"I should be going" is something that you say when you're ready to leave a conversation or a meeting. "I should be going" is polite, but it can sound either friendly or cold, depending on how you say it.

You can also say "I should get going."