When you're sorry about something, use this phrase to explain what it is you're sorry about:

Sorry I didn't listen to you.

Sorry I was late.

This is the same as using "that":

I'm sorry that I was late.