You start a sentence with "I have to admit..." when you're telling people something that you feel a little bit guilty about:

I have to admit, I'm pretty bad with remembering names.

I have to admit, I thought you were kind of annoying when I first met you.

You don't use this for things that you feel really guilty about, like making a big mistake at work.