To "notice" something is to see details and then realize what they mean. Simply seeing something isn't enough - you have to think about it as well.

You use "that" to express a fact that someone has noticed. What follows "that" is a clause, which is just like a sentence inside of another sentence:

I noticed that he wasn't wearing a wedding ring.