This means to do what you said you'd do, or do what you promised.

You can express what you're following through by using "follow through on ___":

Are you going to follow through on your promise?

You can express what the promise was using "(someone's) promise to ___"

I'm starting to think that she might not follow through on her promise to pay us back.