"I've got to hand it to you" means "I have to recognize your accomplishments.

You use this phrase to praise some who you don't usually praise, like:

• someone who you don't get along with
• someone who proved that you were wrong

You can also say "I have to hand it to you" and "You've got to hand it to (him/her/them/etc.)."