Recognition. You might recognize someone’s success: “I have to hand it to you, I didn’t think you could give such an inspiring speech.” But it can also be a dig: “I have to hand it to you, I’ve never seen someone be so embarrassed from a speech.” Basically, you are confirming that someone did or said something that either was wonderful or horrible. What is being ‘handed’ is either an insult or praise. (Compare to Back-handed compliment or You are the man!)
“I really got to hand it to you when it comes to dealing with the boss, you are good.”