"Having a thick skin" is an idiom which means not getting upset when people criticize you. 

The phrase that means to become more unconcerned by people's criticisms is "grow a thick skin".

This is a neutral expression — not too formal and not too casual.