Is it possible that babies have the ability to don't like certain people to carry them? Like 冲? Every time that person carries or plays with baby they will cry.

I don't believe that. It's probably that the person did not carry the right way and make baby feel insecure hence baby will cry. Baby also recognises smells too.