Crying baby

Whenever I carry my newborn, he always wants/ looks for milk and starts to cry. I can't even hold or carry him properly without him crying. He stops crying when other people like my mom or husband carries him. Anyone facing such issues and how to deal with it? Thank you.