LO Cries When I carry But Not When Others Carry

My LO Cries murder whenever I carry her when she wake up prematurely from her nap and will put her hand to mouth and make hungry face. Once my mil take over however she always quieten down instantly and dozes off immediately. Makes me v frustrated as I just can't put her back to sleep n need my mil to help but my mil is only helping out temporarily. Is it because I have the milk smell that's causing her to always want milk when with me? I feel like she only associates me with milk and nothing else. I don't latch her but bottle feed ebm.