can't drink milk during pregnancy

Hi Moms, I'm currently 28 weeks pregnant, and I've been having a hard time with milk. The smell of it makes me feel nauseous, so I haven't been able to drink it at all during my pregnancy. At my last ultrasound, my doctor mentioned that my baby is measuring a bit smaller than expected for this stage. I'm really worried and wondering if my inability to drink milk might be causing this low fetal weight. Has anyone else experienced something similar? What did you do to make sure you and your baby got the necessary nutrients without drinking milk? Any advice or suggestions would be greatly appreciated! Thanks so much for your help!