mother not taking hospital drugs

I am 24 weeks gone but i dont take the drugs goven at the hospital, but i eat a lot of fruits and vegetables. I hope me not using the drugs doesn't affect my baby?