Baby refusing milk at night

My baby is 3.5 mo old and suddenly keep refusing milk at night. When she wake up in the middle night, she is sucking her thumb and just go back to sleep and not drinking the milk when i offer her. she is fully bottle fed with fm. It is stressing me out as I don’t know if I should just let her sleep through or keep offering milk. Can anyone advice? Tia.