I'm 36wks pregnant. When should I be worried about baby decrease of movements?

I'm 36wks pregnant. But a few days ago I realised my baby hasn't been moving much (or at all). Im not talking about kicking because i understand my baby is getting to big. But sometimes there's no movements at all for several hours. Even after I eat, walks around the house and eating sweets. Tried to poke around my belly which usually my baby will respond. But not anymore. I am kinda worried but people around me been telling maybe the baby are getting to big to move or she's just sleeping. Should be worried or it's normal? FYI, I don't do the kick counting at all.