Baby kicks while sex

Is it only me or is there anybody else you feel horny and you have sex with husband but then during sex you feel your baby kicking then your mood suddenly changes? It’s like my mind is suddenly diverted to the baby. What to do?