It is very normal for baby to feel warmer than us.. please do not self medicate 😰…… While observing, please go and get a thermometer, you can easily get the pigeon ones at NTUC.
I would recommend not self medication for baby. You can refer to your doctor for assistance on the same.