Newborn feeding time

Hi, im a ftm. My baby is only 4 days old. Im supposed to be feeding my baby for every two hours. But when it's feeding time, he is still sound asleep. Even when i try waking him up to give him milk, he will still continue sleeping .. is this normal? Can i just wait for him to wake up on his own and feed him or should i just try feeding even when he's asleep? I really help on this. Thank you!