My baby keeps looking left and right but not straight ahead (or at me) - is that normal??

It seems that your baby is curious with it's surrounding. Try holding a toy infront of your baby and interact with them to see if they are able to focus on you. Do not worry much as young babies usually aren't unable to see well yet till they are about 5 months old.