worry not! this is a common problem in babies :) a really good remedy is to apply breastmilk to your baby's chapped lips!
here's an article that has more information that you could use :D http://www.healthline.com/health/parenting/newborn-chapped-lips