The patches on your baby's skin should be harmless and will go away on their own after a few weeks. If you have milia and the bumps on your skin aren't clearing up on their own, talk to your healthcare provider. They might suggest you visit a dermatologist or try new exfoliating techniques to help milia go away faster.