Is your baby still wearing mittens, if yes, then yes it may be the fibre so you just wash/pick it away gentle. Baby that young tends to shred skin and hair. If your baby is having dry skin, maybe apply some baby safe moisturiser
err clothings? mittens if still wearing? swaddle?
perhaps from clothings or cloths nearby