Belly button gunk

May I know if I were to remove the dirt from my belly button, would it cause any harm to the baby?