Is it safe to use pacifier while sleeping?

I remove the pacifier once the toddler is fast asleep. and slowly purse his lips.