Are there any disadvantages of not to letting baby have a pacifier? Like affect their brain development?

no real disadvantage. but baby may suck his fingers. some say that it's easier to ditch the pacifier since we can easily remove it from baby.