Are there any disadvantages of not to letting baby have a pacifier? Like affect their brain development?

There are pros and cons to everything but I don't think there are any adverse effects on the brain and development with regards to pacifier use. I mean, lots of us used it growing up and we turned out fine right? And same goes to those who didn't use it :)