Are there any disadvantages of not to letting baby have a pacifier? Like affect their brain development?

No . I didn't intro pacifier to my almost 2 years old toddler since birth . She'll self sooth herself using her milk bottle nipple