It does not sound like anything is wrong. He is gaining weight. I would continue to give bm only and monitor. As long as there are wet Diapers ill say it's okay. Also if a baby is hungry they ain't going to keep quiet. That's for sure. Many moms worry that their milk is insufficient.