My 4-month old baby shouts too loud now. It sounds funny and entertaining to us. Is she learning to talk now or just need some attention?

A little of both! It's so cute isn't it. Hahaha. My girl was very vocal around the same age. She would about for attention but sometimes she was just playing on her own. It is also the period where they discover their own vocal cords. As she began to progress along she was able to call nen nen(milk), mama and pa at 6 months! I think your turn may come very soon.