I may sound ignorant.... but was wondering is it a must to sterilize baby's feeding bottles?

You can stop sterilising gradually after baby starts solids. If baby have not started solids, it will be good to at least sterilise the bottles once per day and rinse with hot water thereafter.