Drinking water for baby?

We are living in a rented house until Aug this year, but I'll be having my baby soon in July. I wonder if I should buy bottled mineral / drinking water to feed my baby? As the kitchen does not equipped with additional water filtration, and we are not planning to install one until we move into a new house. Is it ok or should I boil the water straight from the tap? Thanks all for your advice.