W11D4 - Can I drink tap water without boil? I heard is alkaline water.

When I was pregnant, the tap water tasted and smelt like chlorine. My taste buds and smell sense were very strong. I was only drinking bottled mineral water throughout my pregnancy