How many times a toddler (boy, 3y11mos) have to drink his formula milk in a day.

Hi mga mommies. How many times do you let your toddlers drink their milk in a day? Kasi ako, tini-train ko na sya na 2x a day na lang uminom ng milk (during breakfast and before he sleeps at night). Napapansin ko kasi, he drinks milk 4-5x a day if we let him just drink everytime he wants. Thats why, I am trying to train him to drink 2-3x na lang in a day. Am I too harsh po ba mga mommies with what I'm doing? I'm confused po, and sometimes I felt guilty po ako if hihingi sya ng milk na hindi ko napagbibigyan. Your advices po will be highly appreciated. #advicepls PTPA. Thank you.