This is something both of you have to work it out.
Considering the fact that he married you aka took responsibility of the child. He should be a decent man.
If you feel both of you can't get along.. Maybe both can consider a separation deed and live in different room
At the end if the day the child is innocent..if both parent willing to care for the child, the solution must come in the care arrangement.
Read more