as you also have to think of the expenses, i would suggest that you first speak to your hubby about the issues you are having.
he can talk to his father and brother and tell them what's going on. once your baby starts school, you can take up work and maybe move out then?