You need to have a heart to heart talk with your husband. Say anything and air your pain and frustrations. As a husband and father, he's ought to prioritize you over his family no matter what happens. I'm sure, sooner or later he'll recognize his shortcomings.