Please take sometime to talk to your family members while your hubby is not around. Let them know of the situation. Don't let your hubby feel left out.
Every family culture and way of talking is different. What we feel is funny might be insulting to another.