How would you feel?

My baby looks exactly like me (mom'side), a lot of other people who knows us also thinks he looks like me , but the father's side (husband sides and inlaws) always insist he looks like his dad and they would always tell other people that he doesn't look like me and I suddenly feel bad. is it normal to feel?