Newborn having a fever

He's only 10 days. I suspected he got fever from me cause I'm having a fever due to breastfeeding... swollen breast leads me to fever and I still pump out milk to feed my newborn cause most say fever still can breastfeed? How to overcome his fever ? He's drinking well and pooping thou