4 months baby has fever

my 4 months baby has fever.when i check with termometer ar his armpit is below 37 celcius but his head is 37 to 38 celcius. what should i do? i give medicine every 6 hours according to doc instruction.