Try having more frequent feeds. It is expected that he will be drinking less for each feeding. So you can try nursing more frequently during this period. If he refuses to latch, perhaps can try feeding him with a spoon or from a cup.
Take care mummy! Hope your little one feels better soon!!