One of my friends who encountered the same situation suggested having another caregiver bottle feed the baby.
When baby sees that you are around, he/she may prefer to breastfeed.
She also tried feeding her baby using a spoon, syringe or a cup in the day when baby refuses the bottle.