I went for a trip right after confinement (which was booked when I was pregnant) and regretted it totally.
I missed my kid so much that I couldn't enjoy myself and was constantly thinking about her and regretting not bringing her along even if it means our itinerary will not go as planned.
It might be a bit more troublesome because you will have to stop for feeding and diaper changing, but other than that I do not see how it can affect the routine much. Furthermore, Taiwan is a baby friendly country, this will probably ease your concerns more.
Read more