Is it actually possible/ advisable to go on overseas holiday with 2 or more very young kids. I'm only worried we end up in the hotel room doing the daily routine feeding and tiring ourselves even more!

You can consider clubmed as well. They are very family friendly and have programmes specially drawn up for the children. Their baby clubmed can cater to babies and toddlers. https://www.clubmed.com.sg/l/kids-baby Personally, I feel that a vacation should be relaxing and enjoyable. If you feel that you will end up being more stressed than relaxed, perhaps you can wait till they are older. For now, you can consider a staycation as an alternative?