Is it actually possible/ advisable to go on overseas holiday with 2 or more very young kids. I'm only worried we end up in the hotel room doing the daily routine feeding and tiring ourselves even more!

Yuna shared very good suggestions. How about holiday with relatives? What i usually do is plan a holiday with my parents and siblings. They are always ready to help and at the same time can have bonding moments with their grandchildren/nephews n nieces.