Is it actually possible/ advisable to go on overseas holiday with 2 or more very young kids. I'm only worried we end up in the hotel room doing the daily routine feeding and tiring ourselves even more!

It is possible if you choose the right holiday destination and do your research. My friend recently went to Bali for a week's vacation with her husband and 2 young kids (3 year old and 8 weeks old). Apparently she hired a local holiday nanny when she was there to assist her, thus giving her and her husband to have some fun and not worry too much about the kids. This is the service she used, which came highly recommended: http://www.karsini-services.com/nanny/nanny.php You can choose to have your nanny on-demand, part-time or even live-in during your stay. My friends had lots of fun during their holiday because of this additional help. Perhaps you can consider?