how to avoid middle child syndrome

How can i avoid neglecting my second child? My 3 kids are 4, 2 and 3 weeks old currently. With my first, i got to spend a full 2 years with him before diverting my attention to my second boy. Even now, we get to spend time together when i bring him for enrichment classes (no 2 had not started enrichment, just childcare). At night, i sleep with youngest boy while the elder boys sleep together with their grandparents. Somehow i feel that i am not doing enough with my no 2. It would also be weird to bring him out alone without my eldest boy as my eldest boy would insist to tag along. Can anyone share how can i better manage the kids such that i wont neglect my no 2?