Do you put water in bottle warmer and then put the milk bottle to warm it?

I do it the traditional way, not using a bottle warmer but a stainless steel mug - but the concept is the same!