Agreed with the mom above! Clean tap water will do. But no rinsing at all, I think not so good idea.
When I used to pump in the office, I just ran water to the pump parts and sort of set it in a small rack I brought in and shoot it in a ziplock after a little bit of drying ( I was paranoid some rubbery parts might get smelly when I don't dry them).
When I arrive home, I immediately take it from my bag and wash it with soap and warm water.
You can also refer to the instruction manual of your breastpump if there's special notes to take in cleaning your unit's part.
Read more