Sometimes hubby says this kind of thing just to save face or joking. One of my colleague who married an older woman said to me : "yeah, i kanna cheated by her" but of coz you know he said it jokingly and i know quite well that he loves his wife. So just talk the things out with your hubbie.