I think you did the right thing Hopeful. Just because R talk is not something we should be dabbling in, doesn't mean we have to let them walk over us or allow THEM to remind US about it either.
A few weeks back my W was volunteering for a fall fun day at our S's school. She got the parent volunteer list and saw they were all moms. She made the joke/comment to me, "geez, you should've volunteered, could find yourself a nice single mom <laugh>". Granted that's not nearly as crass as what your H said. I let it go and didn't comment, but I regret it a little. I just couldn't come up with something that seemed an appropriate comeback. I think what you said was pretty spot on.
Married 6 together 8 Me:38 W:31 second marriage for both SS12, SD10, S6 Bomb: 9/8/11 (day before our 5 yr ann) W moved out: 2/18/12 D final: 11/12/12 Share S 50/50. Spend as much time as I can with SS & SD