If you didn't respond back last evening, then I would sit on it for a while. I find it quite interesting that he was a bit spoiled considering how his mother is acting.
If he says something again, say "h, I'm sorry that things were difficult for you growing up" and leave it at that. As for your son and him growing up to be better than h, you could always say something like "h, we both want to see son grow up and be successful and learn how to be responsible and accountable for his actions. However, it would also be nice if he were able to have a well rounded life which includes fun as a child/teenager too."
Of course, these are just suggestions and you can reword them to suit the situation.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.