What an infamous statement!!! I've heard a similar one. It's like they are blaming ow and you for H being in the situation. I think you handled it very well.
You are so right Cathy, you aren't doing anything to make him stay. You can't tie him to the house. There's a reason he comes back, he just needs to figure it out.
When you can't make a decision because you are torn between your heart and your head, listen to the half with the brain.