Why do you think he doesn't come out with you as a family? Do you think he feels bad about himself and feels that he doesn't deserve you?
What would you like him to do to show you that he cares? What would prove it to you?
I remember pushing and pushing my H away till he was living in a flat a couple of miles away; we were barely on speaking terms, I threw out all of his photo's cause I couldn't bear to look at him....things were that bad. When I had finally erased every speck of him from my home and from my heart...the empty feeling that I had inside was still there. I started thinking he's gone, thats what I wanted why aren't I happy?
In the end it dawned on me that expecting my H to make me happy was pretty unrealistic so I decided to become happy. To do things that made me smile and stuff him. i decided not to worry about him anymore. Him and his behaviour would no longer effect me. He noticed the differnce in me almost immediatly!! He became curious, I suppose I became nicer to be around...His new found interest gave me confidence and i started to tell him what I wanted. Or I should say what i didn't want. No inapropriate comments, trying to kiss me etc etc. You know what I am talking about.. this made him more curious and drew him in more.
To cut a very long and boring story short. We are now getting closer. It's not without it's hicups. last week was a nightmare, as I started to feel very vulnerable in the R but I am getting there with lots of great help and support from DB board.
My point is this (and I know it's been a long time coming) Could your H be sensing your anger, suspicion and resentment? Could home feel unwelcoming and hostile? It's just a thought. But if what you are doing is not working, why not try something completely different?
I know it's hard. I've been there, still am now on and off...