Have you asked him to go to a Retrouvaille weekend with you? Check out the location of weekends on their webpage, www.helpourmarriage.com.
It sounds to me like this is not about you, that he is depressed. Walking away certainly won't help the situation. There are times in people's lives when they need help from outsiders. This sounds like that kind of a time to me.
