I'm sensing (through the internet, I know...) you want to know what to do right now, and you're hoping to get an answer to speed up the process and hopefully not have to go through a 2-year ordeal. From what you've relayed, it looks similar to what we've been dealing with. And what we've been dealing with takes a long time.
To directly answer your question: keep giving him space; which means don't pressure him about the once a week activity. I know you guys agreed to it, but I'm guessing he doesn't want to do it and forcing him into it is just going to drive him away. At least he has noticed something and told you about it. My wife says nada. Keep it up, but I'd forget about the once a week activity.
M: 41 W: 41 Married 2003 2 boys 9 & 6 Bomb Dropped May 2017