What the hell does he have to gain by being outside the relationship? It sounds like if he comes home you will do right by him and your marriage. That both of your needs can be met mutually benefitially.