I would tell him "considering where the economy is and where our marriage is at right now, I don't think it's a good time to be adding any to our principal balance of our mortgage right now," and wash your hands of it. I think the man is foggy and wayward, and you shouldn't do anything to enable his fog.
