You've mentioned that both you and your wife are churchgoers. Have you spoken with your pastor or priest about your situation? Sometimes that gives people more clarity.