Nope...it isn't a good idea unless the friendship INCLUDES the spouse at all times...otherwise there is too much room for confidencial talk that can lead elsewhere...
I think it is especially so if there has been infidelity....and in my opinion anyone who would insist on this right of friendship after infidelity is definitely up to NO GOOD!
