When you asked him if he was happy and if he loved her and such, that's NOT the way to handle that, when you ask questions like that you VALIDATE the affair into something respectable and acceptable...
If someone lies and steals, you don't ask them if they are happy doing what they are doing, you don't ask tehm if they LOVE what they are doing... you just tell tehm its selfish, sleazy, and cruel and you HANG UP THE PHONE
THAT is the only way to respond to infidelity, give it the indignantcy it deserves.. a hang up and silence... that's all infidelity deserves
silence says that best... that's what I think he needs to hear