"Sorry you feel that way, you know how I feel about D. You need to do whatever you think is the best decision for yourself and what will make you happy"
change to
"YOU may feel that way, yes, I don't doubt it. You and I are parents, WE need to do whatever is the best for these children and what will give them the best life they can have. What's best for these kids is what we need to work for."
Notes :
I took out the sorry, I saw no need to sympathize with selfishness
I removed the happy and changed for "best life". I find during infidelity people confuse true happiness with unhealthy excitement and sheer adrenaline
You can keep playing with it until you have something that sends the right message