Hi JB. To build on what DV said (great advice, IMO) I'd suggest you give thought as to where/how any potential conversation might take place.
I'd tend to think a neutral location (neither of your homes) might be good, and not something you're "stuck" in for a long time such as a meal. If you think a public location is okay then perhaps a coffee. If you feel privacy might be best to avoid a potential scene maybe you can take a walk around a neighborhood?
I think it was very smart of you to not tell anyone else about a potential conversation. No need to complicate things with anyone else's opinions or guidance.
I don't see any 2x4s coming your way since you seem to be approaching this with a strong mental attitude and a calm demeanor.
