stopped by my house and visited unexpectedly several times, text me and stopped in my office after my 3rd daughter had a stint in the NICU. Then went after my wife
Likely he was after your W from the moment he met her. That would explain much of what you describe here.
"I will never be able to detach, seeing him almost weekly, he walked in the bank at 9am, and all I can think is my wife left his bed within the last hour."
This tells me that you do not understand what detachment is. In fact, it is always a good exercise to let a LBS explain what detachment is to them. So can you explain to us what you believe detachment means?
If you think it means some kind of "Eternal Sunshine of the Spotless Mind" thing then you clearly have it wrong.
M(53), W(54),D(19) M-23, T-25 Bomb Drop - Dec.23, 2017 Ring and Piecing since March 2018