What is more uncomfortable... not having a job at all and struggling financially more than you already are OR moving to where the OM lives?
If you are married or not you still have to be able to support yourself so I would say go where the job is. If your W is true in her desire to rebuild your M it really shouldn't matter if the OM lives next door. The boundaries you have put in place (RE: your W and OM) should hold true no matter where you live. If your W violates those boundaries then you know what you have to do as far as the marriage goes (end it).
