Sir -

I dont know if that would set you back, but it sure sounds like you are being used right now by your W. Ask yourself if moving back will make "YOU" fee better about yourself. That is what matters.