Yup... Just go to it the way you are... Make sure you have friends and famly who are pushing him to end the affair and return home.

That's what you want is YOU moving away and your friends and family pressuring him to follow you before its too late.