oh, when I mean he needs to move out, I don't suggest you push him out. Let him do it. Not sure how. May be let him know that if he wants a D, first step is probably to move out. And arrange visitation of kid. Let him set the pace.
(I bet OW will do the pushing for him to move out, which will be positive from your side) Take care