Because you have kids and combined assets, I would advise that you have a legal consult just so you know where you stand.
As to that convo with landlord, they are men and they are pigs. I wouldn't pay much mind to that.
As to what I see with your sitch, your H is very confused. You need to give him space and have him miss you. Have him get a bit jealous. That is when you have the most reaction from him.
M:27 H: 33 M:10/07 T:9 yrs H moves away for drug recovery: 3/2010 ILYBINILWY & wants D:5/02/10 Confirmed OW:5/21 Told MIL:5/25(only concerned about H's recovery) Told FIL:5/28(will speak to him)