So i'm not the best at advice right now. Buuuuuut when things were rough for me I found reply at my own time. one weekend I texted him a picture and he never replied. Then on Monday morning at like 7:45am he sends me this picture of a bunch of food he bought at a speciality market. Did I know it was there, oh by the way he went to that restaurant I had told him about blah blah blah. It drove me insane....you ignore me all weekend then (possibly as soon as GF has left your place) you send me a run down of your weekend. I started to reply and then I didn't. I took a shower went to work, got comfortable doing my job which makes me feel confident and texted him back after lunch with yes I knew about that place perhaps I should have told you glad you like the food at that restaurant. He replied something funny about the market. I ignored.
My point is the second they make contact we LET him invade our once built little fortress of serenity. It will get easier. I had gotten to a place where I didn't really think about him and GF I thought I had accepted it until I got that bomb yesterday.
It will get easier. That's all I can say. Try and concentrate on you!