I think it's also the use of the word "just" here. It's as if you're justifying YOUR distance from him, when HE'S the one cheating, and you are only protecting yourself emotionally!
That "just" is used as a softener, MB, as a way to "rescue" him from feeling the consequences of your delayed response.
Do you see that?
Puppy
I am completely with you on that one PUP... he feels guilty so he wants to make sure YOU aren't angry with HIM.
When you say "just along night" he hears...
I love you, I don't believe you are hurting me at all, my upset has NOTHIGN TO DO WITH YOU.
He wants you to let him off the hook.... its a symptom of his guilt.. and when you tell him your distance is from a long night he does a happy dance... HE is GUILT FREE for a few hours...
You need to stop feeding him these life lines...
Tell him he's HURTING you, shut him out, and watch him DROWN in his GUILT.
He will NOT last long under those conditions... no one with a shred of conscience could...