I'm not surprised that Mr. GAG did not come to the door; this is not his normal pattern and as a 'first' he would probably need to do that alone. Being with his sister and coming to the house would likely give an impression of contact between you and he's probably just getting used to the idea himself let alone giving this information away to someone else. I think Mr GAG is doing this reconnecting stuff on his own terms and in his time.
I wonder if H feels uptight about you and his sister catching up, thinking that perhaps he is topic of conversation?? It seems possible given this is the second outburst related to you three. Perhaps XH thought he told his sister a time and he was ready to go thinking she'd be punctual.
I can imagine your frustration but I think you just disregard your observations and carry on in the positive way you have been moving of late.