Maybe it's time for a rehash of what NG's LL are, and how you can step up the pace a little by engaging in one or more of them in new ways. If you can jostle him out of his mini-rut, it may go a long way in showing him (a) you are not going to punish him for the A (b) you are not distancing yourself but coming closer (c) making an effort to show him love in the way he likes.
I'll bet something will change vis-a-vis his lack of affectionate words toward you.
