Aren't you? You've made so much progress.... you kinda seem to be backing off .... part of his coming to a comfortable place in trusting your relationship may very well be.... seeing that even when he's being ugly and unlovable.... you are there! showing your support in spite of his attitude at the moment.
Just a thought Amy...
Psa 51:10 Create in me a clean heart, O God, and renew a right spirit within me.