Trust me it isn't you one bit, ya you made some past mistakes, but your truly repentant and being what a guy would love to have in a R, a real peach.
He is just destroyed inside right now. Not sure to go back or forward, even which way is up. Make him feel needed, so he can be a man, but don't be needy. He will have to rebuild his confidence himself.