I loved people in the past who did far worse than tell me things. I have told them I love them in spite of what they have done. I guess that is the difference between you and your H. You are able to express your feelings regardless of the past and he is not.
