I'm sorry you had such an awful experience. It does seem that he wants to have power over you, to tell you what to do and give you orders, which you are not good at taking. I really think it is time to stop inviting him places. Spend time with people who like you, and like being with you. If he is not one of those people, then avoid him.
