Rachael, It's not "like being used"...you are being used. He's playing the "emotional" abuse card w/you and that's part of the passive aggressive personality, as well as a mix of mlc.
You should be very proud of what you accomplish and do not allow him to take you down. He sounds so much like my xh who was very passive aggressive and a nasty mlcer.
Hang in there.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.