((((((Bunny)))))) I think he has proven that he hasn't heard a word you have said. It just helps validate that you are doing the right thing.
It sounds like you have already figured it out, but I would stay away from anyone associated with "swinging". Their thinking is similar to your H's, they are just trying to take advantage of your situation, to use you.
Stay with what is comfortable for you. And remember that sometimes doing nothing can be doing something. Just get yourself stabilized. Be a happy Bunny!