My only concern is that the more I step back the more he walks all over me trying to get a reaction from me.
It's almost like he's testing me. I really can step back as long as he contributes financially. I've accepted that I won't know which job he's at when.
Of course he is testing you...
You have been telling him that you are different, yet your actions are saying that you aren't...
Why wouldn't YOU test that if the situation was reversed ???