He is not providing you what you DESERVE. And he's only doing it right now b/c he wants his EA and you in case that doesn't work out. This where you have to be tough, and I know it's hard, very hard. But it gets easier - I know that sounds crazy right now.
I don't think you are crazy for hurting like you are or for wanting to work on your M. You love him, as you should. But you have to face the reality of your sitch right now...for YOU and your little one. Again, you have to be tough. What is your alternative?
What you will find is that as you let go of your H's problems, you will be much better mentally, physically, and emotionally. But you have to start letting go.