If the apt is a good move for you and the kids, go for it.
You really need to think of yourself as a single parent. I have a frame of mind that has been helpful for me; it is that my H is a friend that is just really into my D's. That way when I say something and don't get any feedback, I can just let it run off without any worries and do what I think is best.
The more you try to do what you think will make him happy, the more pressure you put on him (interestingly enough) and the worse you feel when it doesn't work.
