I agree. Do not let him off the hook for fear of what he might think about you. I'm catching that from my stbxh now. Whining.
Never believe for a moment that you are taking anything from him. You earned it and more. Think of your D, and what the difference it will make in her life. H's tend to forget the sacrifices you made for them and your family when they are in tantrum mode.
Why should you work two jobs to break even while he takes vacations. Poor, poor pitiful me is a song sang too often by our WAS. Don't buy it for a minute.