I think you did just fine. Ask him stuff once about the kids and then drop it. It's his loss.
About the retainer, just because it's $6K doesn't mean that's what it will end up costing you. It's just a deposit. If you only run up $3K in fees, they refund the rest. And depending on the laws in your state, if he is the sole breadwinner he may be responsible for your legal fees, within reason.
Get a good lawyer. One that understands your position and does what YOU want.
That doesn't mean you want a divorce.
Everybody hurts. It's part of life. Don't miss the good stuff.