Yes it is tough.....as much as you'd probably love to bash him it won't do any good for your kids. I think what you have suggested saying it's an adult issue is a good idea...they don't need to know the details.
I wish none of us would have to be in this predicament but wishing won't change anything. We just have to do the best we can with our situations even though they are tough.