I have connected to your situation, and through your writing style I feel I know how you are. So I don't believe that I actually physically know you. Your writing style leads me to believe that you are a loving woman, and that you can be adventurous and romantic. Your husband will regret his choices later, unless he is a heartless soul and they say that even heartless folks pay too. Do right, as long as your environment is good you will get what you put out.
Having been used as a disposable dad, I know how you feel. But when I was younger I am guilty of bailing on a marriage so I now get to see how the shoe is on the other foot.
God bless you, and I would love to take responsibility and spend time with a woman such as your self.