Wendylon, why are you scared to ask your H what time he'll be back? After all, he's the one who suggested going on a b-day dinner. I think it's totally ok to tell him, "hey, are we still on for my b-day dinner?" Heck, it's your birthday, and you deserve to be treated well.
In regard to OW #1, what changes did you two make since then? Were the risk factors for another A still there during the past few years? Even more importantly, are the risk factors present now? What can you do to get rid of them? Think about it.