Glad that you enjoyed your time with your H. As long as you are comfortable and enjoy it, why not. Don't think about D so much. What you do is still DB effort. Don't give up until it is really over. Maybe your H decides differently. Who knows?
For me, my W has burned the bridge and it is very hard to return. Trust and proud are staying in our way. We can't even talk to each other face to face. The hurt is too deep.
Your situation is different. So don't throw the towel as yet.