I understand your frustration. I do! Here's my take. You CAN have that conversation if you so choose, although I think you know the response will not be as you hoped. Only you can decide when you are truly ready to move on and no one will fault you for moving on or continuing to stand.
Here's the truly difficult part. If your h decides he wants to give it a go, he knows you don't want a d and he knows where to find you. This isn't a 2x4 by any means.
Hang in there!
3 kids BD 12/15/13 (IDKIILY. ) Rope dropped Cirque du Soleil style D final 9-9-14 "Some people are born on 3rd base and go through life thinking they hit a triple." Barry Switzer