Aw speed, the thing is buddy, we feel that way because what we see in our minds is that person that we used to love being with. The possibility of ever having that with someone we are already comfy with is so damn hard to get over.
J, I believe a lot of that is the same for you. You are almost over him and ready to move on. I imagine this is because you do hang on to the thoughts of what once was and the fact that you do so miss being loved that way and just want to feel that warm and fuzzy feeling again. It is easier to sit back and think why can't my spouse just pull their sh^t together and be that person again than it is to say to yourself that you can find that again with someone new.
That my dear is the hardest thing for each and every one of us. To be able to get past that comfort and safe feeling that we have with the spouse that we once had a good R with. The one's here that move on simply find that place, that ability to see that there is more life to live out there and someone else who can give them what they need. You have to come to that place in your own time J, and it sounds like that is the direction you are headed in.
It takes a strong person to be able to find that place J, keep up the fantastic job that you are doing and by all means, meet with him and do what you need to do.