I envy your sitch right now. But follow your heart. Maybe you do need time apart to make him really realize what he is missing. But if you do leave, you need to detach from him.
I was doing great detaching from my H, but since we spent the holidays together, it's been really hard on me.