No it's not crazy - not at all. I feel exactly the same way. I miss my W more than I ever thought possible - unfortunately at this point in time she doesn't feel the same.
Do not pursue!
W 39 Me 33 M 9yrs 8 year old Son ILYBINILWY - Dec 12 W moved out - Jan 2013 OM - Jan 2013 I file for D - May 2013