I don't think this is that usual of a fantasy. My ex's idea was that we would live next door to each other and be best friends. My response:

"I am only your friend within the context of this marriage."

Everybody hurts. It's part of life. Don't miss the good stuff.