OK, I didn't mean you had to use that question. You are the best judge of what question you need answered. But looking at what you say, maybe the question is more like how do I feel about our difficulty in finding time for each other? Because you do have a conflict inside. It's not all rosy when you spend time together. You feel cheated knowing that he would rather be somewhere else, doing something else, and you feel patronized, and you feel demanding, and all-together unsatisfied with the way things happen. This is a knot that needs to be sorted out.
