Going to the gym actually makes the HD/LD situation worse. For me it does the following: 1) It raises my desire level (more testosterone). 2) There are in-shape women working out there to remind me of what I don't have. 3) I work out to keep my body in shape specifically for the ladies. I want a lady that loves to touch. Again, reminded of what I don't have.
