There is no question that low desire in men is often not a testosterone-related issue. There are many, many reasons a man may not feel turned on. However, it stands to reason that a physical check up is an efficient way to eliminate low testosterone as a potential cause of the problem. You're right though, low testosterone isn't the culprit many wish it were.
