I'd have to agree with kml on the introvert thing, that's exactly what I was thinking when I read about M.
Some backstory on me that I hope will help give some perspective. When I was in the Air Force I took this Airman leadership course to prepare E3's for the higher supervisory ranks going forward. This was a 2 or 3 week course that involved daily public speaking and managerial skill development. It absolutely destroyed me every single day. I would get home at 5 PM and pass out before 5:30 and usually sleep a solid 12 hours because I was so low in energy. I've never been so drained in my life. One of the days we had this personality expert come out and test us on our Myer Briggs personality to show differences in how people relate to each other. I was the only person there who scored the max possible score in introversion while one other person was a few people below me. Everyone else was near the middle range or on the extroverted side. Either way, the instructor spent a good amount of time using me and the other girl as examples on how extroverts view introverts and giving a different perspective on our behaviors and how their image of didn't fit with our actual thoughts and motives. Such as, not talking to someone or spending time being taken as the person not liking you or not valuing you, when in fact its just difficult to manage our energy stores and we overthink situations.
Anyway, recharging is a daily struggle for me. My job requires me to interact with several individuals, two of them being nearly the opposite on the extroversion scale and its a constant struggle every day.
Please do not look at this and think its something to do with him not valuing the R the same as you do, its just a difference in personality and how we operate, which is normal. The more introverted someone is, the more they are drained by people and the longer it takes them to recharge. I promise going down the "if he loves me he would be recharged by me" is the wrong way to process this and will only lead to resentment and disappointment.
I love my kids and would do anything for them but even they drain me, so that along should say alot about it not having anything at all to do with the person they're with. I need my personal time to keep sane and not just once a week. Sometimes I need mini episodes daily and then a larger period every few days.
I know there are balances and sacrifices in any R, but take the above as a perspective to help understand him more. You aren't wrong to want more time with him, but neither is he for needing his alone time to recharge. There's a balance you both need to work towards and it will take time.
Accept what is, let go of what was, and have faith in what will be