That he goes quiet is not that unusual in my world. When my H does, I let it go. Sounds like you have set the boundaries, is that correct?
As far as PMA, do you set goals for yourself and record how you are doing with regards to meeting them? How about exercise (any kind will do)? What makes you feel better?