Sorry, I misunderstood. Has your H asked to go along on any of your GAL'ing? Have you told him he could join you if he wanted?
If your H is constantly angry, as you described, then the issue isn't you - yes, you probably know this. Has he ever spoken to you about how he sees himself? Does he like himself? How's his self esteem?