It sounds like your H is definitely pursuing you. It hard to tell what the motivation really is. You should set the boundaries as you feel appropriate, and it sounds like that's what you're doing. Unless your motive is revenge or anger for not wanting to go on a date, don't go on the date. Go when you're ready.
Don't worry, the GAL'ing will fall into place, even if you have setbacks here and there.