It sounds as though your H opened the door a wee bit for the "talk" in is his own way with the glass of wine and saying "sit someplace, and I'll follow you". I think this is encouraging, if for no other reason than that he was showing respect with regard to your request for some time with him.
Has your H always been a bit indirect in his communications?