IMO, if you want to go out casually with this guy and you have boundaries for yourself just as you do with your H and ML... then I think it's okay. But maybe you need to let the guy know what's going on and you're not interested in a R rt now... just keep it casual? I'm sure there will be varying opinions on this but you're the best judge.
Seems your H is still conflicted. Keep getting on with your life, he's aware of your feelings and it seems like a step in the right direction.