I wouldn't want to deal with the brother at all. Let H bring the kids to see him at his own apartment. Don't see how you're going to score any points there. Be pleasant when you bump into him and positive and make brief but friendly smalltalk to show interest in him? What else is there to do? It's not like you need to hang out with him, right?
