Hmmm... I dunno, as long as he is doing this "I might leave" thing I would not be getting physical with him.. and I would make him aware of that...

Just tell him you aren't about to hop into bed with someone who is threatening to abandon his family ... Just tell him that's not "sexy" whatsoever...