I agree. He wouldn't have messaged you on VD if he didn't want a reply. The longer you wait the more rejected he may feel. Even if he's married, the contact will boost your self-esteem and doesn't have to be inappropriate. Do it!