JujuB - don't beat yourself up, its natural to want a new relationship make us whole after a divorce. And sometimes that desire leads us to ignore red flags.
I would listen to your son if he's feeling uncomfortable.
That being said, don't go to the opposite extreme and assume you'll always be alone. There are plenty of good men out there you just need to shop around.