If you don't want to be around him, don't. It's okay to break up with someone you've been dating - that's why it's called dating, it's just a trial period to see if you are compatible. I certainly wouldn't want to be with someone who picks on me and then can't own it but still tries to blame me for it.
Also - if by any chance you are somewhat ADD like your son (it's missed a lot in girls because they often don't have the hyperactive part) do you really want to be with someone who is bothered by that???
