My goodness he really likes to play the "I'm lonely" card. Well then maybe he needs to start doing a hobbie or activity that will keep him busy and not have him chasing skirts and hanging out regularly with people half his age?
Sorry, for venting but it's almost like he's blaming you for feeling lonely or alone. You were with him for months before moving back to hometown and yet he chose to spend that time frolicking with someone else.
You did not chase him away Addie, please do not blame yourself. He wasn't healthy enough yet.. and he still isn't.