If I tell him he can't come here anymore how is that DB'ing?
I suppose not technically. But if you want it to be a boundary, then set the boundary.
I don't have the answers. I just see what you are doing doesn't work most times. He comes and goes, but in a way its good that he is comfortable there. AS LONG AS you feel respected and loved, not used.