Your are not wrong at all. If his habit, upsets you, he should at a very minimum have the curtiousy to understand your point of view.
BUT, he has already admitted this is very close to being a addictive behavior for him and in this case, I say if he is at all serious in restoring your M, he needs to stay away from it totally!
