I am starting to wonder if the reason I can't feel ok in my M is because I don't want to be with him anymore

Very possible.