You are living in his upside down world. Read "Controlling People: How to Recognize, Understand, and Deal with People Who Try to Control You" by Patricia Evans.

He sets a pattern and you let him live it. Shut. It. Down.