I don't think anyone will holler at you...more likely they'd like to holler at your h.
before you married you set up a list of what you wanted and he agreed..he didn't live up to those things..you've stuck it out..you've even changed your life to accomodate him (stop doing that! you'll feel much better about yourself if you get back to being you) he should do the same.