I agree - go ahead and do what you want to do. Paint the walls neon pink or something outrageous because YOU are the one living there.
UNLESS, H left partially because he felt that he his opinion didn't matter. My H was the same way, didn't seem to care, never made choices or showed any interest in decorating. But, I have since learned that he did care, did want to be considered and has strong opinions on matters for which he showed no interest whatsoever.
Confusing? Yes. And I do think that you should assert yourself by choosing your own colors, but when the time comes, and you will know it, maybe he can have some input on another area of the house. Just MHO.