I think he is daring you to do those things. He might or not not know if you were putting money aside. But he certainly will know when you talk to OW's H, because he will come down on her. I think he is voicing his fears so that you will reassure him that his little world in not in danger. You are not going to do anything despite the fact that he is an a$$ and a whore, as he puts it.
