Your wife senses that you are afraid to stand up to her. As a result she feels free to carry on with this affair without worrying about the consequences. IMO, you are helping to plant the seeds of the destruction of your marriage. Only by making it clear to her that you will not stay married to her if she is going to play footsie with another man can you hope to possibily save your marriage. Showing weakness will end your marriage.