Why should you be confident about your marriage? You are being naive.
Agree with him, this isn't working, he needs to move out, you need to get divorced because he's not a good husband or father. Let him go, you are pursuing someone who doesn't value you. How does that make you look in his eyes?
When you stand up for yourself is when his feelings start to change.
M22,H45,W45 S21/18D12 Retain faith that you will prevail in the end, regardless of the difficulties and at the same time confront the most brutal facts of your current reality, whatever they might be.