You are both in your 20's? This is a lot to handle from such a very young marriage. Things have not really gotten tough for you yet (and believe me, with 25 years of M under my belt- things will get tough at some point.)
It sounds like you are making quite a bit of excuses for his behavior- stop.
It sounds like you are hanging onto crumbs of his attention, while he is not playing with OW- stop.
I am so very sorry you are here. You sound like such a considerate person, use that talent on/for yourself.
Do you have any children?
He is bieng so tacky talking about himself, the OW and his life, his this, his that... you may need to cut yourself off from this selfishness before you bottom out