Phil McGraw has a good article-show recap on infidelity with pregnancy by the OP... But lets wait to see what H has to say...
The only `side`I can see from your list is his accusing you of cheating or violence.
It is VERY common for spouses who have been cheating or who are cheating to cross accuse - that is, to turn the tables they accuse the LBS of cheating.. its quite common... and no, they don`t have evidence when they do it... they simply accuse.