First off, good job on your part with the boundaries and stating what you need in a strong way. You stated your piece from a position of power rather than weakness.
As far as the "touching" stuff goes, I will give you a guys perspective. IMHO, I think he genuinely feels bad for you and feels bad for the pain he is causing. He is trying to comfort you. This is how a guy reacts when someone they care about is hurting.
Again, IMHO, he needs to see what life will be like without Olive. He needs to see what he will be missing without you there. More importantly, you need to know that with or without him, you WILL be Lovely, Vivacious, Sought After Olive.
Being under the same roof makes this difficult, but you need to do it, for yourself. Since I stepped back 10 days ago and as much as possible quit worrying about her, I have slept better and felt better.
I am praying for you.
Me: 44 S: 17 and 7 Final-6-13-08 I once went to a psychic who told me I would soon feel cheated......