Do not delete anything! I am astounded that anyone would think that is a good idea.

You were right to think to keep them as "evidence" in case it escalates. Just make a hotmail folder called "evidence" and put them in there where you don't have to look at them every time.