this would seem a very positive turn of events for you. You say you still love him, and I'm sure your emotions are all over the place about exactly what you want, but now is the time to decide exactly what you want. You have a H who appears finally ready to begin undoing the damage he has caused. Should you want your marriage to work then over time you are going to have to work out how to forgive him for his actions. This won't be easy.
The only thing I can suggest is to really think about what you want, how likely your H's actions are likely to last, and then set out to him some ground rules/boundaries over what you'd expect from him and from a R going forward.
good luck!
BD - 30TH JAN 2015 S - 30TH JAN 2015 PA CONFIRMED - 16TH FEB 2015 (SINCE AT LEAST OCT 2014) CONTINUAL TALK OF D ME: 31 W: 28 T: 10yrs M: 4.5yrs D:5, S:6