Sandi, as long as you live with this man, your house is never going to look like House & Garden. Can you accept that? Can you live with that without making yourself nuts?
The matter of taxes is something else. If you are liable or in any way legally responsible, you must take some action to protect yourself.