IMO your family attny would not be able to handle a divorce case as he has once represented both you and your W for other issues.

That would be a conflict of interests. Unless this differs by state when you consult with an attny in the area of family law it is required the attny run a check on both you and your spouse to be sure the other spouse has never had a consult or conducted any business with ANY attny in the practice.