Creditors, lawsuits, divorces, and even poor financial habits can quickly chip away at what families worked decades to build.