e-discovery 2.0

As a long-time reader of The Economist, I was excited to find that this week’s edition writes at length about the exponential growth in electronically stored information (ESI), and how people are using technology to manage it.  I believe this is one of the most significant “mega-trends” impacting our economy, and I was thrilled to see it recognized by a mainstream publication. But when I read the 14-page special report, I was disappointed to find that its analysis of the legal and regulatory implications of “the data deluge” is really weak.

The survey does a good job of teeing up the issue:

The world contains an unimaginably vast amount of digital information which is getting ever vaster ever more rapidly. This makes it possible to do many things that previously could not be done: spot business trends, prevent diseases, combat crime and so on. Managed well, the data can be used to unlock new sources of economic value, provide fresh insights into science and hold governments to account.

It goes on to talk about how companies like Walmart, which has 2.5 petabytes of point-of-sale transaction data, is using business intelligence software to analyze the 1 million transactions it does every hour. By doing so, Walmart is able to improve the efficiency of its supply chain and the effectiveness of its marketing. The article also describes how companies like Amazon and Google use web analytics software on click stream data to improve their services.

What’s missing is an equally intelligent analysis of the legal and regulatory implications of all this data. The move from paper to ESI (email and files) has created a user-generated, written record of everything that happens in a company. That’s incredibly helpful when, after the fact, questions or disputes arise. Rather than relying on incomplete recollections, courts and regulators can now consult a written record – one where every document is time-stamped and very often attached to a person’s name via email. That enables judges and regulators to get better information which, in turn, leads to better decisions. It’s hard to quantify the value of that, but there’s no doubt it’s substantial.

There is, however, a catch. Because the volume of ESI is so great, it’s really expensive to gather, sift through, and then produce information. Add the requirement that the process needs to be defensible (i.e., easily explained in court), and the whole thing gets really expensive really fast. Hence the need for electronic discovery software: it’s the only cost-effective way for companies to manage their ESI from a legal and regulatory perspective.

That’s why I believe e-discovery software will be as big a category as web analytics software or business intelligence software – it’s a different side to the same coin. Or, more specifically, a different dimension to managing digital information stores which, as The Economist points out, are growing tenfold every five years.

Update: Nick Patience at The 451 Group has also posted on this topic, at almost exactly the same time as me.

Learn More On Litigation Software & Litigation Support Software.

Last month, for the first time, friends of mine who do NOT work in the legal industry starting talking to me about e-discovery. In the past, they had always taken on the glazed look of a bored 8th-grader whenever I spoke about what I do. But suddenly, they were strangely interested and full of questions.

The reason was two articles about e-discovery in the mainstream media which appeared within a week of each other. The first was in the Wall Street Journal, which wrote about how tech firms are at war with lawyers. According to the Journal, the fact that companies are saving money by using e-discovery software is bad news for lawyers, since they are “facing the loss of lucrative client fees.” In response, the lawyers are fighting back: “The attorneys counter that there are pitfalls to replacing them. Early this year, a federal judge required chip maker Qualcomm to pay rival Broadcom more than $8 million after it failed to uncover and share emails relevant to a case.”

I am sure there are lawyers who see technology as a threat, but the firms I deal with are actively embracing e-discovery technology, not fighting it. They see it as another way they can add value to their clients, and would prefer to have their staff focused on practicing law, not mindlessly reading irrelevant documents. So I ended up spending a lot of time explaining to my non-legal friends that there are two sides to the coin. As for my friends who do happen to be lawyers, they focused on the Qualcomm case, pointing out (as we have written before) that the problem was not technology, but rather poor processes and bad judgment on the part of the attorneys concerned.

The second article appeared in the Economist and took a different tack. It argued that the stratospheric cost of e-discovery is gumming up the court system and preventing justice from being served. According to one former justice from Colorado quoted in the article, even mundane landlord-tenant disputes “are now digital wars of attrition”; there are “cases that are settled only because one party cannot afford the costs of e-discovery”; and, many “plaintiffs cannot afford to sue at all, for fear of the e-discovery costs.”

I love the Economist’s tongue-in-cheek style and thought the article made many valid points. My one disappointment was that its spin was unequivocally negative, as though e-discovery is a self-inflicted wound on the American judicial system. Nowhere was there mention of the fact that electronic evidence often helps litigants get at the truth. Rather than incomplete recollections or “he said-she said” claims and counter-claims, there’s no disputing an email that captures a person’s words and actions in black-and-white. Nor was there any mention of how technology is solving the problems that it inadvertently created: today, there are many products that rapidly sift through electronic information, dramatically lowering the cost of e-discovery.

It is great for everyone in the e-discovery community for our domain to get more ink in mainstream, quality publications. I expect that the trend will continue as the industry grows, and especially once the investigations start into our current financial meltdown.