e-discovery 2.0

Next week, as most of you know, is the Superbowl of legal technology events.  And, so if this is a newsflash, you’ve probably found this blog by searching for the European Cockpit Association (“ECA”).  If on the other hand you have an unnatural affinity for the other ECA – early case assessment — then you’ve probably been planning to head to this year’s LegalTech show immediately after the last one ended.

For fear of gratuitous self promotion, I will be moderating several panels with e-discovery pundits on the first day. Akin to the upcoming Superbowl, these “Supersessions” will be chockablock with EDD luminaries and it’ll be all I can do to get a word in edgewise.  Below is the schedule. Feel free to pre-register since we expect a packed house.

1:00 – 2:00 pm: The E-Discovery Expert Panel.  This session will discuss best practices in e-discovery. Panelists include:

• Jay Brudz, senior counsel, legal technology at GE;
• Ron Best, director of legal information systems at Munger, Tolles and Olson, LLP, and
• Brian Hill, senior analyst at Forrester Research, Inc.

2:15 – 3:15 pm: Strategies for Transparency and Cooperation in E-Discovery. This session will discuss how to move toward a more cooperative resolution of legal disputes.  Speakers include:

• Sean Gallagher, partner at Hogan & Hartson, LLP and
• Lauren Schwartzreich, associate at Outten and Golden, LLP

3:30 – 4:30 pm: Ask the E-Discovery Doctors. The “doctors” will take questions from the audience and provide their prescriptions for a wide-range of e-discovery topics.

• Craig Ball, attorney and president, Craig D. Ball, P.C.
• Ralph Losey, attorney and co-chair of E-Discovery Practice Group, Akerman Senterfitt,
• George Socha, attorney and president, Socha Consulting, LLC

While it’s probably not fair to pick a favorite session, my sense is that the last one will be the most anarchical, chaotic, and stimulating, assuming that the speakers don’t take the faux Doctor thing too far (yes, they will be in scrubs).

Please come by to get your recommended daily dose of e-discovery insights.

Earlier this month, Gartner published its third annual MarketScope For E-Discovery Product Vendors. Written by Debra Logan, Whit Andrews, and John Bace, the report is an excellent survey of this rapidly evolving market. It is also a useful buyer’s guide for anyone considering a purchase of electronic discovery software, since it analyzes and rates various e-discovery players. You can buy the report at Gartner’s site, or access a complimentary copy here.

The report covers 18 e-discovery software vendors. Missing from the report are e-discovery hosted/software-as-a-service (SaaS) providers and small e-discovery software vendors. Gartner believes the market is maturing and only larger companies are viable in the long run. So it increased the minimum annual revenue requirement for inclusion in the report to $15 million.

My guess is that next year Gartner will discontinue the MarketScope and move instead to a Magic Quadrant for e-discovery software. Doing so would be very helpful for the entire industry. Now that George Socha and Tom Gelbmann no longer publish their annual rankings, Gartner’s report is the only way for people to get a sense for how different products compare against each other. That alone makes it required reading for anyone considering an investment in e-discovery software.

As most electronic discovery veterans are aware, the EDRM Project is an effort founded five years ago by George Socha and Tom Gelbmann to bring together a community of e-discovery practitioners for the purpose of solving some of the industry’s most challenging problems.

It may be hard to believe, but there was time in the very recent past where the iconic EDRM model did not yet exist. No multicolored boxes, no arrows, no sloping volume and relevance lines — nothing. Coming up with a standard way of talking about electronic discovery was the first problem that the group set about solving, and I think it would be hard to argue with the fact that they came up with the gold standard: a simple, clear, concise model that, at least so far, is standing the test of time as a way of thinking about the flow of the e-discovery process.

With each passing year, the group has started to address a broader set of problems, all with a practical bent.  Currently, there are eight:

This year’s annual EDRM conference took place back in May. After years of meeting in the same chilly and wind-swept location in downtown St. Paul, Minnesota, George and Tom had the brilliant idea of spicing up the meeting a bit by moving it to a more exotic locale: Bora Bora! Plans were set in motion, but quickly the overwhelming feedback came back from EDRM members: E-discovery is so fascinating, so heart-warming, that adding Bora Bora to the mix would simply be too much for the vast majority of the participants to bear. So St. Paul it was!

This was Clearwell’s third EDRM conference, and location aside, it’s been fascinating to see how it has changed over the last few years. Here are several notable trends from this year’s kickoff:

• More participation from end-users: There was a definite increase in the number of end-user/consumer participants (that is, those not from the vendor community), particularly from law firms. This could be taken as further evidence that e-discovery is indeed moving in-house.
• Increased enthusiasm to take on new challenges: One of the great things about EDRM is its willingness to try to tackle new areas that aren’t being directly addressed by some of the other (fantastic) organizations out there like Sedona. This was in evidence several years ago, when Clearwell was fortunate to get involved in the early stages of the EDRM XML project, which has proven to be a huge time, cost, and risk reducer for many in the industry by providing a common standard that can be used to move data within the e-discovery process. It was in evidence last year when Clearwell’s CTO was able to help launch a new effort around Search that is seeking to develop standards and best practices in an increasingly complex and contentious area. And, finally, it was in evidence this year with the launch of the Information Management project, a cutting-edge group that is exploring how to solve the challenges that e-discovery poses for information management – certainly a complex area in need of thought leadership.

• Improved collaboration: One thing that has amazed us from day one is how collaborative EDRM is, and continues to become. There are a lot of e-discovery vendors involved who, outside of the confines of the St. Paul Hotel, aggressively compete in the marketplace. However, George and Tom have been able to create an environment at EDRM where competitive spirits are set aside and ideas can be cultivated which provide huge value across the e-discovery landscape (both vendor and consumer).

One final note: If you’re an e-discovery practitioner in a law firm or corporate setting, I’d encourage you to get connected, either informally (through the EDRM web site) or formally (by signing up for one or more of the projects). While end-user involvement continues to grow, there is definitely still a need for more non-vendor involvement. It is critical in ensuring real and relevant problems get solved, and to pushing the state of the art in e-discovery forward. Please join us!

When we first started brainstorming about our “Five Questions” feature a few months back, Tom Gelbmann was on our short list of “must-have” interviewees. As most readers are probably aware, Tom Gelbmann, together with George Socha, founded the Electronic Discovery Reference Model (EDRM) project and, also with George, directs the annual Socha-Gelbmann Electronic Discovery Survey. Since 1993 he has been managing director of Gelbmann and Associates, a consultancy based in Saint Paul, Minnesota.

1. There’s been a lot of buzz (particularly within the vendor community!) about the changes to the Socha-Gelbmann Electronic Discovery Survey. You and George have written about this a bit before, but we’ll try to take a slightly different angle: Beyond concerns about people taking rankings out of context or as an excuse for not doing due diligence, were there specific trends and drivers among end-users of e-discovery products and services that motivated the change?

The most important reason for killing the rankings was that they were too often interpreted by end-users as being a “one size fits all” evaluation of top product and vendors, and we thought this type of decision-making was becoming increasingly dangerous as electronic discovery was increasingly in its visibility and importance. It was similar to a prospective car buyer focusing in on the cars that earned the Car & Driver Car of the Year award. They may not need a BMW 3-Series or a Porsche Boxster if they need something to haul lumber or transport the kids to hockey practice. We also saw the opportunity to deliver something that could be useful in identifying software and service providers that meet a set of requirements based on the EDRM model. The result of the overhaul of the Survey we are currently working on will be the capability to specify requirements, dial up/down weighting of criteria and see which providers fit those parameters. Our objective is to deliver something more useful than the rankings.

2. Your other main project is, of course, the Electronic Discovery Reference Model (EDRM). How did EDRM get started? Was it you and George scribbling on the back of a napkin in a coffee shop?

It wasn’t quite on the back of a napkin, but close – it was an Etch-a-Sketch®! Actually, the idea came out of the 2004 Socha-Gelbmann Electronic Discovery Survey. After the dust settled in the fall of 2004, we took a step back to look at what we learned. It wasn’t difficult to spot the #1 issue concerning consumers and providers: confusion and frustration over the lack of standards in the electronic discovery industry. Many people told us this was the Wild West and something needed to be done. That something was a standards initiative. The reference model approach came from looking at the tremendous value the Open Systems Interconnection Reference Model had on computer communications. Developed in the late 1970s, this model provided a common structure for development of products. We thought a similar approach would work for electronic discovery. We started talking to providers and consumers about this idea and initially thought we may get 15 or so organizations interested… 20 tops. We now list the EDRM alumni of 500+ individuals from 140+ organizations.

3. EDRM will be celebrating its 5th year at the upcoming May meeting in Saint Paul. What’s surprised you most about the first five years of the Project?

The biggest surprise by far is that there was a second year, to say nothing of a fifth year that we are now planning. We started out with the objective of keeping the project to a single year, thinking that having a hard deadline would motivate everyone to complete the project on time. We also knew that placing all content in the public domain would attract interest and participation in this initiative that would help the entire industry.

4. The global recession is having a tremendous impact on the electronic discovery community. Any thoughts on how the landscape will be reshaped coming out of the storm?

Potential influencers keep surfacing, making it difficult to anticipate what is around the corner. Certainly, we have seen and will continue to see consolidation of providers. Acquisitions will likely continue as will dissolutions. It is clear that everyone is tightening the belt. Some corporations and law firms who had begun to expand internal electronic discovery operations will sharply curtail or stop the expansion. Experienced, highly capable people will be out of a job and looking for new opportunities, which means short term turmoil for these folks, but hopefully long term success within well managed organizations. The volume of work doesn’t seem to be ebbing yet, so there is great opportunity for the survivors.

5. You and George Socha are the “Dynamic Duo” of electronic discovery and have been working together for a long time.  Anything you want to reveal about George that might not be generally known?  Hidden talents? Secret ambitions?

Interesting question. George is a man of many talents. One pleasant surprise to me was learning of his expertise in baking. I thought I was good at making good pie crusts, after a dozen years making Thanksgiving pies with my daughters. My crusts have gotten rave reviews from the family. But George is the real expert. His creations are a work of art. When it comes to secret ambitions, I think he would like to assemble a massively parallel computer complex in his home office. He has a good start with a half dozen monitors, several computers, servers, etc. and shows no signs of slowing down.

Today’s questionee is Monica Bay, editor-in-chief of Law Technology News. Not only is she the author of The Common Scold, Law Technology Now podcasts, and co-author of the EDD Update blog, but she is also a rabid New York Yankees fan (as you will see below).  Let’s get to the questions.

1) As a lawyer, what advice would you give litigation support professionals to them to help foster more successful and productive litigation support-lawyer relationships?

In June, I wrote “Can You Adapt?” in Law Technology News which explores the changing terrain of EDD support staff. Increasingly, vendors, law firms and corporate counsel are hiring lawyers to handle e-discovery, particularly the review phase. This is creating tremendous opportunities for both attorneys and non-attorney professionals to further develop their careers, and make a whole lot of money (we’re already seeing poaching).

As for advice, it is the same I would give anyone in any job. Think baseball:

• Be a team player: It’s about the team, not the individual. You win and lose as a team. (See, Derek Jeter).
• Play your position well: Make yourself indispensible… be reliable, accurate, prompt, and anticipate needs. Raise your hand when there’s a job nobody wants to do because it’s too complicated or detailed. Extra points for utility players (See, Miguel Cairo).
• Home runs are great, but small ball wins more games. Watch the details. (See, Tampa Bay Rays)
• Take pre-emptive strikes: If you screw up, tell your boss immediately. It is far better for YOU to bring it to your boss than the reverse. Don’t try to hide problems (See, Tanyon Sturtz).
• Bring answers, not problems. Don’t whine. Instead of complaining about problems to your boss, come to her with alternatives. Show initiative and ingenuity. (See, Derek Jeter, Joe Girardi)
• Be low maintenance. ‘Nuf said. Even Manny got traded for being a pain. (See, Jeter, Abreu, Nady, Posada, et al)
• Don’t sit back and wait to be noticed. Ask for promotions. Do your homework, know the market, don’t take the first offer – negotiate. This is particularly important for women, who traditionally haven’t been encouraged to be assertive. (See Joe Torre, Joe Maddon)
• Don’t exaggerate your own importance. (See, Scott Boras, re: B. Molina, Rodriquez, etc.).
• Be loyal, work hard, kind, considerate, passionate, diligent, and work smart (See, Derek Jeter)

2) Socha-Gelbmann abandoning their existing ranking system: Good or bad (or both), and why?

Good.  George Socha and Tom Gelbmann, creators of the Socha/Gelbmann E-Discovery Survey, have said that they are rethinking how they rank, because too many folks were “foolishly” simply relying on their reports rather than doing the necessary due diligence to be sure they were buying the right products. I applaud them and look forward to the next iteration.

3) Helping strengthen the legal technology community is obviously a big passion of yours. Any new issues you are championing?

My latest crusade is the result of recent disheartening news reports that document severe gender gaps in pay for members of our profession; as well as the latest statistics about how painfully difficult it is for minority lawyers to climb partnership ranks, especially in large firms. Even among paralegal ranks there is a gender gap, which is especially ridiculous because that’s an area dominated by women.

There are no easy answers to these problems, but we simply must address them. In our October issue, I challenged every law firm managing partner, vendor CEO and company GC to immediately remedy gender pay gaps in their shops. There is no excuse for those. Solving the issue of obstacles facing career growth for women, minorities, gays and lesbians is a more challenging and nuanced problem, but one that we simply must make a top priority and continue to address. We cannot give up. It is only right and just. I wrote about this in our November issue, and will continue to keep it front and center in LTN.

4) Since it’s Halloween, we’ll ask a scary question. In your view, is e-discovery in its current state a help or a hindrance to the legal system?

The short answer is that it’s both. But e-discovery is here to stay, and the challenge before us is to work to develop systems and protocols that help us attain the real goal – to resolve disputes in a fair, speedy, reasonable manner.

I worry that litigation costs have so escalated that disputes today are being resolved more based on risk management assessments (e.g., the cost of the litigation) than the actual merits of the dispute.

5) Finally, be honest with us: How do you REALLY determine who gets to be in the President’s Corner?

Narrowing it down to the most newsworthy releases of the month, and then finding the one photo among all the finalists that’s actually in focus.

Yesterday’s post about the top e-discovery software vendors prompted a couple of interesting comments. George Socha posted a response here, disagreeing with my conclusions; and someone else (“top8”, whoever that is) asked whether one should “always listen to the top 5-10 songs on the list…[or] use the top 5 software products, regardless of one’s situation.”

To clarify, I whole-heartedly agree with George that there is no such thing as a “best” e-discovery service provider – as George says, it really does depend on your situation and I can think of many cases where a smaller, less well-known firm is a better choice than a national brand.

But e-discovery software is different for 2 reasons. First, and most importantly, in software there are increasing returns to scale which do not exist for service providers. The more companies that use a particular software product, the better that product becomes. Speaking from personal experience, when you have a large number of demanding customers, they force you to make your product better – and give you the money to do it. That’s why most technology markets are incredibly concentrated: everything from databases (Oracle) to search engines (Google) have a single dominant player. We are still in the early days of the e-discovery software market, but ultimately I expect it will follow suit and consolidate around a very small number of players.

The second difference between e-discovery software and service providers is that enterprises cannot change their software vendors as easily as they can change their service providers. Once software is deployed behind the firewall, it is fiendishly difficult to get it out, requiring enterprises to pick a single product for all cases. By contrast, it is easy to change service providers, so enterprises can pick the most relevant expertise on a case-by-case basis.

To answer the question posed by “top8”, I am not suggesting that everyone should only read Harry Potter, watch American Idol, and (Heaven forbid!) listen to Britney Spears. Those are matters of personal taste where diversity is what makes for a rich, vibrant society. But there are very good reasons why so many corporations rely on Veritas for backup software, Oracle for databases, Symantec/McAfee for anti-virus, IBM for developer tools, and so on. In software, the best products only get better. That’s why, 5 years from now, the list of top e-discovery software vendors will be even shorter.

There are two independent analyst reports identifying the top e-discovery software vendors.

The first, published in June 2007, is the Socha-Gelbmann Annual Electronic Discovery Survey. The authors, George Socha and Tom Gelbmann, probably know more about e-discovery than anyone else you are likely to meet. As someone who has filled out their 178-page survey, I can tell you it is excruciating in its detail and incredibly rigorous. According to the report, George and Tom contacted nearly 1,000 individuals and collected detailed data from 115 organizations.

The second analyst report is Gartner’s MarketScope, which is published today (December 2007). Its author, Debra Logan, is fast emerging as one of the leading lights of e-discovery and has great instincts about the market. For her report, Debra tells me that surveyed 30 vendors and checked over 90 customer references.

The results from the two reports are as follows:

(1) Companies listed as “Top Electronic Discovery Software Providers Based on 7 Criteria” (Table 19 and 20), listed in alphabetical order. (2) Companies awarded ratings of “Positive” or “Strong Positive” (Figure 1), listed in alphabetical order.

Why are the lists so different? Primarily because of two main factors:

1. Gartner’s list mixes service providers and software companies whereas Socha breaks them out separately. The Socha report has an entirely separate list for service providers.
2. Socha’s report was completed 6 months earlier than Gartner’s. In that intervening period, several new players entered the e-discovery market. For example, Kazeon was ranked by Gartner earlier this year a “niche player” (lower left quadrant) in the enterprise search market, and has not been in e-discovery long enough to participate in the Socha study (or, if they did participate, they did not have enough e-discovery customers to gain a high ranking).

Conclusions

The first conclusion to draw from these lists is that any vendor not in them is probably not worth considering for e-discovery. If neither Socha nor Gartner ranked them highly, then the vendor either could not provide compelling customer references or has lost competitive bake-offs to someone who is on the list. Either way, they are best avoided.

The second thing that stands out is how different these lists are. Of the 21 vendors identified by Socha and Gartner, only 5 are ranked as top e-discovery software vendors by both of them. Those 5 are Attenex, Clearwell, FTI, Guidance, and LexisNexis. So, if you are an enterprise looking for an e-discovery solution, it is clear who you should call first.

Finally, it is worth noting that both these analyst reports are relatively new. This is the third annual survey for Socha, and the first MarketScope for Gartner. That speaks to the fact that e-discovery software is a new, fast-growing product area. More and more enterprises are adopting e-discovery software solutions, and asking analysts about them, because they offer such a compelling ROI.

Prior to working in e-discovery, I (Aaref) always thought standards bodies were a waste of time – or, at least, nothing more than an excuse for free travel to exotic locations. But George Socha and Tom Gelbmann’s EDRM project has changed my mind. In the second of a series of posts, our e-discovery guru – Kurt Leafstrand – explains one of many ways in which EDRM will have a big impact on e-discovery in the years to come:

Last week, I once again had the pleasure of participating in the (now biannual) EDRM conference in St. Paul, Minnesota. For those unfamiliar with it, EDRM is a fantastic collaboration between e-discovery software vendors, service providers, and consumers committed to addressing practical problems associated with e-discovery.

Looking back on both formal sessions and informal conversations with many participants, the one key theme that came across loud and clear is that the days of traditional, “throw-it-over-the-wall” (TIOTW) e-discovery are numbered.

I am sure you’re familiar with the TIOTW approach, that endearing process whereby an enterprise gathers up a muddle of electronic data in all shapes and sizes, ties it up in a big bundle, rolls it in bubble wrap, and catapults it into the waiting arms of a service provider. They unwrap it, chant some incantations and perform other black magic for a few days (or it is weeks?) and throw a bundle back over the wall to their corporate client. In-house counsel takes a look and promptly realizes that the search terms she thought were sure things were completely off the mark, and that she missed a couple of custodians, and then… well, it’s back over the wall again.

What’s going to tear the wall down? The EDRM XML schema, the first version of which is unveiled today by Clearwell and a large group of other vendors and customers. This will have the same impact on e-discovery as web services have had on e-commerce, enabling systems to pass data to one another over the internet, just as Travelocity passes information to American Airlines when you use it to make a reservation online.

What difference will this make? Well, I boil it down to 3 main things:

1. Litigation risk will decline as early case assessment finally becomes a reality in the enterprise—making it feasible to process, analyze, and do first-pass review of documents in-house, and then transfer those documents and tags to service providers and outside counsel without having to start from scratch.
2. E-discovery timeframes will shorten as enterprises become able to craft comprehensive e-discovery strategies more easily by executing and refining searches closer to the source of the data, and eliminate time-consuming back-and-forth exchanges between enterprises and service providers. And that’s a good thing, with the new FRCP (and coming soon, state rules!) pressure.
3. E-discovery manageability will improve as enterprise-based e-discovery systems are able to integrate seamlessly with downstream litigation management systems. Previously, you were forced to either channel data into a complex external litigation management system too early — making it difficult for internal counsel and other constituents to have access to the documents — or pay for costly and time-consuming custom data conversions to migrate data between document “silos.”

What to do with all of those unused CDs gathering dust in your office? I’ve heard they make great coasters…

I tend to have a “Mark Twain perspective” on statistics and apply a healthy grain of salt to any numbers quoted by analysts and industry experts. But when end-users speak, I sit up and listen. That’s why I was very interested to read here that Microsoft “spends an average of US$ 20 million for e-discovery per litigation, according to one company exec.” (My thanks to George for alterting me to the article)

If true, it is an astounding number – but one that is quite consistent with what we have seen first hand working with other large enterprises ourselves. Once you factor in processing costs (an average of $1,800 per GB), review costs ($200/hour), and the huge volume of information being generated and stored, you can get up to $20 million on a single case surprisingly fast.