e-discovery 2.0

As we approach LegalTech New York next week, oft referred to as the Super Bowl of legal technology events, there are any number of helpful blogs and articles telling new attendees what to expect, where to go, what to say, what to do. Undoubtedly, there’s some utility to this approach, but since we’ll be in New York, I think it’s appropriate to take a more skeptical approach and proffer a list of what *NOT* to do at LTNY.

1. DON’T get caught up in Buzzword Bingo. There are already dozens of sources attempting to prognosticate what the most popular buzzwords will be at this year’s show.  Leading candidates include “predictive coding,” “technology assisted review,” “information governance,” “big data” and even the pedestrian sounding “sampling.” And, while these terms will undoubtedly be on booths and broadcast repeatedly from the Hilton elevator, it doesn’t mean an attendee should merely parrot these without a deeper dive.  Here, the key is go behind the green curtain to see what vendors, panelists and tweet-ers actually mean by these buzzwords, since it’s often surprising to see how the devil really is in the details.
2. DON’T get a coffee at the Hilton Starbucks. Yes, we all love our morning coffee, but there’s no need to wait in the Justin Bieber-esque line queue at the in-hotel Starbucks. There are approximately 49 locations in a ½ mile radius, including one right across the street. There’s also the vendor giving out free coffee on the second floor, so save yourself 30 minutes of needless line waiting.
3. DON’T ride the Hilton elevator. For those staying or taking meetings at the Hilton, the elevator lines can be excessively long.  Once you finally get on, you’ll wish they’d been even longer as you then find yourself subjected to the brainwashing of vendor announcements while you make multiple stops on your way to your desired floor. Either take the stairs or, if that’s not possible, try to minimize the trips to keep your sanity. Or, plan B – bring your iPod.
4. DON’T talk to booth models. It’s tempting to gravitate to the most attractive person at a given vendor’s booth, but they’re often hired professionals designed to get you in for the all-important “badge scan.” Instead, focus on  the person who looks like they’ve been in the same company-branded oxford for 48 hours, because they probably have. While perhaps less aesthetically pleasing, they’ll certainly know more about the product and that’s why you’re there after all, isn’t it?
5. DON’T pass out your resume on the show floor. While certainly a great networking opportunity, LTNY isn’t the place to blatantly tout your professional wares, at least if you want to keep your nascent job search on the down low. And, if you want to have more private meetings, you’ll need to do better than “hiding out” at the Warwick across the street. For more clandestine purposes, think about the Bronx.
6. DON’T take tchotchkes without hearing the spiel. There are certain tchotchke hounds out there who roam around LTNY collecting “gifts” for the kids back at home. While I won’t frown on this behavior per se, it’s only courteous to actually listen to the pitch (as a quid pro quo) before you ask for the swag. Anything less is uncivilized.
7. DON’T get over-served at the B-Discovery Party. After a long day on the show floor you’re probably ready to let loose with some of the eDiscovery practitioners you haven’t seen in a year.  But, in this era of flip cams and instant tweeting, letting your hair down too much can be career limiting. If you haven’t done Jägermeister shots since college, LTNY probably isn’t a good time to resume that dubious practice.
8. DON’T forget to take your badge off (please!). Yes, it’s cool to let everyone know you’re attending the premier legal technology event of the year, but once you leave the show floor random New Yorkers will heckle you for sporting your badge after hours – particularly the baristas at Starbucks. Plus, if you’ve broken any of the other admonitions above, at least you’ll be more anonymous.
9. DON’T forget to bring a heavy coat, mittens and scarf. Last year there was the infamous ice storm that stranded folks for days (me included). Even if the weather isn’t that severe this year, anyone from warmer climates will need to bundle up, particularly because it’s easy to unintentionally get caught outside for extended amounts of time – waiting for a cab in the Hilton queue, eating at Symantec’s free food cart, walking to a meeting at a “nearby” hotel that’s “just a block or so away.” Keep in mind those cross town blocks are longer than they appear on a map.
10. DON’T forget to learn something. Without hyperbole, LTNY has the world’s greatest collection of legal/technology minds in one place for 3 days.  Most folks, even the vaunted panelists, judges and industry luminaries are actually quite accessible. So, at a minimum, attend sessions, ask questions and interact with your peers. Try to ignore the bright lights and signs on the floor and make sure to take some useful information back to your firm, company or governmental agency. You’ll undoubtedly have fun (and maybe a Jagermeister shot, too) along the way.

For years, concept search in electronic discovery has been like concept cars at auto shows: Cool. Slick. The thing that everyone is talking about.

But not ready to move to the assembly line and be put into production.

Like a concept car, concept search has been based on a lot of good ideas and shown a lot of promise. However, it has failed to move beyond a few edge use cases and reach mass adoption in the e-discovery market.  Why is this the case?

It’s not been because it’s an unproven idea or that the basic technology hasn’t been available. In fact, the core algorithm that underlies most existing concept search technologies has actually been around since 1988, when latent semantic analysis (LSA) was first patented by a team from Bell Labs. Over the last 20 years, dozens if not hundreds of companies have sprung up to apply concept search to the broad area of enterprise search and to e-discovery in particular.

To understand why concept search has never taken off, it’s always interesting to look for parallels, and the parallel du jour is social networking. Readers of David Kirkpatrick’s excellent book The Facebook Effect and (perhaps to a lesser, more fictionalized extent) viewers of the movie The Social Network understand that Facebook was far from the first social networking site (remember MySpace? You won’t admit it, but I know you do). But, despite being several years late to the party, Facebook somehow took the core of the social networking idea and presented it to users in a way that really allowed it to “cross the chasm” to the mainstream market.

In introducing Transparent Concept Search, Clearwell plans to help conceptual search cross that same chasm in e-discovery.  In talking to customers over the last couple of years, we have found that there are unmet customer needs with existing concept search products that, once addressed, will really allow its use in e-discovery to flourish – and not just in a way that makes concept search marginally more useful, but, a la Facebook, makes it orders of magnitude more useful.

What are these unmet customer needs?

Ease of use: Historically, concept search has been relatively easy to use in the strictest sense of the word – you type in some terms that represent your concept, and you get a set of search results back, along with some related terms and/or clusters of related documents. Simple, right? The issue is that in most cases that’s not what the user really wants to do. Because concept search is inherently “fuzzy”, users want to be able to refine their concept based on the feedback that they got from their initial search. Concept search, just like keyword search, is an iterative process, and prior-generation technologies have not allowed for that form of iteration. In contrast, Clearwell’s Transparent Concept Search allows concepts to be defined and refined in a way that is intuitive, visual, and (don’t take my word for it, but try it for yourself) fun.

Precision: Traditional concept search increased recall when compared to just keyword search, but it came at the cost of precision. The refinement process facilitated by Clearwell’s Transparent Search addresses this issue by allowing intelligent human input to guide the concept search process. You get the best of both the recall and precision worlds with vastly diminished time and effort.

Defensibility: Even more important than ease of use and precision is defensibility. Defensibility, for those new to the term, isn’t so much about whether the way the algorithms work is known and able to be understood. They are, and aren’t that complicated. Rather, defensibility is about reasonableness: was the concept search a reasonable way of determining which documents are responsive? Without the ability to define your concept in an interactive manner, we believe that the answer has historically been “no”, making concept search nice in theory but unusable in actual legal practice. Transparent Concept Search promises to change that. The end result is a more defensible search process that yields both greater recall and greater precision, enabling users to more quickly analyze case facts, rapidly identify key documents that may have been missed, eliminate irrelevant documents, and prioritize the most relevant documents for review. Clearwell also provides a reporting and auditing feature to document your search, allowing you to improve defensibility by “proving up” what was done.

Low cost: Finally, never underestimate the value of “free” in helping meet the ever-important unmet need of cost predictability and control. Historically, vendors have charged price premiums (often substantial) for concept search. Trying to charge a premium in e-discovery for something that doesn’t fully meet the customer use case and isn’t defensible, and it’s a recipe for low adoption. However, provide a highly useable, effective, and defensible capability as part of the core functionality of today’s leading e-discovery platform, and it starts to look very attractive indeed.

Hopefully you can tell that we’re incredible excited about the promise that this technology holds for the market, and this initial version is really just the beginning. Want to see it for yourself? Check out the video below, visit our web site or, if you are in New York this week, please visit us at LegalTech New York – we would love to see you.

At LegalTech New York there was still considerable discussion about ECA, which I of course assumed meant early case assessment.  And, while I have a good idea of what ECA means in the practice of electronic discovery, it struck me that many electronic discovery vendors were making up definitions to suit their own needs.  So, in a search for the one true meaning I began my search in earnest.

First, I went to Wikipedia.  Apparently ECA can stand for a whole host of things, including:

• Evangelical Christian Academy, a school for missionary children in Madrid
• Entertainment Consumers Association, an entity representing American game consumers
• European Cockpit Association, the representative body of 34 national flight crew associations in Europe

After a brief diversion into the mandate of the European Cockpit Association I decided that Wikipedia wasn’t the answer. Then I came across a pretty illustrative post from the Settlement Perspectives blog. There, the author struggles with the same quest and ultimately concludes that an early case assessment is a “disciplined, proactive case management approach designed to assemble, within 60 days, enough of the facts, law, and other information relevant to a dispute to evaluate the matter, to develop a litigation strategy, and to formulate a settlement plan if appropriate.”

What’s interesting about this definition is how important *early* is to a successful ECA.  While it seems both obvious and axiomatic, doing this process within 60 days seems to hold some of the secret sauce.  According to Schering-Plough’s VP of Litigation and Conflicts Management: “in 60 days…  you will know 80 percent of what you will ever know about a case.”

While this 60 day window initially seems reasonable, I’d wager that the timeline can be exponentially more aggressive, especially for practitioners leveraging next generation search and analytical tools…

As an example, let’s assume a fairly broad collection of relevant electronically stored information (ESI) where counsel wisely iterates on their search strategy to divine 80 percent of the significant case facts. This process could and should occur with 60 hours, much less 60 days. Not only is this compressed time frame dramatic in terms of moving the window from two months down to one week, but in reality an ECA needs to be done this quickly in order to facilitate preparation for the newly accelerated meet & confer conferences, as well as providing counsel with the insights to develop a settlement posture before the parties have become entrenched for expensive and protracted litigation.

We live in a time where information is now presumed to be instantly available.  While perception isn’t quite yet reality, it’s incumbent upon modern litigants to have real case data available within days, if not hours, from the inception of litigation.  Since the opposition probably has a significant jump start on the facts (since they filed the lawsuit), the defendant doesn’t have the luxury of taking two months to determine 80% of the relevant facts.

“Unless I’m wrong, and I’m never wrong…” this means that counsel should be conducting ECAs in nearly every case.  It should be “must have” instead of a nice to have. However, anecdotal evidence suggestions that ECAs aren’t performed routinely today.  The question is why?

Aside from the educational component and the use of old school, brute force review methodologies, the answer may lie in a common litigation mindset:  i.e., the desire to avoid costs for as long as possible.  Even in the Settlement Perspective piece the author admits to this mindset:  “I would prefer to avoid ‘all the major work’ on a case if I can.”  While he doesn’t seem to lump data analytics into this camp, this pervasive notion is still readily apparent.

In order to make the sea change where ECA is a standard operating procedure in every matter, counsel must understand that while some costs are incurred early in the process the benefits are crystal clear: i.e., determining customized case strategies early in the matter to decide whether to fight or settle.  Similarly, corporate clients must recognize that the benefits outweigh the costs and require their litigation counsel to include this process in every significant matter.  Failure to do so merely widens the rapidly growing information gap, leads to uniformed case decisions and heightens confusion with the European Cockpit Association.

Learn More On Ediscovery Litigation.

If you have been to LegalTech before, you know that – by the end of the day – you could use a nice stiff drink to recover. So why not do it with some company? We (Aaref, Dean, Kurt, and Will) will be at the Bridges Bar at the Hilton at 7pm, and we are happy to buy drinks for the first 50 E-Discovery 2.0 readers who join us (we will have a big E-Discovery 2.0 sign on our table, so feel free to just stop by and introduce yourself). It’s a great way to meet us, suggest ideas for what we should cover on the blog, and get warmed up before going to the B-Discovery event later that evening.

Come early though. We mentioned the idea to Brandon, who runs the E-Discovery 2.0 group on LinkedIn, and he invited his group to arrive shortly after, so the seats (and the drinks!) may go fast.

Hello from Los Angeles, where the weather’s fine and summer’s in full swing! Accordingly, a few of us in the legal technology community spent the night before LegalTech enjoying a Dodger’s game hosted by LTN editor-in-chief and rabid Yankees fan Monica Bay (outfitted in full Yankee regalia for the occasion). So as to not incur Monica’s wrath, I left my Red Sox cap at home.

At the game, I happened to sit next to a colleague from another vendor who mentioned that her firm is about to celebrate twenty years in e-discovery.

Twenty years! What a remarkable milestone for any company. It got me wondering about how much technology has evolved over that time period, and raised an interesting question to noodle over between innings: With all of the investment and innovation in the e-discovery space, who’s actually winning the electronic data discovery tug of war, twenty years in?

What is the e-discovery tug of war, you ask? Let’s start with the scene in 1988.

On one side, the documents: They stared at you from across the mud puddle — hundreds or even thousands of boxes stacked one of top of another, hauled out from a warehouse where they’d spent their days, against their will, in windowless solitude, ready for battle. They were ticked.

And on the other side, you: With your new IBM PS/2 Model 80 (the best money could buy: 640×480 VGA color screen, 16mhz 386 processor, 80MB hard drive), flatbed scanner, and some new DOS-based database program called “Concordance.” To add insult to injury, Starbucks hadn’t even really gone national yet, so you were probably stuck with a jar of instant coffee to try to stay awake.

You didn’t stand a chance.

From then until now, two different dynamics have played against each other, pulling the flag back and forth over the dividing line:

1. On one side, the explosive growth of electronic documents has been truly mind-boggling. From a baseline of close to zero in 1988 (WordPerfect 5.1 wasn’t introduced until 1989), today essentially every single business document is created, transmitted, and stored electronically.
2. On the other side, technology innovators in the e-discovery space have used creativity and a large dose of Moore’s Law to store, process, and search electronic documents with ever-increasing speed and efficiency.

During the seventh inning stretch, with the Dodgers holding a commanding lead over the White Sox, I thought: Maybe technology is about to win.

Here’s the argument: Assuming that the creation of document content will still largely be human-driven, now that most every legally significant class of communication is being created and managed on-line, growth of e-discovery-relevant data volumes may quickly move from being exponential (when everything was “going digital”) to a rate driven more by productivity improvements and economic growth. Improvements in processing, search, and analysis of documents, however, will continue to improve at a Moore’s Law pace for the foreseeable future, presumably making it fairly trivial for advanced e-discovery technologies to outmuscle their longtime adversary.

Google shows some evidence of this victory of technology over data. Remember that just a few years back, search engines frequently trumpeted how much of the Internet they were able to index – and it was far from the whole thing. Today, that’s largely a solved problem. It’s simply amazing how quickly Google’s index ingests new data, often in what seems like a matter of minutes. In fact, I dare say that by the time you read this post, you’ll be able to perform a Google search on some of its content and have it come up front-and-center in your search results. Amazing.

What does this mean for electronic data discovery? The best e-discovery technologies will change to solve challenges that are far more strategic in nature. Instead of focusing on how fast and effectively they can process documents, or how quickly they can allow attorneys to review them, they’ll provide powerful capabilities for addressing some of the most important e-discovery problems that inside and outside counsel face, such as:

• How do I craft robust, defensible search strategies for my cases while minimizing e-discovery costs?
• How can I standardize a repeatable, high-quality discovery process that’s executed consistently across my organization?
• How can my organization become more proactive in identifying potential legal risks and liabilities based on our company’s “legal history”?

I’m sure you can come up with a number of others. What do you think – is the war against documents over, and electronic data discovery ready to move to a new phase? Or are there still many more battles to be fought?