By Jim Sullivan, Founder and CEO, eDiscovery AI I was attending a session at a legal conference recently, and the moderator stated that most attorneys had high hopes for Generative AI in eDiscovery, but the reality has been disappointing as it has so far failed to deliver. I’m sure my gasp was heard across the room. WHATTTT?!?!?!? About 17 years ago, I was sitting in a small stuffy room at the top of a fancy building, doing document review for hours each day. Of course, many discussions came up among the small review team, and a college football discussion came up. Do you know what I said? “Ehhhh, Tim Tebow just seems a little bit soft.” And his response was very clear “hearing you say that tells me that you know absolutely nothing about college football.” And he was right! I was making a claim about a sport based on impressions I had made without seeing the man play the sport I was judging him on. So what does this have to do with eDiscovery? Tim Tebow is not soft. He was one of the toughest players in the game. Suggesting he is soft was a clear indication that I was not knowledgeable about college football. Generative AI is the biggest leap forward in the history of eDiscovery. Suggesting it has been disappointing is a clear indication the speaker was not knowledgeable about using Generative AI in eDiscovery. HAVE YOU USED RELATIVITY AIR?!? In 5 minutes, you can code your entire review set with a level of accuracy that destroys any human review. I would ask “What were you expecting,” but the problem isn’t that Generative AI isn’t good enough. It’s that there is no chance the speaker had legitimately used AI before making that claim. Don’t believe me? There is only one way to know for sure. TRY IT! Give it 1 hour. One hour of your time to determine if it is as good as people claim. Let me show you how good it can be
November 14, 2024 — [Minneapolis, MN] — eDiscovery AI, an advanced AI-powered solution provider, and ProSearch, a leader in eDiscovery and legal technology services, today announced their strategic partnership. The partnership combines eDiscovery AI’s cutting-edge artificial intelligence technology, with ProSearch’s extensive expertise in eDiscovery, transforming the efficiency, scalability, and precision of document review processes across the legal landscape. eDiscovery AI’s technology offers numerous features including automating initial reviews,conducting quality control, handling multi-language documents, comprehending complexprivilege reviews, identifying personally identifiable information (PII), expedites image andaudio review and cybersecurity breach response. “Partnering with ProSearch allows us to maximize the potential of our AI solutions,particularly in the area of generative AI-powered document review,” said Jim Sullivan, CEOand Founder of eDiscovery AI. “With ProSearch’s unmatched discovery expertise, we’reable to deliver more impactful, scalable, and precise solutions for legal professionalsacross the globe. Together, we are raising the bar on what’s possible in document review.” The partnership highlights enhanced workflows that streamline critical aspects ofdocument review, including relevance determination, privilege identification, PII detection,and more. The platform’s support for foreign language and multimedia content furtherbroadens its application across industries, ensuring consistent and defensible documentreviews. “eDiscovery AI is the latest cutting-edge solution added to the arsenal of tools andworkflows we employ to address the complexity and cost of legal review and another stepin delivering a comprehensive AI solution to our clients,” says Joe Pirrotta, director of review services and AI innovation committee chair at ProSearch. “We’re excited to leverage this technology to further streamline critical aspects of document review, including relevance determination, privilege identification, PII detection, and more.” By partnering with eDiscovery AI to supplement its homegrown solutions, ProSearch is providing clients with a defensible technology strategy that leverages the right tool to solve each unique data challenge. The partnership is the latest expansion of the ProSearch suite of solutions aimed at taking advantage of the industry’s newest and best technology to continually improve outcomes for its discovery services clients. About eDiscovery AI eDiscovery AI is at the forefront of legal technology, providing generative AI-powered solutions to streamline and optimize the document review process. eDiscovery AI’s mission is to empower eDiscovery with advanced AI-powered solutions that maximize efficiency, enhance accuracy and improve cost effectiveness. eDiscovery AI’s review suite of solutions – Relevance, Privilege, and PII Detect – deliver industry leading features, speed and accuracy. Together with our Legal Service Provider partners, eDiscovery AI is dedicated to delivering cutting-edge technology with expert guidance to help users navigate the evolving landscape of legal technology. We measure our success by our partner’s success. Learn more at eDiscoveryAI.com. About ProSearch ProSearch is a leading provider of tech-enabled solutions to corporations and law firms. The ProSearch eDiscovery and AI-led review offerings allow clients to efficiently address their most challenging litigation, regulatory, privacy, and other legal matters. ProSearch’s team of consultants, data scientists, linguists, project managers, and eDiscovery specialists collaborates with clients to execute their matter strategies and ensure on-target, on-budget, on-time delivery. ProSearch works with some of the largest companies in the Fortune 500 as a trusted partner that brings efficiency to the legal process and spend. To learn more visit ProSearch.com.
Fighting eDiscovery Burnout with AI By Tony Reichenberger A recent white paperi, published in partnership with the EDRM, considered and described the level of burnout specific to the eDiscovery community. The very first lines of the paper are stark; “The eDiscovery community is experiencing a mental health crisis…indeed, mental health in the legal industry as a whole is problematic.” For many eDiscovery practitioners, we know this, feel it every day and experience it as a regular part of our lives. A number of the sources to much of the strain are also documented: That eDiscovery is a highly technical, specialized field with multiple stakeholders that regularly compound stress and complexity. Mistakes are easy to make in eDiscovery, with profound and serious consequences. The negative feedback is compounded by the multiple layers of attorneys above eDiscovery ground level work. There are high levels of unreasonable expectations and sometimes arbitrary deadlines. It’s often viewed as an unglamorous task, subject to derision and hopelessness. eDiscovery is often depicted as having a boiler room ethos and the paper expands on that. It requires long hours, precise focus, high level of organization and strong mental endurance. It usually pays substantially less than other jobs in the legal sphere and often upward mobility is closed off to those within eDiscovery. The fact that eDiscovery costs are often the largest portion of litigation, and the area most clients want to cut out the most, only amplifies the pressures on eDiscovery practitioners. However, one line particularly caught my eye. “Consumers of eDiscovery services expect computer like artificial intelligence level output when—in reality—the work of eDiscovery professionals is very human.”ii This may be currently true but does not have to be a future source of strain. Give the consumers what they want; AI level quality output through the use of AI; AI review can meet or exceed the expectations legal clients can anticipate. It can do a consistent, thorough, and accurate job, without the fatigue, stress, and anguish many reviewers experience. We’ve already previously documented the cost analysis of human v. AI review here (https://ediscoveryai.com/cost-analysis-human-review-v-ai-review-how-do-they-compare/) where we show that a rate close to minimum wage was already more expensive than an AI review. You also receive the results within very little time at all, as opposed to weeks or months later depending on the size of the review. But within the mental health study, the people who make the biggest case for transitioning to AI are the review attorneys themselves, who complain about the work, become physically exhausted, and disdain the working conditions. Here is a sample of the criticisms: The work can be “mind numbing.” Working until your “eyes bleed” for little pay. Document review providers are referred to as “nasty sweatshops.” Technology to improve work product only puts an emphasis on “human error” increasing reviewer stress (as opposed to its actual goal of getting a better work product). Remote surveillance to ensure reviewers do their jobs results in attorneys feeling “dehumanized.” Document review work is indeed exhausting. There are, without a doubt, physical limitations to the work. The longer one does it in a day, or a week, the more likely errors occur. As the paper makes clear, they’re only human. It’s repetitive, it’s boring, and nobody is jumping up and down to do document review if other options are available. These are the typical kinds of jobs that inevitably get automated; they can be done by machines better, more consistently and without issue. There is less overhead required, less curveballs to the project due to unforeseen vacations or sick days, and AI doesn’t complain, especially about burnout. AI document review has proven itself to be more accurate and better, and not bound by the limitations human reviewers have. Back to that quote, “Consumers of eDiscovery services expect computer like artificial intelligence level output when—in reality—the work of eDiscovery professionals is very human.” Why not provide for those consumers what they expect? If they want artificial intelligence level output, give it to them. We can provide that for you and them. Contact eDiscovery AI today to schedule a demonstration or find out how AI review can work for you.
Boo! Yes, it’s that time of year. That time when we encounter ghosts, ghouls and goblins that terrorize our lives. In e-Discovery, we deal with these monsters every day
October 28, 2024 — [Minneapolis, MN] — eDiscovery AI, an advanced AI-powered solution provider, and Purpose Legal, a leader in eDiscovery and legal technology services, today announced its strategic partnership. This partnership combines eDiscovery AI’s cutting-edge artificial intelligence technology, with Purpose Legal’s extensive expertise in eDiscovery, transforming the efficiency, scalability, and precision of document review processes across the legal landscape. eDiscovery AI’s technology offers numerous features including automating initial reviews, conducting quality control, handling multi-language documents, comprehending complex privilege reviews, identifying personally identifiable information (PII), expedites image and audio review and cybersecurity breach response. “Partnering with Purpose Legal allows us to maximize the potential of our AI solutions, particularly in the area of generative AI-powered document review,” said Jim Sullivan, CEO and Founder of eDiscovery AI. “With Purpose’s unmatched eDiscovery expertise, we’re able to deliver more impactful, scalable, and precise solutions for legal professionals across the globe. Together, we are raising the bar on what’s possible in document review.” The partnership highlights enhanced workflows that streamline critical aspects of document review, including relevance determination, privilege identification, PII detection, and more. The platform’s support for foreign language and multimedia content further broadens its application across industries, ensuring consistent and defensible document reviews. “We are thrilled to partner with eDiscovery AI and bring their groundbreaking AI capabilities to our clients. This collaboration reflects our commitment to leveraging the best technology available to ensure our clients receive the most efficient and effective services,” said Jeff Johnson, Chief Innovation Officer at Purpose Legal. “The integration of Purpose Legal’s expertise and eDiscovery AI’s innovative platform creates a powerful solution for law firms and corporations handling complex matters.” This collaboration enhances Purpose Legal’s suite of legal technology offerings, empowering clients to tackle even the most challenging cases with confidence. With advanced AI tools that automate and optimize critical workflows, law firms and legal teams can allocate more resources to strategic decision-making, while maintaining the highest levels of accuracy and compliance. About eDiscovery AIeDiscovery AI is at the forefront of legal technology, providing generative AI-powered solutions to streamline and optimize the document review process. eDiscovery AI’s mission is to empower eDiscovery with advanced AI product solutions that maximize efficiency, enhance accuracy and improve cost effectiveness. eDiscovery AI’s suite of products – Relevance, Privilege, and PII Detect – deliver industry leading features, speed and accuracy. Together with our Legal Service Provider partners, eDiscovery AI is dedicated to delivering state-of-the-art technology with expert guidance to help users navigate the evolving landscape of legal technology. We measure our success by our partner’s success. About Purpose LegalPurpose Legal is a leader in eDiscovery, document review, and legal technology services. Our diverse team of experienced, talented, and motivated people are our greatest asset. The company assists multinational corporations, law firms, government entities, and channel partners through best-in-breed software, creative managed services solutions, and deep industry expertise. Purpose delivers expertise in litigation support, HSR second requests, internal compliance, and regulatory investigations, core eDiscovery services and technology, document review, information governance, data breach discovery, commercial contract review, and data science. We hire and develop experienced industry professionals, who combined with proven processes and robust technology, help us deliver consistently effective solutions to our many valued clients. The company has a global reach and serves clients throughout North America, the EU, and India. Learn more at www.purposelegal.io.
Document review is the most expensive part of the EDRM. It’s not even close. Looking at the EDRM, it’s easy to see why; the costs of everything else in it are largely task oriented. The amount of time it takes for someone to push a button to process ten custodians is roughly the same as it is for twenty. There are hosting charges and processing charges based on volumes, but those costs pale in comparison to the hourly rates charged by attorneys to look at documents. Every other portion of the EDRM leads into, or results from, Review, which is the heart of a legal project. Review is on an individual document level, meaning everything needs to be considered and analyzed. George Socha (currently with Reveal), one of the creators of the EDRM, created a chart which adjusted the size of the individual areas by cost, which demonstrates these cost disparities: Cutting out expensive review is the easiest and simplest way to lower litigation costs. Plain and simple. Other aspects of the EDRM are simplified by technology and automation. We have now reached the point where review can also be automated through AI, lowering your project costs considerably. How much? Let’s compare it to human managed review. The Cost Comparisons When it comes to human managed review, the costs are directly tied to volume and the review rate. If you have 1 million documents and the quoted review speed is 50 docs/hour, the amount of time it will take reviewers to go through the entire set is 20,000 total hours, and then just multiply that by the attorney hourly rate to get the reviewer cost. Even then, some variables can throw off those results. Some reviewers are generally slower, meaning faster reviewers must make up the difference. In addition, the more categories you need to tag, the slower the review as there are more factors for which the reviewers are required to tag. In recent years, the trend has been to lower the quoted review speeds compared to where they were five or ten years ago when they were 60 docs/hr.. If the rate goes down to 40 docs/hr., that 20,000 total hours now balloons to 25,000 total hours. That number is just for first-level review too; add multiple layers to it, such as a QC review, privilege logging or redaction review, and the hours increase further. QC review usually adds another 10% since that’s usually what is requested to QC. Privilege logging costs vary on the volume to log and usually the level of detail required for the log summaries. Redaction reviews can be simple or flat out ugly, again depending on volume and level of detail. Another way human managed review increases costs is by pyramiding the internal review structure of a project. Sure, the 25,000 hrs. mentioned above relates to the reviewer hours required to complete first level review, but there is always a review manager, organizing and overseeing the review team. That also increases the cost. In recent years we’ve seen another layer, “review leads,” increase costs, inserted between review management and the review team; these are usually better reviewers but help coordinate the other reviewers for the review manager. Those better reviewers cost more, even though they really serve no additional purpose, and it’s a way to pass on cost from the review provider to the customer to keep better contract reviewers longer term. So, for a project length of 25,000 hrs., if you have 25 reviewers going through documents, you will have one Review Manager, and likely five leads, with five reviewers reporting to each lead. The costs of the review at that point become formulaic and easily calculable once you know the hourly reviewer/ lead/ manager rates: 1,000,000 docs/40 docs/hr. = 25,000 First Level Review hours 25,000+ (25,000 x 10%) = First Level + QC Review Hours (27,500 hrs.) 27,500/25 reviewers = 1100 hrs., 40 hrs./week = 27.5 weeks (about 6 and a half months) to complete. 27,500 x Hourly Reviewer Rate = Cost of First Level Review + QC (5 x 1100) x Hourly Team Lead Rate = Cost of the Team Leads (1 x 1100) x Hourly Review Manager Rate = Cost of Review Manager “d” + “e” + “f” = Total Cost of First Level Review and QC. Assuming a reviewer, lead and manager rate all at $50/hr. (which is never the case; leads and managers cost notably more), that’s an overall cost of first level review and QC of $1,705,000. And that’s not even including Privilege Logging or Redactions. Which brings us to the cost of an AI review. Much like every other aspect of the EDRM, the cost of an AI review is fixed to the volume of documents you want to run it across. So, for example, if the cost is $0.45 per document, the cost of an AI review of 1,000,000 documents is $450,000. You get a relevancy determination, a summary and an explanation as to why the AI coded the document that way. The summary is saved to a field that one could use for Privilege Logging as well. Running the documents through AI only needs to be done once and you get the results in 24 hours, not 6 ½ months later. What you choose to QC is entirely up to you, though some small additional review work for QC sampling and to validate results should be conducted as a part of any AI review protocol for defensibility. Assuming an Hourly Review Rate, a Team Lead Rate, and a Review Manager Rate all the same of only $16.50 per hour already puts you over that cost. Think about that; a rate close to the minimum wage in many states is more expensive for document review than an AI review. The Quality Comparison Document reviewer quality varies wildly. To be sure, there are some good reviewers out there making a legitimate career of contract review work.