This paper presents a groundbreaking comparison between Large Language Models (LLMs) and traditional legal contract reviewers—Junior Lawyers and Legal Process Outsourcers (LPOs). We dissect whether LLMs can outperform humans in accuracy, speed, and cost-efficiency during contract review. Our empirical analysis benchmarks LLMs against a ground truth set by Senior Lawyers, uncovering that advanced models match or exceed human accuracy in determining legal issues. In speed, LLMs complete reviews in mere seconds, eclipsing the hours required by their human counterparts. Cost-wise, LLMs operate at a fraction of the price, offering a staggering 99.97 percent reduction in cost over traditional methods. These results are not just statistics—they signal a seismic shift in legal practice. LLMs stand poised to disrupt the legal industry, enhancing accessibility and efficiency of legal services. Our research asserts that the era of LLM dominance in legal contract review is upon us, challenging the status quo and calling for a reimagined future of legal workflows.
Technology can help you solve problems in your law firm, connect with clients, save time and money, and so much more. But, how do you know what tech will work best for your practice? Molly Ranns and JoAnn Hathaway talk with Colin Levy about understanding and utilizing technology, common mistakes in choosing new tools, and ways to overcome tech-related fear and anxiety.
Every time we attend Legalweek, we have a unique opportunity to tap into the collective knowledge of hundreds of legal professionals. This year at Legalweek 2024 we talked with peers in a wide variety of roles, from litigation support professionals and lawyers to partners and heads of innovation. Throughout the sessions and discussions, we started to notice a few common themes, interesting trends, and helpful insights.
WASHINGTON, Feb. 6, 2024 /PRNewswire/ — While three-quarters of higher-education trustees (83%), faculty (81%) and administrators (76%) agree that generative artificial intelligence (GenAI) will noticeably change their institutions in the next five years, community college trustees are more optimistic than their community college counterparts, with (37%) saying their organization is prepared for the change coming compared to just 16% of faculty and 11% of administrator respondents.
Those findings are from the 2023-2024 Digital Learning Pulse Survey conducted by Cengage and Bay View Analytics with support from the Association of Community College Trustees (ACCT), the Association of College and University Educators (ACUE), College Pulse and the United States Distance Learning Association (USDLA) to understand the attitudes and concerns of higher education instructors and leadership.
From DSC: It takes time to understand what a given technology brings to the table…let alone a slew of emerging technologies under the artificial intelligence (AI) umbrella. It’s hard enough when the technology is fairly well established and not changing all the time. But its extremely difficult when significant change occurs almost daily.
The limited staff within the teaching & learning centers out there need time to research and learn about the relevant technologies and how to apply those techs to instructional design. The already stretched thin faculty members need time to learn about those techs as well — and if and how they want to apply them. It takes time and research and effort.
Provosts, deans, presidents, and such need time to learn things as well.
Bottom line: We need to have realistic expectations here.
AI Adoption in Corporate L&D — from drphilippahardman.substack.com by Dr. Philippa Hardman Where we are, and the importance of use cases in enabling change
The headline of the report is that we’ve never seen a technology adopted in enterprise as fast as generative AI. As of November 2023, two-thirds (67%) of survey respondents reported that their companies are using generative AI.
However, the vast majority of AI adopters in enterprise are still in the early stages; they’re experimenting at the edges, rather than making larger-scale, strategic decisions on how to leverage AI to accelerate our progress towards org goals and visions.
The single biggest hurdle to AI adoption in large corporates is a lack of appropriate use cases.
15 legal Substacks worth your time — from jordanfurlong.substack.com by Jordan Furlong It’s my great pleasure to return the compliment of a Substack Recommendation and direct your attention to these terrific legal newsletters.
GeoLegal Notes, by Sean West, Co-Founder Hence Technologies, Santa Monica, CA. “Bridging the gap between global affairs and legal practice; helping equip legal leaders to thrive against a backdrop of increasing global complexity.”
—> Recommended post: Law and Politics of Supply Chains for Goods, AI and Knowledge
…
In addition…please also take a moment to click through and check out these ten other excellent newsletters:
Abstract
We conducted the first randomized controlled trial to study the effect of AI assistance on human legal analysis. We randomly assigned law school students to complete realistic legal tasks either with or without the assistance of GPT-4. We tracked how long the students took on each task and blind-graded the results. We found that access to GPT-4 only slightly and inconsistently improved the quality of participants’ legal analysis but induced large and consistent increases in speed. AI assistance improved the quality of output unevenly—where it was useful at all, the lowest-skilled participants saw the largest improvements. On the other hand, AI assistance saved participants roughly the same amount of time regardless of their baseline speed. In follow up surveys, participants reported increased satisfaction from using AI to complete legal tasks and correctly predicted the tasks for which GPT-4 were most helpful. These results have important descriptive and normative implications for the future of lawyering. Descriptively, they suggest that AI assistance can significantly improve productivity and satisfaction, and that they can be selectively employed by lawyers in areas where they are most useful. Because these tools have an equalizing effect on performance, they may also promote equality in a famously unequal profession. Normatively, our findings suggest that law schools, lawyers, judges, and clients should affirmatively embrace AI tools and plan for a future in which they will become widespread.
Welcome to the first of a few special Legal Week 2024 edition episodes of “The Geek in Review,” where we looked for innovative and creative ideas on the road and recorded live from the bustling environment of the 2024 Legal Week conference in New York.
Marlene Gebauer notes the transformation of Legal Week into a thought leadership conference, with a special mention of keynote speaker Bryan Cranston’s impactful talk on storytelling, branding, and the thoughtful application of AI in both the acting world and the legal tech space.
In the second of a special series of interviews from Legal Week 2024 , co-hosts Greg Lambert and Marlene Gebauer welcomed Mollie Nichols, CEO, and Mark Noel, Chief Information and Technology Officer of Redgrave Data. Nichols and Noel discuss Redgrave Data’s mission to cut through the hype of legal tech innovations, particularly generative AI. Nichols emphasized the company’s focus on delivering custom solutions that meet clients’ actual needs and highlighted the importance of educating the legal community on effectively integrating new technologies into their practices.
Mark Noel emphasized the strategic addition of data scientists to their team, enabling Redgrave Data to develop and advise on cutting-edge technologies. He stressed the importance of applying generative AI judiciously, pointing out its limitations and the potential for misuse if not properly vetted. Noel and Nichols shared insights on navigating the legal tech landscape, emphasizing efficiency, data management, and the careful evaluation of tech solutions.
I can’t recall any prior technology that has simultaneously trigged both of breathless enthusiasm and panicked resistance . While the technology shows game changing promise, there are significant ethical, client relations, security and intellectual property concerns which still need to be addressed. The C-Suite survey charts the issues of concern where are impeding adoption of GenAI.
These days, whenever a customer asks me for my view of generative AI for law and where and how they should be using it, I reply with a simple analogy: Think ‘Google Maps for lawyers’.
Analogising generative AI for law to mapping technology begins with thinking about legal matters as journeys. A similar conceptualisation appears in a recent article by Justin Turman, legal systems and processes manager at Stryker, with legal work as flight paths. Either way, you have a desired destination (winning a lawsuit, closing a deal, finalising a contract, etc.) and many possible ‘routes’ reflecting various strategic and tactical decisions along the way. At various junctures, it is helpful to get intelligence and directions on how to proceed. And, as with driving (or flying), circumstances are subject to change along the way – newly discovered facts, shifts in goals, etc.
Based on that bathroom-break induced inspiration, Neal went on to develop — and this week launch — Lexplug, a site developed for law students “to make interacting with cases more accessible, efficient, and engaging.”
Search, Query and Simplify Case BriefsAt its core, Lexplug is a library of case briefs, all created by Neal using GPT-4. So far, he has created 7,000 briefs, and hopes to have 50,000 by the end of the year. To decide which cases to prioritize, he collected a variety of syllabi for basic law school courses such as constitutional law and torts and extracted the key cases. He also has the full text of every briefed case.
But there is another, related, kind of justice gap in this country. It is the funding gap between those who are developing legal technology to better meet the legal needs of low-income Americans and those who are developing legal tech to serve large law firms and corporate legal departments.
…
At Legalweek, the focus of the conference is almost exclusively on tech for large law firms and corporate legal departments. The sponsors and exhibitors are focused on products for e-discovery, contract lifecycle management, large firm financial and business management, and the like. The programs, similarly, focus on data privacy, e-discovery, information governance, contract technology, and large-scale litigation.
The exhibit hall spans three floors, the booths are big and bright, and the vendors seemingly all throw parties that are over the top, or quite literally near the top, at venues such as the Rainbow Room at the top of Rockefeller Center, with freely flowing alcohol and plenty of food.
By contrast, at the ITC conference, the attendees come mostly from the ranks of legal aid offices, pro-bono programs, court self-help staff, and the like. The programs focus on how understaffed legal aid offices and understaffed courts and understaffed community programs can use technology to help meet the influx of low-income people seeking legal help.
The juxtaposition of the glitziness of one conference and the modesty of the other speaks to the larger issue of inequity in legal tech – and specifically financial inequity.
An important addition to the national access to justice landscape, the Above the Line Network (ATLN) has launched today to tackle the daunting challenges that middle-class Americans face when seeking legal help that doesn’t break the bank. While most organized access to justice efforts rightly focus on low-income and poor people who are especially vulnerable, we can never achieve our nation’s ideal of equal justice for all when middle-class people—who make up more than 50% of the nation’s population— and small businesses struggle to find quality, affordable legal services. They are “above the line” of income eligibility for the free legal aid reserved for the poorest Americans, but they also struggle to find quality and affordable legal services in the current legal market.
General counsel and chief legal officers will do more work in-house with the help of tech investments, especially as more legal tech companies add generative AI and other types of artificial intelligence capabilities to the tools they offer in-house teams. At the same time, legal leaders will be exploring ways to reduce outside counsel costs, in part by giving work to smaller firms and reserving the most complex work for the largest firms.
ARLINGTON, Va. – POLITICO, today announced the launch of a new, innovative feature allowing POLITICO Pro users to quickly review an AI-generated summary of Federal bills, rapidly accessing critical legislative context while benefiting from the in-depth analysis and insights that subscribers rely upon. POLITICO Pro is the leading subscription policy intelligence platform.
Legaltech is revolutionizing the way lawyers work — from verdict.co.uk by Legaltech focuses on increasing work efficiency by addressing important but low-value or high-volume work to provide more time for lawyers to work on tasks requiring a higher skill set.
For example, in February 2023, Allen & Overy launched its generative AI platform, integrating Harvey (based on GPT-4 technology by OpenAI), into its global practice to help its lawyers with drafting legal documentation. In December 2023, Allen & Overy also created an AI contract negotiation tool, ContractMatrix, in partnership with Harvey. The firm estimates that the tool saves around seven hours when negotiating a contract. When discussing these innovations, David Wakeling, Head of the Markets Innovation Group at Allen & Overy explained that the firm’s goal was to “disrupt the legal market before someone disrupts us.”
However, the fact that thousands of students and clerks approach me rather than those officially entrusted with these duties suggests that the clerkship system is a five-alarm fire and that law schools and the judiciary have failed in their duty of care to students and employees. They must do better.
…
Here are some questions clerks always ask me:
What are my options for redress?
Can I report the mistreatment anonymously?
Will I be protected against retaliation by the judge?
Will I experience reputational harm in the legal profession when job searching if I speak out, leave my clerkship early, or file a complaint?
Do you hear from other clerks like me? How common is my situation?
Firms must continue to evolve to remain relevant — from lawyersweekly.com.au by Emma Musgrave Law firms of all shapes and sizes must continue to reinvent themselves beyond the COVID-19 pandemic, according to two senior leaders at Piper Alderman.
“So [it’s] not saying, ‘We’re going to roll out ChatGPT across the board and use that’; it’s finding some particular cases that might be useful,” he explained.
“We’ve had, for example, [instances] where lawyers have said, ‘We’ve got a bunch of documents we use on a regular basis or a bunch of devices we use on a regular basis. Can we put these into ChatGPT and see if we can [find a] better way of pulling data out of things?’ And so use cases like that where people are coming up with ideas and trying them out and seeing how they go and [questioning whether] we roll this out more widely? I think that’s the approach that seems to be the best.”
eDiscovery investigations and the potential for cyberattacks
Enhancing efficiency, but potential risk for data leakage
Automation of administrative tasks and rapid data research
Revolutionizing Law Firm Strategies With AI And SEO — from abovethelaw.com by Annette Choti Explore how AI and SEO are transforming law firm strategies, from automated keyword research to predictive SEO and voice recognition technology.
AI and SEO are two powerful technologies transforming the digital world for legal offices. AI can enhance SEO strategies, offering a competitive edge in search engine rankings. AI can streamline your content creation process. Learn about machine learning’s role in enhancing content optimization, contributing to more targeted and effective marketing efforts.
Embracing Gen AI in Legal So in all the Gen AI smoke and handwringing, lets first identify what we excel at as lawyers. What only we as lawyers are qualified to do. Then, when it comes to technology and the flavor of the day, Gen AI, let’s look relentlessly at how we can eliminate the time we spend on anything else. Let technology free us up for the work only we can do.
That’s Satya Nadella’s advice. And Microsoft has done pretty well under his leadership.
It’s a rare privilege to converse with a visionary like Judge Xavier Rodriguez, who has seamlessly blended the realms of justice, law, and technology. His journey from a medieval history enthusiast to a United States district court judge specializing in eDiscovery and AI is inspiring.
…
Judge Rodriguez provides an insightful perspective on the need for clear AI regulations. He delves into the technical aspects and underscores the potential of AI to democratize the legal system. He envisions AI as a transformative force capable of simplifying the complexities that often make legal services out of reach for many.
Judge Rodriguez champions a progressive approach to legal education, emphasizing the urgency of integrating technology competence into the curriculum. This foresight will prepare future lawyers for a world where AI tools are as commonplace as legal pads, fostering a sense of anticipation for the future of legal practice.
The Emerging Role of Smart TVs Boothe and Comiskey claim that our TVs will become even smarter and better connected to the web and the internet. Our TVs will become an intelligent center for a variety of applications powered through our smartphone. TVs will be able to direct things like appliances and security cameras. Perhaps even more importantly, our TVs can become e-commerce centers, allowing us to speak with them and conduct business.
…
This increased TV capability means that the TV could become a more dominant mode of working and computing for lawyers. As TVs become more integrated with the internet and capable of functioning as communication hubs, they could potentially replace traditional computing devices in legal settings. With features like voice control and pattern recognition, TVs could serve as efficient tools for such things as document preparation and client meetings.
From DSC: Now imagine the power of voice-enabled chatbots and the like. We could be videoconferencing (or holograming) with clients, and be able to access information at the same time. Language translation — like that in the Timekettle product — will be built in.
As we step into 2024, the legal industry continues to be reshaped by technological advancements. This year promises to bring new developments that could revolutionize how legal professionals work and interact with clients. Here are key predictions for legal tech in 2024:
Last Friday was Legaltech Week’s year-end show, in which our panel of journalists and bloggers picked the year’s top stories in legal tech and innovation.
So what were the top stories? Well, if you missed it, no worries. Here’s the video:
Building a lawyer support ecosystem — from jordanfurlong.substack.com by Jordan Furlong Pro sports teams invest serious resources to maximize the performance of their highly skilled, uniquely specialized professionals. Why don’t law firms do the same?
So my advice to law firms here is simple: Create more support for your lawyers and other professionals. Design and build ecosystems for the training, support, and personal and professional development of these highly skilled, uniquely specialized, and strategically critical human assets. Hire more full-time business coaches, skill trainers, and relationship managers. Spend money on these supportive measures now, or face massive bills down the road for the repair and replacement of the people you worked so hard to recruit.
Katherine discusses her unique approach to problem-solving in the legal field, which involves design thinking and project management principles. Katherine explains the importance of lawyers understanding client needs, the process of workflow mapping, and the challenges of implementing new processes in law firms.
Katherine also emphasizes that empathy and understanding the client journey is a must when designing effective legal services. In the end, she also gives some real world tips about where to begin working in project management principles into legal practice.
Like every year, I end 2023 with a blog featuring all the other people you should be reading (or listening to) as part of your day-to-day in-house life. For me, the hard part is choosing just a few to highlight. There are so many great content generators out there fighting for your (and my) attention. Unfortunately, I cannot list everyone (and I rarely repeat listing anyone I have listed in the past, i.e., I just assume you know they are still worth your time – they are!). [2] And, if you are interested in past winners, you can start by reading last year’s edition of “Best Blogs (and Other Media) for In-House Lawyers.” Instead, I try to list some new voices for you to check out. And, same as always, there is no particular order to my list (literally I am just typing as I find things in my Post-it notes, faulty memory, and Google Keep folders). Okay, where was I…? Right, enough yakking, let’s get on with the 2023 edition of Best Blogs and Other Media for In-House Counsel!
6 in-house legal trends to watch in 2024 — from legaldive.com from Lyle Moran and Robert Freedman AI, labor, antitrust, bankruptcies, women GCs and cross-collaboration are among the headlines in-house counsel can expect this year.
In the 2023 Litigation Support Trend Survey, U.S. Legal Support asked lawyers and legal professionals what technology trends they observed in 2023, and how they expect their use of technology to change in 2024.
Now, the results are in—check out the findings below.
Topics included:
Use of Artificial Intelligence
Prevalence of Remote Depositions
Digital Reporting
Speaking of legaltech and/or how emerging technologies are impacting the legal realm, also see:
? Voice Cloning in Law: ? A Brave New World of Sound!
In my latest blog, “The Deepfake Dilemma: Navigating Voice Cloning in the Legal System,” I tackle the complex challenges posed by voice cloning technology in the justice system. Discover the challenges, risks, and ethical… pic.twitter.com/Jj5u51u1Ia
Look over this list of my blog posts that were most popular this year, and there is no doubt about the topic that most captivated the legal industry. Of my 40 most-read posts of 2023, 30 directly involved generative AI and others implicated it.
What I’m watching for in 2024 — from alexofftherecord.com by Alex Su My view of the legal ecosystem, and why I’m going to pay close attention to generative AI, new Biglaw offerings, and the rise of “independent” attorneys
Today, instead of sharing my predictions about what’s coming to the legal industry, I’ll share where I think the most action will take place next year. In short, it’s (1) generative AI; (2) Biglaw firms adding low-cost capabilities; and (3) strong bench talent among independent attorneys. Before I get into why, I’ll share some observations on the past, and the trends I’m seeing take place right now.
In 2023, the legal landscape has been significantly shaped by two key trends: the rapid evolution of Artificial Intelligence (AI) and the advancements in ediscovery. These developments have not only transformed legal processes but also presented new challenges and opportunities for legal professionals. As we delve into this first part of our series, we examine the top blogs that have been at the forefront of these trends. These articles offer a window into the current state of legal tech, providing invaluable insights into how these technological advances are reshaping the practice of law.
In the fast-paced world of the digital era, technology is revolutionizing almost every aspect of our lives, and the legal field is no exception. The traditional process to hire a lawyer, once dominated by word-of-mouth referrals and physical law firm visits, is undergoing a transformation. This shift is not just changing how clients find and interact with legal professionals, but also how legal services are delivered and experienced. In this blog, we delve into the ways technology is reshaping the landscape of hiring a lawyer.
A virtual assistant can perform administrative tasks for a firm, from client communication and appointment scheduling to legal research, contract management and accounting. Delegating these tasks can be an effective way to free up lawyers to do what they do best. Based on my work with virtual assistants, here are some of the potential benefits and also tips on how you can find a VA who best fits the needs of your practice.
The changing mindset of lawyers toward technology
In 2023, there was a noticeable shift in the mindset of legal professionals. While its direct health impacts remain uncertain, the pandemic’s influence in accelerating technology adoption has been undeniable. Lawyers and judges, traditionally viewed as tech-averse, are now embracing tools like Zoom, iPads and smartwatches with surprising enthusiasm.
Post-pandemic, as lawyers returned to offices—often in a hybrid model—they displayed a newfound curiosity about technology. This change in attitude came at an opportune moment, coinciding with the introduction of new generative AI technologies in the legal field even as legal technology funding declined.
WASHINGTON, Dec 31 (Reuters) – Artificial intelligence represents a mixed blessing for the legal field, U.S. Supreme Court Chief Justice John Roberts said in a year-end report published on Sunday, urging “caution and humility” as the evolving technology transforms how judges and lawyers go about their work.
Roberts struck an ambivalent tone in his 13-page report. He said AI had potential to increase access to justice for indigent litigants, revolutionize legal research and assist courts in resolving cases more quickly and cheaply while also pointing to privacy concerns and the current technology’s inability to replicate human discretion.
“I predict that human judges will be around for a while,” Roberts wrote. “But with equal confidence I predict that judicial work – particularly at the trial level – will be significantly affected by AI.”
During lockdown, we were forced to start producing videos for Moocs remotely. This was quite successful, and we continue to use these techniques whenever a contributor can’t come to the studio. The same principles can be used by anyone who doesn’t have access to a media production team. Here are our tips on producing educational videos on a budget.
I have a column about AI and law in @thetimes today. Here are some brief extracts:
“The main social benefit of legal AI will not be in making lawyers more efficient but in empowering people who are not lawyers to handle their own legal affairs” …
Here, I’ll explore some ways that engineers and lawyers see the world differently based on their strengths and experiences, and I’ll explain how they can better communicate to build better software products, especially in AI, for attorneys. Ideally, this will lead to happier lawyers and more satisfied clients.
A groundbreaking legal tech startup, Zuputo, is set to reshape the legal landscape across Africa by making legal services more accessible, affordable, and user-friendly.
Founded by Jessie Abugre and Nana Adwoa Amponsah-Mensah, this women-led venture has become synonymous with simplicity and efficiency in legal solutions.
We have formed a new global partnership with @AxelSpringer and its news products.
Real-time information from @politico, @BusinessInsider, European properties @BILD and @welt, and other publications will soon be available to ChatGPT users.
But if you are looking for a law-related GPT, a new site can help. Raymond Blyd, the Amsterdam-based cofounder of Legalpioneer, a site that lists law-related companies, and CEO of Legalcomplex, a company that tracks investments and market data, has uncovered nearly 600 law-related GPTs and made them searchable on a new resource he calls Legalpioneer Copilot.
Blyd (who recently changed the spelling of his last name from Blijd) told me that the GPTs he has found cover a range of legal, regulatory and tax issues, and could be useful for academics, professionals and businesses.
AutoNDA is designed for inhouse legal and business teams that need to streamline and centralize the NDA process. It enables self-serve access for your business teams and gives in-house teams control over outbound NDAs. It also stores and organizes all completed NDAs.
From DSC: Google hopes that this personalized AI/app will help people with their note-taking, thinking, brainstorming, learning, and creating.
It reminds me of what Derek Bruff was just saying in regards to Top Hat’s Ace product being able to work with a much narrower set of information — i.e., a course — and to be almost like a personal learning assistant for the course you are taking. (As Derek mentions, this depends upon how extensively one uses the CMS/LMS in the first place.)
What does this all mean for the first day of class? Approach that first day with “learning-centered” in your mind. Focus on learning. Learning is all about curiosity and desire. Desire to know, to figure things out, to be surprised, all getting that dopamine flowing throughout the brain: That is what learning-centered is all about. An exam is best thought of as feedback, showing whether students are learning, not a date to cover on the first day and dread every class period in the meantime. An exam should never be the reason to learn, it should always be an indication of learning. Don’t spend your first 45 or 85 minutes focused solely on exams, term paper deadlines, and attendance policies. That moves teaching toward an artificial transactional arrangement where students learn in exchange for points and grades.
From DSC: I would highly recommend starting out with a major HOOK. Some question, some video, some recording/piece of audio, etc. that would provoke interest, curiosity, or even some emotion. On that first day, the following item MUST be addressed if you expect to engage your students:
Why is this class/topic relevant?
Start with that. Immediately. The other stuff can be introduced later on, as Todd mentions.
