{"id":95509,"date":"2025-05-19T01:00:04","date_gmt":"2025-05-19T05:00:04","guid":{"rendered":"https:\/\/danielschristian.com\/learning-ecosystems\/?p=95509"},"modified":"2025-05-18T18:42:31","modified_gmt":"2025-05-18T22:42:31","slug":"ai-caught-in-epic-legal-fail-the-neuron","status":"publish","type":"post","link":"https:\/\/danielschristian.com\/learning-ecosystems\/2025\/05\/19\/ai-caught-in-epic-legal-fail-the-neuron\/","title":{"rendered":"“AI caught in EPIC legal fail” [The Neuron]"},"content":{"rendered":"
\n

From The Neuron’s<\/em> posting entitled, “20-Somethings Break AI”<\/a>:<\/p>\n<\/div>\n

\n

Anthropic’s Claude AI<\/a>\u00a0just pulled a classic AI move: it completely fabricated a legal citation, and then\u2014plot twist\u2014the lawyers actually used it in court.\u00a0Awkward.<\/i><\/p>\n

The scene: A Northern California courtroom, where Anthropic’s lawyers are battling music publishers. Claude decides to get creative and generates a citation out of thin air\u2014complete with a made-up title and nonexistent authors. And get this: their \u201cmanual citation check\u201d didn’t even catch it.<\/p>\n

It’s like the AI equivalent of writing your homework, but then your dog actually<\/i>\u00a0eats it\u2014except in this case, the dog actually wrote the homework, and it doesn’t make any sense.\u00a0Nor does this metaphor, which is increasingly getting away from us\u2026<\/i><\/p>\n

This is far from the first time AI has fumbled in the legal arena, and it\u2019s not exclusive to Claude. Earlier this week, another judge absolutely roasted law firms for submitting \u201cbogus AI-generated research<\/a>.\u201d We seemingly see these headlines every week; here\u2019s\u00a0all the ones Perplexity<\/a>\u00a0and\u00a0OpenAI Deep Research<\/a>\u00a0could dig up (remember, these too could have hallucinations in them!<\/i>).<\/p>\n

Anyway, talk about confidence, right? Feels like more of a lawyer problem than an AI problem. Consider this your friendly reminder to always check your work.\u00a0<\/i>Twice<\/i>.<\/i><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

From The Neuron’s posting entitled, “20-Somethings Break AI”: Anthropic’s Claude AI\u00a0just pulled a classic AI move: it completely fabricated a legal citation, and then\u2014plot twist\u2014the lawyers actually used it in court.\u00a0Awkward. The scene: A Northern California courtroom, where Anthropic’s lawyers are battling music publishers. Claude decides to get creative and generates a citation out of […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[113,329,482,825,837,833,830,285,195,321,367],"tags":[],"class_list":["post-95509","post","type-post","status-publish","format-standard","hentry","category-21st-century","category-24x7x365-access","category-intelligent-systems","category-law-schools","category-legal-operations","category-legal-reform","category-legal-technologies","category-legislation-legislatures","category-tools","category-united-states","category-vendors"],"_links":{"self":[{"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/posts\/95509","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/comments?post=95509"}],"version-history":[{"count":3,"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/posts\/95509\/revisions"}],"predecessor-version":[{"id":95526,"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/posts\/95509\/revisions\/95526"}],"wp:attachment":[{"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/media?parent=95509"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/categories?post=95509"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/tags?post=95509"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}