I normally don't discuss many of the "AI hallucination" opinions that regularly come down these days. For one thing, they're fairly straightforward (and uniform), and all basically say "It's okay to use AI, but if you do, you must make sure to thoroughly check the stuff to make sure it's right, and if you don't, you can get into a ton of trouble." Common sense, and entirely right, so I don't have much to add to it. Plus, generally, these opinions get a lot of mainstream press and attention anyway, so it's not like it's really important for me to highlight them and express my agreement with what they say.
Today's opinion from the Ninth Circuit, by contrast, is different. It's definitely worth mentioning.
First off, it's one of the very few Ninth Circuit opinions on the subject, so it's important for anyone who's litigating in that forum. Second of all, it contains a very strong claim about what an attorney's duties are with respect to submissions that they sign -- one that might, in fact, be too strong. So it's very much worth talking about.
The first paragraph of the opinion contains a good summary of what went down in this particular case:
"Attorneys Mike Singh Sethi and William Rounds filed briefs in this Court with multiple nonexistent cases, misattributed quotations, and gross misrepresentations of real cases. Sethi and Rounds claimed that the errors were the product of innocent typographical mistakes. And they repeatedly denied the possibility that generative artificial intelligence (“AI”) might have produced the errors. Having identified other cases in which Sethi or Rounds filed briefs that presented similar problems, we ordered them to show cause why they should not be sanctioned, suspended, or disbarred from practice before this Court. We have considered their response, and we now impose discipline."
Cutting to the chase, the attorneys here ultimately get sanctioned ($2500 each); suspended from the Ninth Circuit for six months; reported to the Bar; and ordered to provide a copy of the opinion to each of their clients, opposing counsel, and the presiding judge in every tribunal in which they have a case. Ouch.
I'm not sure that anyone is going to decry what happened to these particular lawyers (other than their friends and family, of course). Among other things, the opinion stands as yet another reminder that when you're caught for something like this, don't try to defend or deflect. Just go full mea culpa. You can tell that the panel here was very much not happy about the way the attorneys here responded to the court's investigation into these events. (Lines like this one permeate the opinion: "Instead of transparency, and despite our Order to Show Cause, Sethi has apparently chosen to engage in more subtle subterfuge.")
What I really wanted to focus on, though, is the Ninth Circuit's overall articulation of what it means to be a lawyer who signs a brief in that tribunal -- whether generated in whole or part by AI, or otherwise.
We obviously all know about Rule 11 and what it means for us to sign a brief. We're responsible for what's in it. That much is clear, and undisputed.
When we write the briefs ourselves, there's no real complexity. We're in charge, and we have to make sure that everything we say is entirely accurate.
But in the real world, lawyers often delegate. Associates write first drafts. Subordinate partners take their turn. Someone high up gives it an additional read. Someone ultimately signs the thing; generally, someone fairly high up the food chain.
All of that is fine as well.
What struck me about today's opinion, though, is how the Ninth Circuit articulates the duties of anyone who signs the brief. Citing the opinion from the California Court of Appeal, here's what the panel says:
"But a competent and diligent attorney must do more than prompt generative AI, check that the citations provided by the AI are real and the subject matter roughly on point, and call it a day. Cal. Bar Practical Guidance 3 (Duties of Competence and Diligence) (“The duty of competence requires more than the mere detection and elimination of false AI-generated results.”). A competent and diligent attorney must also read and reason. The California Court of Appeal put it well: “To state the obvious, it is a fundamental duty of attorneys to read the legal authorities they cite in appellate briefs or any other court filings to determine that the authorities stand for the propositions for which they are cited.” Noland, 114 Cal. App. 5th at 445 (original emphasis). This exercise of professional judgment “cannot be delegated to generative AI and remains the lawyer’s responsibility at all times.” Cal. Bar Practical Guidance 3 (Duties of Competence and Diligence). That is, there is no substitute for “critical attorney analysis fostered by traditional research and writing.” Id.
The duties of competence and diligence also apply, of course, to attorneys who do not use generative AI and do not suspect its use in the drafts they review. And the substance of the duties is the same. “Simply stated, no brief, pleading, motion, or any other paper filed in any court should contain any citations—whether provided by generative AI or any other source—that the attorney responsible for submitting the pleading has not personally read and verified.” Noland, 114 Cal. App. 5th at 430 (original emphasis)."
(Emphases in original)
I fully understand why the panel says that in the present case. The lawyers here hired law students who hadn't yet passed the Bar to draft their briefs, and the AI-generated results included both hallucinated (i.e., fabricated) cases as well as numerous claims about real cases for which those cases did not stand. The panel wanted to make it clear -- and rightly so -- that one's duty is not only to cite-check cases to make sure that those cases in fact exist, but that they also stand for the proposition for which they are cited in the brief.
Fair enough. That's indeed one's obligation, and it was clearly violated here.
But there's a difference, in my view, between one's responsibility in this regard, on the one hand, and the particularized personal duty that exists to ensure that this responsibility is satisfied.
Let's just reiterate for a second the money quote from today's opinion:
"No brief, pleading, motion, or any other paper filed in any court should contain any citations—whether provided by generative AI or any other source—that the attorney responsible for submitting the pleading has not personally read and verified."
Now, I've signed a lot of briefs in my day. I'm sure so have you. The ones I wrote myself, yep, I surely personally read and verified every single citation. I'm the one that put them in, and they indeed stood for the propositions for which I cited them.
There are other briefs, by contrast, where I trusted the process. Here's my admission:
I have not, in fact, personally read every single case cited anywhere in every section of every single brief I've ever signed. Important cases? Definitely read them. Ones we (or the other side) discusses at some length, or relies heavily on? For sure.
But every single case? Even for common background propositions, or orthogonal points, or positions I already know to be unambiguously true?
No. I forthrightly admit I haven't always personally read those. I may instead have trusted that those cases say what they say (e.g., that conclusions of law are reviewed de novo on appeal) because (1) I'm confident that's right, and (2) I have faith that the lower level person who cited the case looked it up themselves and made sure that's indeed what the case holds.
Now, if my trust is misplaced, and the case doesn't exist (or stand for the cited proposition), and I fully and completely responsible for that deficiency? Yes. One hundred percent. My bad. I am the one who should -- and will -- take the hit. Without complaint. It's my obligation to make sure that the cases that are cited in a brief that I sign say what I say they say.
But it seems overly strict -- and affirmatively pernicious -- to also require the signatory attorney to personally read and verify every single case that's cited. That's excessive, in my view. It increases the expense to the client -- significantly -- and unnecessarily so. You don't need a $1200/hour partner to personally read and Shepardize every single case, no matter how minor or uncontroversial. Someone has to read them, of course. And the accuracy of those citations remains the responsibility of whomever signs the brief. But responsibility can include delegation. I'm responsible for everything my underlings do. But that doesn't mean I have to personally replicate their work. That's not only inefficient, but is also detrimental to the monetary interests of my client in cost-effective lawyering.
Are there some lawyers out there who personally read and analyzing every single case, without even a single exception, that's cited in their brief? (And, presumably, Shepardize them as well to make sure they remain good law.) Surely yes. I'm confident they exist.
But I'll nonetheless wager that the majority of lawyers -- and, to be clear, I mean the majority of good, intelligent, and ethical lawyers -- do not make that their uniform practice. They do not, in fact, make sure to personally read in every matter every single case cited in a brief. They instead, on occasion, delegate. So long as such lawyers act reasonably and understand that they remain fully responsible for everything in the brief, such a practice is not per se wrong. You're not obligated in every matter to read personally every single case.
That's my controversial statement for the day, in any event.
Just know that the Ninth Circuit thinks I'm wrong. They've now said that it's your duty as a signator to personally read and analyze every single case in the brief.
So, right or wrong, as of today, that's something you gotta do. FYI.