In a matter of seconds, the judges on an appeals court in New York realized that the man speaking to them on a video screen, a person who was going to argue in a lawsuit, not only lacked a law degree but was nonexistent.
A panel of judges was scheduled to hear from Jerome Dewald, a plaintiff in an employment dispute, on March 26 under the stained-glass dome of the First Judicial Department of the New York State Supreme Court Appellate Division. This marked the latest bizarre chapter in the awkward arrival of artificial intelligence in the legal world.
Judge Sallie Manzanet-Daniels stated, “The appellant has submitted a video for his argument. Okay, we will hear that video now.” A happy, young man wearing a button-down shirt, sweater, and sculpted hairstyle appeared on the video screen. “May it please the court,” the man said, “I come here today a humble pro se before a panel of five distinguished justices.” “Okay, hold on,” Manzanet-Daniels said. “Is that counsel for the case?” “I generated that. That’s not a real person,” Dewald responded.
Indeed, it was an artificial intelligence-generated avatar. The judge was not happy.
Knowing that when you submitted your application would have been convenient. Manzanet-Daniels yelled for the tape to be turned off across the room after saying, “You didn’t tell me that, sir.”
She remarked, “I don’t appreciate being misled,” and then she let Dewald finish his point.
Later, Dewald wrote a letter of apology to the court, claiming that he had no malicious intent. He had to argue his case on his own since he was not represented by an attorney in the litigation. In his opinion, the avatar would be able to deliver the presentation without his typical faltering, tripping over words, and muttering.
Dewald claimed in an interview with The Associated Press that he utilized a program made by a software company in San Francisco to construct the avatar after requesting authorization from the court to play a prerecorded video. He initially attempted to create a digital image of himself, but he was unable before to the hearing.
According to Dewald, “the court was really upset about it and he was pretty well chewed up by them. Real lawyers have also run afoul of the law while using artificial intelligence.
In June 2023, a federal judge in New York fined two lawyers and a law company $5,000 apiece for using an AI tool to conduct legal research and ultimately citing fake court cases that the chatbot had created. The company’s failure to recognize that artificial intelligence could fabricate information was a “good faith mistake.”
Later that year, legal documents submitted by attorneys representing Michael Cohen, a former personal attorney for President Donald Trump, referenced more fictitious court decisions created by AI. Accusing himself, Cohen claimed he was unaware that the Google tool he was using for legal research could potentially produce so-called artificial intelligence hallucinations.
Although those were mistakes, Arizona’s Supreme its purposefully started summarizing its decisions for the public last month by utilizing two AI-generated avatars, identical to the one Dewald utilized in New York.
Using the aliases “Daniel” and “Victoria,” the avatars claim to be there “to share its news” on the court’s website.
At William & Mary Law School’s Center for Legal and Court Technology, Daniel Shin, an adjunct professor and assistant director of research, said he wasn’t shocked to hear that Dewald had used a phony to argue an appeals case in a New York court. He thought it was inevitable.
He claimed that due to custom, court regulations, and the possibility of disbarment, it was improbable that a lawyer would act in such a way. However, he claimed that people who show up in court without an attorney and ask to speak are typically not informed of the dangers of presenting their case through a video that has been artificially created.
After listening to a webinar hosted by the American Bar Association that covered the application of artificial intelligence (AI) in the legal field, Dewald stated that he makes an effort to stay current with technological advancements.
As of Thursday, Dewald’s case was still pending at the appeals court.
