California Bar discloses AI was used to develop some questions in problem-plagued February exam


LOS ANGELES — The State Bar of California has disclosed that some multiple-choice questions in a problem-plagued bar exam were developed with the aid of artificial intelligence.

The legal licensing body said in a news release Monday that it will ask the California Supreme Court to adjust test scores for those who took its February bar exam.

“The debacle that was the February 2025 bar exam is worse than we imagined,” Mary Basick, assistant dean of academic skills at the University of California, Irvine, Law School, told the Los Angeles Times. “I’m almost speechless. Having the questions drafted by non-lawyers using artificial intelligence is just unbelievable.”

exterior building office state bar of california los angeles
A pedestrian walks past the State Bar of California office in Los Angeles, in June 2024.Google Maps

In February, the new exam led to complaints after many test-takers were unable to complete their bar exams. The online testing platforms repeatedly crashed before some applicants even started. Others struggled to finish and save essays, experienced screen lags and error messages and could not copy and paste text, the Times reported earlier.

According to a recent presentation by the State Bar, 100 of the 171 scored multiple-choice questions were made by Kaplan Exam Services and 48 were drawn from a first-year law students exam. A smaller subset of 23 scored questions were made by ACS Ventures, the State Bar’s psychometrician, and developed with artificial intelligence.

“We have confidence in the validity of the (multiple-choice questions) to accurately and fairly assess the legal competence of test-takers,” Leah Wilson, the State Bar’s executive director, told the newspaper in a statement.

Katie Moran, an associate professor at the University of San Francisco School of Law who specializes in bar exam preparation, told the newspaper, “It’s a staggering admission.”

“The State Bar has admitted they employed a company to have a non-lawyer use AI to draft questions that were given on the actual bar exam,” she said. “They then paid that same company to assess and ultimately approve of the questions on the exam, including the questions the company authored.”



Source link

  • Related Posts

    How Pope Leo became a beloved Peruvian figure

    CHICLAYO, Peru — Walkiria Garcia was 14 years old when she made her confirmation in the Catholic Church, an already significant religious sacrament made even more unforgettable by the man…

    Wall Street Plays Long Game as Deals Go Private

    Now, however, Wall Street’s leveraged finance desks, which chased fee-rich deals to reel in a third of investment-banking revenue in recent years, are in no mood to fritter away some…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Israeli airstrikes kill 23 in Gaza as outcry over aid blockade grows – National

    Israeli airstrikes kill 23 in Gaza as outcry over aid blockade grows – National

    Whitney Wolfe Herd on burning out — and bouncing back

    Whitney Wolfe Herd on burning out — and bouncing back

    Gabriel embracing addition of Sanders to Browns’ QB competition

    Gabriel embracing addition of Sanders to Browns’ QB competition

    Monster Hunter: The Board Game Buying Guide and Expansions

    Monster Hunter: The Board Game Buying Guide and Expansions