The most prestigious law school admissions discussion board in the world.
|
 |
 
|
Law Professors Prefer AI Over Peer Answers
Poast new message in this thread
Date: June 2nd, 2026 5:12 PM Author: startling violet stage https://law.stanford.edu/wp-content/uploads/2026/06/salinas_et_al.pdf
"Professors rated LLMs far higher than their peers (average win rate = 75.33%), with models performing similarly to the best instructor. LLM responses were also rarely flagged as harmful (3.53%, vs 12.06% for professors). Preferences for LLM answers were consistent across evaluators and reflected shared professional standards." |
 |
Date: June 2nd, 2026 5:32 PM Author: Fuchsia nursing home brethren llm's are pretty good at legal stuff. thete's gonna be a flood of litigation as normies and proles realize a $20 claude subscription can produce at least as good of results as a $200/hr shitlaw attorney who doesn't return their calls. (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49911539) |
|
Date: June 2nd, 2026 5:39 PM Author: cerebral doobsian business firm (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49911544) |
|
Date: June 2nd, 2026 5:40 PM Author: startling violet stage I think filing fees will largely prevent that, but I agree that AI can do a pretty good job with basic drafting tasks. It can definitely analyze typical consumer dispute documents and create a competent complaint.
IME, the public AI tools aren't very good with legal research and citations, but a lot of cases don't require much of that. They also aren't particularly good with strategy and argument judgment. But competent drafting is typically more important than either of those for the normie litigation you're talking about. |
|
Date: June 2nd, 2026 5:43 PM Author: godawful national haunted graveyard a $500 filing fee isnt going to prevent normie litigation where stakes are high enough, such as some prole homeowner vs. a house contractor over a $30k kitchen reno (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49911551) |
|
Date: June 2nd, 2026 8:08 PM Author: exhilarant deer antler organic girlfriend Which LLMs? ChatGPT has been dead fucking wrong about multiple legal questions I've asked it (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49911904) |
Date: June 2nd, 2026 5:17 PM Author: startling violet stage Hey, 1Ls, no need for office hours. Just ask AI. (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49911521) |
|
Date: June 2nd, 2026 5:31 PM Author: godawful national haunted graveyard Law professors prefer JDs over LLMs, the study added. (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49911536) |
|
Date: June 3rd, 2026 11:33 AM Author: Olive pisswyrm (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49912733) |
|
Date: June 2nd, 2026 5:44 PM Author: Claret Marvelous Locus Giraffe What "questions" could a law professor possibly need the answer to? Should I go to Greece or Spain for my next sabbatical? (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49911554) |
|
Date: June 2nd, 2026 5:49 PM Author: cerebral doobsian business firm (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49911563) |
|
Date: June 3rd, 2026 11:33 AM Author: Olive pisswyrm (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2#49912734) |
|
Date: June 2nd, 2026 8:07 PM Author: razzle-dazzle lemon roast beef halford This is a dumb study with a predictable result.
They're essentially taking popular 1L cases taught first year law students, and asking professors and LLMs to explain them.
Predictably, the LLMS did better because they can just summarize the casebooks from the past 40 years in the most concise way.
But let's say we a ran a study, where we compared the explanations in the study guide vs the explanations of professors, and other professors chose the study guide 75% of the time. Would that be meaningful or surprising?
I wouldn't think so... |