The most prestigious law school admissions discussion board in the world.
|
 |
 
|
A lot of the uncritical praise for AI is infected by Gell-Mann amnesia
Poast new message in this thread
Date: April 22nd, 2025 7:01 PM Author: boyish pit Author and Harvard Medical School grad Michael Crichton described Gell-Mann amnesia as when you happen to read a news story about a topic where you have real expertise, and "[y]ou read the article and see the journalist has absolutely no understanding of either the facts or the issues. Often, the article is so wrong it actually presents the story backward—reversing cause and effect. I call these the 'wet streets cause rain' stories. Paper's full of them. In any case, you read with exasperation or amusement the multiple errors in a story, and then turn the page to national or international affairs, and read as if the rest of the newspaper was somehow more accurate about Palestine than the baloney you just read. You turn the page, and forget what you know. That is the Gell-Mann Amnesia effect."
Crichton was talking about the news media, but the same thing's true of AI. Try to have a conversation or ask probing questions of ChatGPT Pro on areas where you have pre-existing expertise and/or already know the answers, and you'll immediately see that its rife with errors, oversimplifications, and failures to draw inferences that would be relevant to your prompt.
But it's fucking great at giving you primers on shit you don't know much about -- frankly equivalent to new attorneys (and superior to TTTT summer associates) who often get that exact kind of task, in .01% of the time.
Obviously AI is still useful -- just like the media, as an institution, is useful to society and helps me know about shit that I wouldn't otherwise know about -- but it does make me wonder how much overconfident horseshit is lurking in its seemingly 180^180 memos on supersedeas-bond mechanics, how to find/buy a patek philippe perpetual calendar, and how to tweak my daily supplement stack and workout routine. |
Date: April 22nd, 2025 7:02 PM Author: Provocative Kitty the google deep mind guy said all diseases will be cured in 10 years (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48872148) |
 |
Date: April 22nd, 2025 7:04 PM Author: Stirring buff trailer park it was pretty impressive that he was able to keep a straight face during that (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48872152) |
|
Date: April 22nd, 2025 7:04 PM Author: Provocative Kitty you dont understand. he made a really good video game program and also did some stuff with puzzles (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48872155) |
|
Date: April 22nd, 2025 7:06 PM Author: Stirring buff trailer park "also, AI is going to make Karlstack's writing good"
60 Minutes interviewer gasps, recoils in shock |
|
Date: April 23rd, 2025 8:34 PM Author: Cowardly twinkling tanning salon (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48875437) |
|
Date: April 23rd, 2025 9:00 PM Author: arousing telephone voyeur (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48875496) |
|
Date: April 23rd, 2025 8:33 PM Author: Cowardly twinkling tanning salon (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48875436) |
|
Date: April 22nd, 2025 7:04 PM Author: Gaped Meetinghouse Crichton was 6’9 (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48872153) |
|
Date: April 22nd, 2025 7:15 PM Author: boyish pit 6'9" HUG-HMS Blonde spinner wives |
|
Date: April 23rd, 2025 10:47 AM Author: boyish pit (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48873520) |
|
Date: April 23rd, 2025 10:59 AM Author: Flesh laughsome locale it's just another research tool. everything is fallible.
AI is going through the same phase the internet is where at first people thought if something showed up in a google search it must be true, but after being burned a few times they realized it wasn't an oracle.
ai can be reasonably trusted to get to the right answer on things computers are good at like math or for questions you know are easy. it's a really great tool for proofreading. but anything complex it's best served as a jumping off point. just like how wikipedia is a good tool to begin researching something, but you gotta dig into the primary sources and be aware of bias on the platform. |
|
Date: April 23rd, 2025 11:17 AM Author: burgundy duck-like jew coldplay fan it does just seem like repackaged google/wiki slop (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48873580) |
|
Date: April 23rd, 2025 11:24 AM Author: Flesh laughsome locale i'm sure it's drawing from those heavily so it makes sense. (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48873598) |
|
Date: April 23rd, 2025 8:32 PM Author: boyish pit Using chatgpt does make you realize how much of the knowledge you rely on day-to-day is *not* on the internet: personal reputations, rumors about things coming down the pike, informal policies/practices of various institutions and offices (this even goes for big, high-level shit, like "why hasn't TRUMP nominated any judges yet" and "why is the DOJ leaning so heavily on interim appointments"... multiply this x100 when you're talking about local/obscure contexts), what judges like what arguments (I guess ~5% of this could be picked up on through westlaw or whatever), etc.
All of this still makes the quintessential junior associate theoretically replaceable by AI, since the associate is likely relying on the same internet-based information sources that AI can access. But it hasn't been super-helpful lately for the most front-of-mind professional questions I've been facing lately (my job mostly consists of, and I am mostly hired these days, because I hang out with judges and politicians and rich businessmen). |
|
Date: April 23rd, 2025 8:41 PM Author: carnelian really tough guy stage So… why hasn’t Trump nominated any judges yet? (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48875452) |
|
Date: April 24th, 2025 2:55 AM Author: boyish pit They want to set up an opportunity to nuke the blue slip. (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48876122) |
|
Date: April 23rd, 2025 8:46 PM Author: narrow-minded bateful black woman that's great, but do you actually add any value to the world? (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48875460) |
|
Date: April 24th, 2025 2:55 AM Author: boyish pit I mean, as much as any lawyer, which is to say.... (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48876123) |
|
Date: April 23rd, 2025 8:52 PM Author: Fear-inspiring laser beams 90% of people are dumb as fuck and 90% of “official” sources are always lying by omission *at best*. you have to see at least one conceptual tier beyond the surface-level conversation to have any clue what’s going on, and it’s unfair to expect ai to reliably do this at this point in its development. (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48875472) |
|
Date: April 24th, 2025 3:02 AM Author: boyish pit OFS, the shortcomings of AI are (1) training material and (2) integration.
I once had Pro give me a flat-out wrong (and dangerously so) legal assertion that it elaborated on immensely and made the linchpin of an entire argument. It was on the verge of shaking my confidence in the whole thing, but I pulled the sources and this exact error came directly from a (reputable, very much on-point) law review article. Hard to blame chatgpt for that.
And that's a topic that people *are* writing on. There's so, so much shit out there that still doesn't get memorialized for chatgpt to have any chance at seeing. |
|
Date: April 23rd, 2025 11:18 AM Author: chocolate know-it-all puppy Sounds like some bullshit made up thing a couple of annoying jews force memed so people would know who they are
Pass |
|
Date: April 23rd, 2025 8:34 PM Author: Cowardly twinkling tanning salon AI=Ashkenazi "Intelligence" (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48875438) |
|
Date: April 23rd, 2025 8:44 PM Author: Stirring buff trailer park *nods, scribbles notes* (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48875456) |
|
Date: April 23rd, 2025 8:57 PM Author: chocolate know-it-all puppy (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48875491) |
|
Date: April 24th, 2025 2:59 PM Author: boyish pit (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48877510) |
|
Date: April 24th, 2025 3:07 PM Author: Provocative Kitty based (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48877529) |
|
Date: April 25th, 2025 12:17 PM Author: boyish pit (http://www.autoadmit.com/thread.php?thread_id=5714813&forum_id=2#48879802) |