\
  The most prestigious law school admissions discussion board in the world.
BackRefresh Options Favorite

we can't ban open source AI so we'll remove the ability to run it locally

...
khaki electric rigpig
  12/17/25
are you talking about the RAM shortage
French Vivacious Church Building
  12/17/25
GPUs, RAM, SSDs
khaki electric rigpig
  12/17/25
it's over
buck-toothed violet native trump supporter
  12/17/25
...
house-broken indian lodge scourge upon the earth
  12/17/25
if i flicked nickels at your deformed oblong skull what kind...
white stimulating crackhouse foreskin
  12/17/25
why don't you "ping" your pencil neck you weird li...
khaki electric rigpig
  12/17/25
my neck is huge faggot how bout i rape you with it? show arm...
white stimulating crackhouse foreskin
  12/17/25
lol what a fag
khaki electric rigpig
  12/17/25
the commercial hardware rugpull happening right now is extre...
buck-toothed violet native trump supporter
  12/17/25
...
khaki electric rigpig
  12/17/25
seriously this shit is very concerning i thought this wou...
buck-toothed violet native trump supporter
  12/17/25
NSAM was right
khaki electric rigpig
  12/17/25
name a time NSAM was wrong, chud
Mind-boggling Bistre Piazza
  12/17/25
...
khaki electric rigpig
  12/17/25
I’m on full fucking tilt rn
house-broken indian lodge scourge upon the earth
  12/17/25
This is exactly why I set up a local lm studio, ollama and m...
Mind-boggling Bistre Piazza
  12/17/25
18000
khaki electric rigpig
  12/17/25
how's the performance?
disrespectful vengeful tanning salon
  12/17/25
completely fine on 30B, shit after
Mind-boggling Bistre Piazza
  12/17/25
...
khaki electric rigpig
  12/17/25
Is it a Mac? How many GBs of ram do you use?
trip burgundy casino
  12/17/25
im on a 5090 w a 9950X3D but im currently in the process of ...
Mind-boggling Bistre Piazza
  12/17/25
how tf do you get a bunch of gpus for free
buck-toothed violet native trump supporter
  12/17/25
Large company upgrading and throwing them away and I just to...
Mind-boggling Bistre Piazza
  12/17/25
i literally just found out about Big-Tiger-Gemma and its by ...
Mind-boggling Bistre Piazza
  12/17/25
how large is the database? how does this work? facebook scra...
disrespectful vengeful tanning salon
  12/17/25
here are the normie instructions for low iq mos https://l...
Mind-boggling Bistre Piazza
  12/17/25
i poast on a laptop. i'm just curious.
disrespectful vengeful tanning salon
  12/17/25
...
buck-toothed violet native trump supporter
  12/17/25
LM Studio pushes glitchy, unoptimized models. Ollama curates...
Scarlet Step-uncle's House
  12/17/25
thanks NSAM, if you read the first line you'd see "h...
Mind-boggling Bistre Piazza
  12/17/25
also they all pull them from huggingface so no clue wtf idio...
Mind-boggling Bistre Piazza
  12/17/25
thought this would be NSAM
cocky striped hyena persian
  12/17/25
...
khaki electric rigpig
  12/17/25
...
unhinged main people brunch
  12/17/25
...
Multi-colored Box Office Associate
  12/17/25
this whole thread sounds like nsam talking to himself.
saffron internal respiration
  12/17/25
...
house-broken indian lodge scourge upon the earth
  12/17/25
...
fragrant magenta depressive
  12/17/25
...
khaki electric rigpig
  12/17/25
i agree this is some really concerning shit ricky i'm not ev...
buck-toothed violet native trump supporter
  12/17/25
...
house-broken indian lodge scourge upon the earth
  12/17/25
...
khaki electric rigpig
  12/17/25
...
buck-toothed violet native trump supporter
  12/17/25
...
unhinged main people brunch
  12/17/25
I was lucky I built my 5070 Ti, 48gb RAM build recently but ...
French Vivacious Church Building
  12/17/25
...
house-broken indian lodge scourge upon the earth
  12/17/25
You need 24gb VRAM to do inference. 16gb isn't enough. Howev...
Scarlet Step-uncle's House
  12/17/25
I waited on my RTX pro 6000 and now I'm pissed
fragrant magenta depressive
  12/17/25


Poast new message in this thread



Reply Favorite

Date: December 17th, 2025 9:16 AM
Author: khaki electric rigpig



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516104)



Reply Favorite

Date: December 17th, 2025 1:26 PM
Author: French Vivacious Church Building

are you talking about the RAM shortage

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516818)



Reply Favorite

Date: December 17th, 2025 1:31 PM
Author: khaki electric rigpig

GPUs, RAM, SSDs



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516836)



Reply Favorite

Date: December 17th, 2025 1:32 PM
Author: buck-toothed violet native trump supporter

it's over

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516841)



Reply Favorite

Date: December 17th, 2025 1:36 PM
Author: house-broken indian lodge scourge upon the earth



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516856)



Reply Favorite

Date: December 17th, 2025 9:22 AM
Author: white stimulating crackhouse foreskin

if i flicked nickels at your deformed oblong skull what kind of noise would it make

like a "ping" or would it be more of a squelch

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516121)



Reply Favorite

Date: December 17th, 2025 9:25 AM
Author: khaki electric rigpig

why don't you "ping" your pencil neck you weird little freak



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516133)



Reply Favorite

Date: December 17th, 2025 9:40 AM
Author: white stimulating crackhouse foreskin

my neck is huge faggot how bout i rape you with it? show armpit

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516174)



Reply Favorite

Date: December 17th, 2025 9:52 AM
Author: khaki electric rigpig

lol what a fag

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516208)



Reply Favorite

Date: December 17th, 2025 9:23 AM
Author: buck-toothed violet native trump supporter

the commercial hardware rugpull happening right now is extremely radicalizing

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516126)



Reply Favorite

Date: December 17th, 2025 9:24 AM
Author: khaki electric rigpig



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516127)



Reply Favorite

Date: December 17th, 2025 9:44 AM
Author: buck-toothed violet native trump supporter

seriously this shit is very concerning

i thought this would happen at some point in the future but it's happening already. things are accelerating very fast

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516186)



Reply Favorite

Date: December 17th, 2025 11:25 AM
Author: khaki electric rigpig

NSAM was right

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516456)



Reply Favorite

Date: December 17th, 2025 11:29 AM
Author: Mind-boggling Bistre Piazza

name a time NSAM was wrong, chud

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516465)



Reply Favorite

Date: December 17th, 2025 11:33 AM
Author: khaki electric rigpig



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516483)



Reply Favorite

Date: December 17th, 2025 1:09 PM
Author: house-broken indian lodge scourge upon the earth

I’m on full fucking tilt rn

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516748)



Reply Favorite

Date: December 17th, 2025 9:27 AM
Author: Mind-boggling Bistre Piazza

This is exactly why I set up a local lm studio, ollama and my own custom build that uses publicly available llms

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516143)



Reply Favorite

Date: December 17th, 2025 9:28 AM
Author: khaki electric rigpig

18000

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516147)



Reply Favorite

Date: December 17th, 2025 9:41 AM
Author: disrespectful vengeful tanning salon

how's the performance?

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516178)



Reply Favorite

Date: December 17th, 2025 9:45 AM
Author: Mind-boggling Bistre Piazza

completely fine on 30B, shit after

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516189)



Reply Favorite

Date: December 17th, 2025 9:52 AM
Author: khaki electric rigpig



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516210)



Reply Favorite

Date: December 17th, 2025 11:58 AM
Author: trip burgundy casino

Is it a Mac? How many GBs of ram do you use?

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516550)



Reply Favorite

Date: December 17th, 2025 12:04 PM
Author: Mind-boggling Bistre Piazza

im on a 5090 w a 9950X3D but im currently in the process of making a pretty powerful frankenstein machine with a bunch of gpus i got free

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516564)



Reply Favorite

Date: December 17th, 2025 12:06 PM
Author: buck-toothed violet native trump supporter

how tf do you get a bunch of gpus for free

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516570)



Reply Favorite

Date: December 17th, 2025 12:10 PM
Author: Mind-boggling Bistre Piazza

Large company upgrading and throwing them away and I just took them. All are pretty powerful on their own.

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516583)



Reply Favorite

Date: December 17th, 2025 11:57 AM
Author: Mind-boggling Bistre Piazza

i literally just found out about Big-Tiger-Gemma and its by far the best unchained/uncensored LLM ive found yet

holy shit this thing just helped me remove all shadows in an online game and its completely undetectable

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516548)



Reply Favorite

Date: December 17th, 2025 1:08 PM
Author: disrespectful vengeful tanning salon

how large is the database? how does this work? facebook scraped data legally and illegally, transformed them into matrices, and now they're available to anyone?

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516746)



Reply Favorite

Date: December 17th, 2025 1:13 PM
Author: Mind-boggling Bistre Piazza

here are the normie instructions for low iq mos

https://lmstudio.ai/

+

https://huggingface.co/TheDrummer/Big-Tiger-Gemma-27B-v1

also if you cant answer these questions on your own you probably dont even have a strong enough setup to begin with

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516771)



Reply Favorite

Date: December 17th, 2025 1:20 PM
Author: disrespectful vengeful tanning salon

i poast on a laptop. i'm just curious.

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516803)



Reply Favorite

Date: December 17th, 2025 1:29 PM
Author: buck-toothed violet native trump supporter



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516824)



Reply Favorite

Date: December 17th, 2025 1:38 PM
Author: Scarlet Step-uncle's House

LM Studio pushes glitchy, unoptimized models. Ollama curates so you only get optimized models. You can connect to an Ollama server with OpenWebUI or AnythingLLM and do whatever

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516871)



Reply Favorite

Date: December 17th, 2025 1:39 PM
Author: Mind-boggling Bistre Piazza

thanks NSAM, if you read the first line you'd see

"here are the normie instructions for low iq mos"

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516880)



Reply Favorite

Date: December 17th, 2025 1:41 PM
Author: Mind-boggling Bistre Piazza

also they all pull them from huggingface so no clue wtf idiocy ur talking about

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516888)



Reply Favorite

Date: December 17th, 2025 9:40 AM
Author: cocky striped hyena persian

thought this would be NSAM

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516175)



Reply Favorite

Date: December 17th, 2025 9:49 AM
Author: khaki electric rigpig



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516200)



Reply Favorite

Date: December 17th, 2025 9:58 AM
Author: unhinged main people brunch



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516223)



Reply Favorite

Date: December 17th, 2025 9:58 AM
Author: Multi-colored Box Office Associate



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516226)



Reply Favorite

Date: December 17th, 2025 1:30 PM
Author: saffron internal respiration

this whole thread sounds like nsam talking to himself.

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516830)



Reply Favorite

Date: December 17th, 2025 1:11 PM
Author: house-broken indian lodge scourge upon the earth



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516759)



Reply Favorite

Date: December 17th, 2025 1:11 PM
Author: fragrant magenta depressive



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516762)



Reply Favorite

Date: December 17th, 2025 1:12 PM
Author: khaki electric rigpig



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516764)



Reply Favorite

Date: December 17th, 2025 1:12 PM
Author: buck-toothed violet native trump supporter

i agree this is some really concerning shit ricky i'm not even playing around

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516765)



Reply Favorite

Date: December 17th, 2025 1:16 PM
Author: house-broken indian lodge scourge upon the earth



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516788)



Reply Favorite

Date: December 17th, 2025 1:17 PM
Author: khaki electric rigpig



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516792)



Reply Favorite

Date: December 17th, 2025 1:25 PM
Author: buck-toothed violet native trump supporter



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516814)



Reply Favorite

Date: December 17th, 2025 1:29 PM
Author: unhinged main people brunch



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516825)



Reply Favorite

Date: December 17th, 2025 1:34 PM
Author: French Vivacious Church Building

I was lucky I built my 5070 Ti, 48gb RAM build recently but that is pretty weak for LLMs afaik

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516849)



Reply Favorite

Date: December 17th, 2025 1:35 PM
Author: house-broken indian lodge scourge upon the earth



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516851)



Reply Favorite

Date: December 17th, 2025 7:49 PM
Author: Scarlet Step-uncle's House

You need 24gb VRAM to do inference. 16gb isn't enough. However, unless you are coding there's little reason to go above 24gb. The reason coding can use more VRAM is because going through each iteration of the code generates long context windows. If you run out of context window the AI will forget what it was doing earlier. This is also why you can't run 15gb models on 16gb of VRAM. The context windows spills into system RAM and slows everything down

48gb VRAM lets you do more with image and video generation, but will not give you measurable gains in inference. You can put bigger models on the system but they probably won't give you better results.

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49517900)



Reply Favorite

Date: December 17th, 2025 1:36 PM
Author: fragrant magenta depressive

I waited on my RTX pro 6000 and now I'm pissed

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2)#49516855)