The most prestigious law school admissions discussion board in the world.
|
 |
 
|
My Whatsapp group with BIGTECH bros is >> xo these days
Poast new message in this thread
Date: April 28th, 2026 11:49 PM Author: Onyx Theatre Pocket Flask It's invite only and everything is AI related and it's 180 (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49850251) |
Date: April 28th, 2026 11:50 PM Author: Onyx Theatre Pocket Flask Some CEOdood just poasted this
"so I ran some more math, and newer Xeon machines (Grand Rapids etc) with 1.5TB of RAM (MRDIMM - more throughput than DDR5) can deal with more concurrent users on MoE models like Kimi 2.6 and GLM 5.1 with longer context windows (>200k) though with reduced tok/sec/user for about 1/4-1/5 of the price of B200x8 or 2x(H100x8).
That means that some of my "batching" theories, assuming I can prove dedicated kernels on AMX and AVX512, means that headless coding agents that don't have a human following them, that runs in the background can be executed on said models in a MUCH cheaper way.
running a first test on Grand Rapids CPUs (only managed to get 16 CPUs - GCP won't give me quota).
You would think with the amount of models being downloaded, most clouds should benefit from a proxy for those the same way they do for linux packages..."
|
 |
Date: April 28th, 2026 11:52 PM Author: maroon background story yarmulke CEO bragging about doing setup steps on the max settings
wtf is Grand Rapids Michigan CPU |
|
Date: April 28th, 2026 11:50 PM Author: maroon background story yarmulke You posted this exact thread last week
Provide updated screenshots or gtfo |
|
Date: April 29th, 2026 12:48 AM Author: Onyx Theatre Pocket Flask I can't tell what these people are saying a lot of the time and redacting shit is tedious
https://i.imgur.com/F6Nwlsl.png |
|
Date: April 29th, 2026 12:06 AM Author: vigorous sanctuary Sounds douchey but potentially interesting. More douchey tho. (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49850281) |
|
Date: April 29th, 2026 12:32 AM Author: Onyx Theatre Pocket Flask Speaking as a VC, I will tell you that I hope you aren’t using VC money to buy off brand GPUs. We wall know that the most valuable AI startups use NVIDIA(tm). I have a special relationship with them, actually so we can get you to the front of the queue. (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49850306) |
|
Date: April 29th, 2026 12:37 AM Author: Onyx Theatre Pocket Flask i have a couple of "code parser in the sampling loop" + "code parser controlled KV cache endpoints" experiments that are pretty promising, also in the context of CPU inference. I don't really have time nor knowledge to properly explore them, but if someone is interested here, I feel this can unlock some pretty interesting idea to keep smaller models on track and just in general exploit the massive power that comes with controlling the inference end to end. I did a couple of experiments and my ideas do work (very messy repo: https://github.com/REDACTED), if someone is interested in a chat. (I think small local models + custom inference harness + tools optimized on trace analysis / GEPA-like/autoresearch loops are potentially competitive with much much much larger models for a fair amount of the "lower level but token consuming" tasks in the context of coding. roughly the idea is that if you have a AST parser + compiler/interpreter in the loop, you can do the following things: - flag syntax errors (obv) + easily gaslight the model into thinking it wrote them correctly - autocomplete a set of patterns to save on inference compute by just prefilling the completion - rewind the cache / inference pointer (not sure what the proper name is) to semantically meaningful points (say, function starts) - insert // docstrings that help the model along for trickier APIs - for certain types of functions / unit tests, run the unit tests right after the code was generated, parallelizing with inference, and you can easily rewind - on CPU, where you are memory constrained (I guess it's the same on GPUs but I haven't done GPGPU stuff since 2012), you can run speculative loops / split the code writing across multiple cores and then merge
All of these things mostly benefit from it being tailored to your own codebase / being RL-optimized to your codebase through transcript analysis, so model providers who are more reliant on batching similar jobloads and often are "too fast" for this kind of trickery won't really benefit from it. |
|
Date: April 29th, 2026 12:40 AM Author: Onyx Theatre Pocket Flask At the NVIDIA conf last year, I ran into a liquid cooled server rack vendor I have seen since I was a gothling and set up sun gear in datacenters to pay for fangs and leather jackets. I said “I thought you retired”. He said “no, we’re doing it all one last time. this time for real money”. (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49850314) |
|
Date: April 29th, 2026 1:21 AM Author: Onyx Theatre Pocket Flask https://i.imgur.com/IIch0AM.png (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49850376) |
|
Date: April 29th, 2026 1:38 AM Author: cocky wagecucks Whoa, nice! (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49850406) |
|
Date: May 3rd, 2026 10:00 PM Author: Onyx Theatre Pocket Flask https://i.imgur.com/HMesAbG.png (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49862913) |
|
Date: May 13th, 2026 11:38 PM Author: vigorous sanctuary INSUFFERABLE (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49884675) |
|
Date: May 13th, 2026 11:22 PM Author: Onyx Theatre Pocket Flask 🤣🤣🤣https://www.hiddendoor.co/world/interview-gauntlet-883562 (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49884664) |
|
Date: May 14th, 2026 8:57 AM Author: dark theater stage foreskin get me an invite (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49884939) |
|
Date: May 14th, 2026 9:27 AM Author: Chest-beating selfie den *laughing at the absurdity of this entire premise* (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49884988) |
|
Date: May 14th, 2026 9:40 AM Author: Talented Personal Credit Line Newt JJC? Is that you lil bro? Welcum back (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49885027) |
|
Date: May 26th, 2026 11:44 PM Author: Onyx Theatre Pocket Flask https://i.imgur.com/XhXzJwi.jpeg (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49903462) |
|
Date: May 26th, 2026 11:48 PM Author: Onyx Theatre Pocket Flask https://rosmine.ai/2026/05/18/fixing-llm-writing-with-distribution-fine-tuning/ (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49903484) |
|
Date: May 28th, 2026 7:07 PM Author: Onyx Theatre Pocket Flask Of shit this got taken down!
Here's a backup
Apparently it was proprietary and they got a takedown notice |
|
Date: June 17th, 2026 10:20 PM Author: Microsoft Execution Containers https://i.imgur.com/JBMdgJz.png (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49945557) |
|
Date: June 17th, 2026 11:21 PM Author: Pope Leo XXX WTF is this thread even talking about
Everyone in your "bros" chat needs to be publicly spanked on live TV |
|
Date: June 17th, 2026 11:39 PM Author: Microsoft Execution Containers https://i.imgur.com/q6WbBE4.png (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49945662) |
|
Date: June 18th, 2026 11:17 PM Author: Pope Leo XXX (sup Brady mk 2) (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49947759) |
|
Date: June 18th, 2026 11:20 PM Author: Juan Eighty cq about the wine (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49947781) |
|
Date: June 17th, 2026 11:42 PM Author: Shema Yisrael engineers have a really faggy self masturbatory culture resulting from the zirp payouts in the 2010s. they arent messianic. theyll reveal themselves poor at understanding ai's limitations bc they see it as a means to Ascend (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49945663) |
|
Date: June 17th, 2026 11:44 PM Author: Microsoft Execution Containers yeah they talk about ZIRP sometimes (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49945664) |
|
Date: June 18th, 2026 12:24 AM Author: Microsoft Execution Containers https://i.imgur.com/LPn3HPy.jpeg (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49945688) |
|
Date: June 18th, 2026 11:18 PM Author: Frutiger Aero sounds chill. dare i say fratty. (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2...#49947765) |