The most prestigious law school admissions discussion board in the world.
|
 |
 
|
llama.cpp is the only way to go right now. Fuck Ollama
| Jared Baumeister | 02/21/26 |
Poast new message in this thread
Date: February 21st, 2026 12:17 AM Author: Jared Baumeister Getting 153t/s on 70b models right now. With Ollama I was lucky to hit 3t/s (http://www.autoadmit.com/thread.php?thread_id=5836862&forum_id=2\u0026mark_id=5310908#49684208) |