\
  The most prestigious law school admissions discussion board in the world.
BackRefresh Options Favorite

So can any of you NERDS explain how you "train" a local AI? You just buy expensi

Expensive ass graphics card and then what? Download some shi...
average/ordinary/typical citizen/person
  02/21/26
no its more complicated than that. you don't do full trainin...
robot daddy
  02/21/26
...
fy_iceworld2k Nationalism
  02/21/26
Use Axolotl for training. Train a qlora in 8bit and let your...
cr friend
  02/21/26
I have never used that. Isn't it supposed to be config file ...
robot daddy
  02/21/26


Poast new message in this thread



Reply Favorite

Date: February 21st, 2026 10:07 PM
Author: average/ordinary/typical citizen/person

Expensive ass graphics card and then what? Download some shit and it starts training AI?

(http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2\u0026mark_id=5310796#49685993)



Reply Favorite

Date: February 21st, 2026 10:20 PM
Author: robot daddy

no its more complicated than that. you don't do full training yourself at this point. like pre-training + training across billions of tokens from scratch. that's something frontier labs do it takes distributed training tons of gpu hours millions of dollars. you can train your own small models. but most of what peole do today is fine-tune big models. I wouldn't do the training locally either. Those GPUs aren't optimized for that you use a cloud server gpu, you pay for the VM, deploy it and they charge you per hour when its running. Train it on the cloud then basically you extract the base model directory + weights to your local system. Depends how big and complex the system is whether your local computer can run it. I don't know as much about that part I have never ran anything directly on a local machine. I can tell you how to set up cloud servers, how set up a cli runner on it that plugs in to hugging face transformers etc, but I don't know exactly how to import it locally it would take actual experimentation for me to figure it out

(http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2\u0026mark_id=5310796#49686010)



Reply Favorite

Date: February 21st, 2026 11:04 PM
Author: fy_iceworld2k Nationalism



(http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2\u0026mark_id=5310796#49686073)



Reply Favorite

Date: February 21st, 2026 10:20 PM
Author: cr friend

Use Axolotl for training. Train a qlora in 8bit and let your dataset be formatted as plaintext, you also need to establish a format

(http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2\u0026mark_id=5310796#49686012)



Reply Favorite

Date: February 21st, 2026 10:31 PM
Author: robot daddy

I have never used that. Isn't it supposed to be config file based controls, no need to write a runner file w python, torch etc? Is it good? Or are there limitations?

(http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2\u0026mark_id=5310796#49686022)