\
  The most prestigious law school admissions discussion board in the world.
BackRefresh Options Favorite

This is why your RTX 6000 is busted

Turns out I only need 48gb of VRAM to run agentic shit on a ...
indigo aromatic menage jap
  04/04/26
https://imgbb.com/bRzRZM9Q
cyan excitant locus mental disorder
  04/04/26
...
Floppy effete boiling water
  04/04/26


Poast new message in this thread



Reply Favorite

Date: April 4th, 2026 9:17 PM
Author: indigo aromatic menage jap

Turns out I only need 48gb of VRAM to run agentic shit on a server with 96gb distributed over 5 GPUs. That means I got 48gb of leftover VRAM I can use to run any random shit like nomic-embed-text or GLM-4.7. If I use all five GPUs I'll get 66% of the effective memory bandwidth of a RTX 6000, with some added latency from the PCIe interchanges, but right now I'm getting nearly twice the performance of an RTX 6000 because 90% of my work gets done on a 5090. RTX 6000 would feel slow as fuck for anything I might actually do with it

https://i.imgur.com/WRoXZiF.jpeg

(http://www.autoadmit.com/thread.php?thread_id=5853625&forum_id=2...id#49794381)



Reply Favorite

Date: April 4th, 2026 9:35 PM
Author: cyan excitant locus mental disorder

https://imgbb.com/bRzRZM9Q

(http://www.autoadmit.com/thread.php?thread_id=5853625&forum_id=2...id#49794433)



Reply Favorite

Date: April 4th, 2026 9:38 PM
Author: Floppy effete boiling water



(http://www.autoadmit.com/thread.php?thread_id=5853625&forum_id=2...id#49794443)