I hate my 4070 for only having 12, but the 4080 is a giant pile of shit that only gives you 4 more gigabytes. The 5070 is tiny, takes up on space, and needs only one power connector. The only upgrade from the 4070 that made any economic sense was the 4090, and those cards are yuge and have faulty power connectors that melt. Nvidia won't do shit about it and some of the graphics card manufacturers are even worse.
The only reason I bought a 4070 was because of the low power draw and the fact that it will work fine in older pcie slots. This allows me to run it as either a primary or secondary GPU and pass it through to a container running local LLMs through a web ui. It doesn't really matter if I use it as primary since the system is headless anyway.
Secondary is a cheap af Intel GPU with all kinds of hardware encoding, and that be dedicated to another container running handbrake. If ur using an Intel CPU with integrated graphics, you actually have a third GPU you can use to run a monitor in a pinch.
It sucks ass that I'm limited to 12gb, but I'm finna fix that real soon by switching to Apple. In the meantime, any Nvidia GPU with more than 12gb is still going to be an energy HOG. This series of GPUs only makes that problem worse, if anything.
Date: January 6th, 2025 10:59 PM Author: mind-boggling area
Right now? there are none available. The best I'm seeing is a 4090 for $3000 or a 3090 for $1500. MicroCenter used to have an awesome deal on refurbished 3090s for about $700/each. I wish I cleaned out their supply back then.
I forgot about the 3090s. Seems like the only ones floating around today are stepped on af. Chinks slap the old chips onto off-brand PCBs and sell them as fake brand name cards. This is so common these days it's out of control.