Can Used NVIDIA RTX 5090 32GB run Llama, Qwen & DeepSeek? 380 models that fit
380 of the 493 models in the Spanvero catalog fit Used NVIDIA RTX 5090 32GB's 32 GB VRAM (at a sensible quant, 16k context). For each: run it locally ($0 compute + electricity), rent an equivalent GPU ($0 markup, as of 2026-07-09), or pay per-token via your own API key (as of 2026-08-17).
Three honest ways to run each model on Used NVIDIA RTX 5090 32GB
Run it locally: $0 in compute — you pay only electricity (~575 W under load on this card). Local is real money, never a fake "$0".
Rent an equivalent GPU: from a $0-markup vendor rate (as of 2026-07-09) — you rent on your own account and pay the vendor directly; we never resell compute.
Skip the box: run the same model through your own API key, paying per million tokens (prices as of 2026-08-17).
What fits Used NVIDIA RTX 5090 32GB (32 GB VRAM)
380 of the 493 notable models in the Spanvero catalog fit Used NVIDIA RTX 5090 32GB at a sensible quant (context capped at 16k for the estimate). Most capable first:
Phi 3.5 MoE instruct (microsoft, 41.9B) — needs ~31 GB at Q4_K_M: run it locally for $0 compute + ~$0.7966/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.44/1M via your own API key (size estimate).
Karnak 40B v1.0 (Applied-Innovation-Center, 40.7B) — needs ~29 GB at Q4_K_M: run it locally for $0 compute + ~$0.7783/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.43/1M via your own API key (size estimate).
Seed OSS 36B Instruct (ByteDance-Seed, 36.2B) — needs ~27 GB at Q4_K_M: run it locally for $0 compute + ~$0.7086/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.39/1M via your own API key (size estimate).
Hermes 4.3 36B (NousResearch, 36.2B) — needs ~27 GB at Q4_K_M: run it locally for $0 compute + ~$0.7086/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.39/1M via your own API key (size estimate).
Yi-1.5-34B-Chat (01.AI, 34.4B) — needs ~25 GB at Q4_K_M: run it locally for $0 compute + ~$0.6803/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.38/1M via your own API key (size estimate).
Laguna XS.2 (poolside, 33.4B) — needs ~24 GB at Q4_K_M: run it locally for $0 compute + ~$0.6644/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.15/1M via your own API key (last-known).
Laguna XS 2.1 NVFP4 (poolside, 33.4B) — needs ~24 GB at Q4_K_M: run it locally for $0 compute + ~$0.6644/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.37/1M via your own API key (size estimate).
Laguna XS 2.1 (poolside, 33.4B) — needs ~24 GB at Q4_K_M: run it locally for $0 compute + ~$0.6644/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.09/1M via your own API key.
Qwen3-32B (Alibaba, 32.8B) — needs ~25 GB at Q4_K_M: run it locally for $0 compute + ~$0.6549/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.18/1M via your own API key.
Qwen2.5 32B Instruct (Qwen, 32.8B) — needs ~27 GB at Q4_K_M: run it locally for $0 compute + ~$0.6549/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
cogito v1 preview qwen 32B (deepcogito, 32.8B) — needs ~27 GB at Q4_K_M: run it locally for $0 compute + ~$0.6549/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
Qwen2.5 32B (Qwen, 32.8B) — needs ~27 GB at Q4_K_M: run it locally for $0 compute + ~$0.6549/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
QwQ 32B (Qwen, 32.8B) — needs ~27 GB at Q4_K_M: run it locally for $0 compute + ~$0.6549/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
DeepSeek-R1-Distill-Qwen-32B (DeepSeek, 32.5B) — needs ~27 GB at Q4_K_M: run it locally for $0 compute + ~$0.6501/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
granite 4.0 h small (ibm-granite, 32.2B) — needs ~25 GB at Q4_K_M: run it locally for $0 compute + ~$0.6453/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
Olmo 3 1125 32B (allenai, 32.2B) — needs ~26 GB at Q4_K_M: run it locally for $0 compute + ~$0.6453/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
sarvam 30b (sarvamai, 32.2B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$0.6453/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
llm jp 4 32b a3b thinking (llm-jp, 32.1B) — needs ~23 GB at Q4_K_M: run it locally for $0 compute + ~$0.6437/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
Qwen2.5-Coder 32B Instruct (Alibaba, 32B) — needs ~25 GB at Q4_K_M: run it locally for $0 compute + ~$0.6421/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.83/1M via your own API key.
NVIDIA Nemotron 3 Nano 30B A3B BF16 (nvidia, 31.6B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$0.6356/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.35/1M via your own API key (size estimate).
The honest cost of owning Used NVIDIA RTX 5090 32GB
The full ownership math for this card — its dated street price, 3-year amortization, electricity, and the own-vs-rent break-evens — lives on the dedicated NVIDIA RTX 5090 32GB GPU page (linked under "Keep exploring" below), so those numbers are published once, in one place.
Too big for Used NVIDIA RTX 5090 32GB — rent or use an API instead
These need more than the 32 GB VRAM on this card. Closest first — you can still run them on a rented GPU ($0 markup) or via your own API key:
NVIDIA Nemotron Labs 3 Puzzle 75B A9B NVFP4 (nvidia, 44.5B) — needs ~33 GB; rent 4× NVIDIA RTX 3060 12GB from $0.24/hr, or ~$0.46/1M via your own API key (size estimate).
OTel 2.0 LLM 31B IT (farbodtavakkoli, 32.1B) — needs ~33 GB; rent 4× NVIDIA RTX 3060 12GB from $0.24/hr, or ~$0.36/1M via your own API key (size estimate).
droplychee 1.0 27b (droplychee, 27.8B) — needs ~33 GB; rent 4× NVIDIA RTX 3060 12GB from $0.24/hr, or ~$0.32/1M via your own API key (size estimate).
Mixtral 8x7B Instruct (Mistral AI, 46.7B) — needs ~34 GB; rent 4× NVIDIA RTX 3060 12GB from $0.24/hr, or ~$0.24/1M via your own API key (last-known).
Kimi Linear 48B A3B Instruct (moonshotai, 49.1B) — needs ~36 GB; rent 4× NVIDIA RTX 3060 12GB from $0.24/hr, or ~$0.49/1M via your own API key (size estimate).
Nemotron 3 Nano 30B A3B (unsloth, 31.6B) — needs ~37 GB; rent 4× NVIDIA RTX 3060 12GB from $0.24/hr, or ~$0.35/1M via your own API key (size estimate).
A short email of real AI price moves, straight from the daily log — no hype. We're collecting the list now; the first issue goes out when it opens. Unsubscribe with one click.