Can Used NVIDIA RTX 5090 32GB run Llama, Qwen & DeepSeek? 311 models that fit

311 of the 396 models in the Spanvero catalog fit Used NVIDIA RTX 5090 32GB's 32 GB VRAM (at a sensible quant, 16k context). For each: run it locally ($0 compute + electricity), rent an equivalent GPU ($0 markup, as of 2026-07-02), or pay per-token via your own API key (as of 2026-07-06).

Three honest ways to run each model on Used NVIDIA RTX 5090 32GB

• Run it locally: $0 in compute — you pay only electricity (~575 W under load on this card). Local is real money, never a fake "$0".
• Rent an equivalent GPU: from a $0-markup vendor rate (as of 2026-07-02) — you rent on your own account and pay the vendor directly; we never resell compute.
• Skip the box: run the same model through your own API key, paying per million tokens (prices as of 2026-07-06).

What fits Used NVIDIA RTX 5090 32GB (32 GB VRAM)

• 311 of the 396 notable models in the Spanvero catalog fit Used NVIDIA RTX 5090 32GB at a sensible quant (context capped at 16k for the estimate). Most capable first:
• Phi 3.5 MoE instruct (microsoft, 41.9B) — needs ~31 GB at Q4_K_M: run it locally for $0 compute + ~$0.7966/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.44/1M via your own API key (size estimate).
• Karnak 40B v1.0 (Applied-Innovation-Center, 40.7B) — needs ~29 GB at Q4_K_M: run it locally for $0 compute + ~$0.7783/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.43/1M via your own API key (size estimate).
• Seed OSS 36B Instruct (ByteDance-Seed, 36.2B) — needs ~27 GB at Q4_K_M: run it locally for $0 compute + ~$0.7086/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.39/1M via your own API key (size estimate).
• Hermes 4.3 36B (NousResearch, 36.2B) — needs ~27 GB at Q4_K_M: run it locally for $0 compute + ~$0.7086/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.39/1M via your own API key (size estimate).
• Yi-1.5-34B-Chat (01.AI, 34.4B) — needs ~25 GB at Q4_K_M: run it locally for $0 compute + ~$0.6803/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.38/1M via your own API key (size estimate).
• Laguna XS.2 (poolside, 33.4B) — needs ~24 GB at Q4_K_M: run it locally for $0 compute + ~$0.6644/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.15/1M via your own API key.
• Qwen3-32B (Alibaba, 32.8B) — needs ~25 GB at Q4_K_M: run it locally for $0 compute + ~$0.6549/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.18/1M via your own API key.
• Qwen2.5 32B Instruct (Qwen, 32.8B) — needs ~27 GB at Q4_K_M: run it locally for $0 compute + ~$0.6549/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
• cogito v1 preview qwen 32B (deepcogito, 32.8B) — needs ~27 GB at Q4_K_M: run it locally for $0 compute + ~$0.6549/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
• QwQ 32B (Qwen, 32.8B) — needs ~27 GB at Q4_K_M: run it locally for $0 compute + ~$0.6549/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
• DeepSeek-R1-Distill-Qwen-32B (DeepSeek, 32.5B) — needs ~27 GB at Q4_K_M: run it locally for $0 compute + ~$0.6501/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
• granite 4.0 h small (ibm-granite, 32.2B) — needs ~25 GB at Q4_K_M: run it locally for $0 compute + ~$0.6453/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
• sarvam 30b (sarvamai, 32.2B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$0.6453/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
• llm jp 4 32b a3b thinking (llm-jp, 32.1B) — needs ~23 GB at Q4_K_M: run it locally for $0 compute + ~$0.6437/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
• Qwen2.5-Coder 32B Instruct (Alibaba, 32B) — needs ~25 GB at Q4_K_M: run it locally for $0 compute + ~$0.6421/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.83/1M via your own API key.
• NVIDIA Nemotron 3 Nano 30B A3B BF16 (nvidia, 31.6B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$0.6356/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.35/1M via your own API key (size estimate).
• Nemotron Cascade 2 30B A3B (nvidia, 31.6B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$0.6356/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.35/1M via your own API key (size estimate).
• GLM 4.7 Flash (zai-org, 31.2B) — needs ~28 GB at Q4_K_M: run it locally for $0 compute + ~$0.6292/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.23/1M via your own API key.
• GLM 4.7 Flash (unsloth, 31.2B) — needs ~28 GB at Q4_K_M: run it locally for $0 compute + ~$0.6292/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.35/1M via your own API key (size estimate).
• Qwen3 30B A3B (Qwen, 30.5B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$0.6179/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.31/1M via your own API key.

• Phi 3.5 MoE instruct — full cost breakdown
• Karnak 40B v1.0 — full cost breakdown
• Seed OSS 36B Instruct — full cost breakdown
• Hermes 4.3 36B — full cost breakdown
• Yi-1.5-34B-Chat — full cost breakdown
• Laguna XS.2 — full cost breakdown
• Qwen3-32B — full cost breakdown
• Qwen2.5 32B Instruct — full cost breakdown
• cogito v1 preview qwen 32B — full cost breakdown
• QwQ 32B — full cost breakdown
• DeepSeek-R1-Distill-Qwen-32B — full cost breakdown
• granite 4.0 h small — full cost breakdown
• sarvam 30b — full cost breakdown
• llm jp 4 32b a3b thinking — full cost breakdown
• Qwen2.5-Coder 32B Instruct — full cost breakdown
• NVIDIA Nemotron 3 Nano 30B A3B BF16 — full cost breakdown
• Nemotron Cascade 2 30B A3B — full cost breakdown
• GLM 4.7 Flash — full cost breakdown
• GLM 4.7 Flash — full cost breakdown
• Qwen3 30B A3B — full cost breakdown

The honest cost of owning Used NVIDIA RTX 5090 32GB

• The full ownership math for this card — its dated street price, 3-year amortization, electricity, and the own-vs-rent break-evens — lives on the dedicated NVIDIA RTX 5090 32GB GPU page (linked under "Keep exploring" below), so those numbers are published once, in one place.

Too big for Used NVIDIA RTX 5090 32GB — rent or use an API instead

• These need more than the 32 GB VRAM on this card. Closest first — you can still run them on a rented GPU ($0 markup) or via your own API key:
• Mixtral 8x7B Instruct (Mistral AI, 46.7B) — needs ~34 GB; rent 4× NVIDIA RTX 3060 12GB from $0.24/hr, or ~$0.24/1M via your own API key (last-known).
• Kimi Linear 48B A3B Instruct (moonshotai, 49.1B) — needs ~36 GB; rent 4× NVIDIA RTX 3060 12GB from $0.24/hr, or ~$0.49/1M via your own API key (size estimate).
• Nemotron 3 Nano 30B A3B (unsloth, 31.6B) — needs ~37 GB; rent 4× NVIDIA RTX 3060 12GB from $0.24/hr, or ~$0.35/1M via your own API key (size estimate).
• NVIDIA Nemotron 3 Nano 30B A3B Base BF16 (nvidia, 31.6B) — needs ~37 GB; rent 4× NVIDIA RTX 3060 12GB from $0.24/hr, or ~$0.35/1M via your own API key (size estimate).
• gemma 4 31B it NVFP4 turbo (LilaRest, 32.5B) — needs ~38 GB; rent 4× NVIDIA RTX 3060 12GB from $0.24/hr, or ~$0.36/1M via your own API key (size estimate).
• HyperCLOVAX SEED Think 32B (naver-hyperclovax, 33.3B) — needs ~39 GB; rent 4× NVIDIA RTX 3060 12GB from $0.24/hr, or ~$0.37/1M via your own API key (size estimate).

Keep exploring

• NVIDIA RTX 5090 32GB — rent rates, own-vs-rent math & what fits
• Check a different GPU or Mac
• All GPUs — rental rates compared
• Free cost calculator — local vs rent vs API
• All models — the real cost to run each
• How we stay honest

Open the free Spanvero advisor → · GPU rates as of 2026-07-02, API prices as of 2026-07-06. Honest, $0-markup — your own accounts, we never resell compute. © 2026 Cynosure LLC.