Can Used NVIDIA Tesla P40 24GB run Llama, Qwen & DeepSeek? 294 models that fit

294 of the 396 models in the Spanvero catalog fit Used NVIDIA Tesla P40 24GB's 24 GB VRAM (at a sensible quant, 16k context). For each: run it locally ($0 compute + electricity), rent an equivalent GPU ($0 markup, as of 2026-07-02), or pay per-token via your own API key (as of 2026-07-06).

Three honest ways to run each model on Used NVIDIA Tesla P40 24GB

• Run it locally: $0 in compute — you pay only electricity (~250 W under load on this card). Local is real money, never a fake "$0".
• Rent an equivalent GPU: from a $0-markup vendor rate (as of 2026-07-02) — you rent on your own account and pay the vendor directly; we never resell compute.
• Skip the box: run the same model through your own API key, paying per million tokens (prices as of 2026-07-06).

What fits Used NVIDIA Tesla P40 24GB (24 GB VRAM)

• 294 of the 396 notable models in the Spanvero catalog fit Used NVIDIA Tesla P40 24GB at a sensible quant (context capped at 16k for the estimate). Most capable first:
• Laguna XS.2 (poolside, 33.4B) — needs ~24 GB at Q4_K_M: run it locally for $0 compute + ~$2.279/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.15/1M via your own API key.
• sarvam 30b (sarvamai, 32.2B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$2.2132/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
• llm jp 4 32b a3b thinking (llm-jp, 32.1B) — needs ~23 GB at Q4_K_M: run it locally for $0 compute + ~$2.2077/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.36/1M via your own API key (size estimate).
• NVIDIA Nemotron 3 Nano 30B A3B BF16 (nvidia, 31.6B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$2.1802/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.35/1M via your own API key (size estimate).
• Nemotron Cascade 2 30B A3B (nvidia, 31.6B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$2.1802/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.35/1M via your own API key (size estimate).
• Qwen3 30B A3B (Qwen, 30.5B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$2.1193/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.31/1M via your own API key.
• Qwen3 Coder 30B A3B Instruct (Qwen, 30.5B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$2.1193/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.17/1M via your own API key.
• Qwen3 30B A3B Instruct 2507 (Qwen, 30.5B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$2.1193/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.12/1M via your own API key.
• Qwen3 30B A3B Thinking 2507 (Qwen, 30.5B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$2.1193/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.85/1M via your own API key.
• Tongyi DeepResearch 30B A3B (Alibaba-NLP, 30.5B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$2.1193/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.34/1M via your own API key (size estimate).
• Qwen3 30B A3B Base (Qwen, 30.5B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$2.1193/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.34/1M via your own API key (size estimate).
• lynx instruct 30b (bineric, 30.5B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$2.1193/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.34/1M via your own API key (size estimate).
• North Mini Code 1.0 (CohereLabs, 30.5B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$2.1193/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.34/1M via your own API key (size estimate).
• granite 4.1 30b (ibm-granite, 28.9B) — needs ~24 GB at Q4_K_M: run it locally for $0 compute + ~$2.0298/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.33/1M via your own API key (size estimate).
• Gemma 2 27B Instruct (Google, 27B) — needs ~22 GB at Q4_K_M: run it locally for $0 compute + ~$1.9224/1M in electricity, rent 3× NVIDIA RTX 3060 12GB from $0.18/hr ($0 markup), or ~$0.65/1M via your own API key.
• Trinity Mini (arcee-ai, 26.1B) — needs ~19 GB at Q4_K_M: run it locally for $0 compute + ~$1.8709/1M in electricity, rent 2× NVIDIA RTX 3060 12GB from $0.12/hr ($0 markup), or ~$0.10/1M via your own API key.
• LFM2 24B A2B (LiquidAI, 23.8B) — needs ~18 GB at Q4_K_M: run it locally for $0 compute + ~$1.7378/1M in electricity, rent 2× NVIDIA RTX 3060 12GB from $0.12/hr ($0 markup), or ~$0.29/1M via your own API key (size estimate).
• Mistral Small 3 (24B, 2501) (Mistral AI, 23.6B) — needs ~20 GB at Q4_K_M: run it locally for $0 compute + ~$1.7261/1M in electricity, rent 2× NVIDIA RTX 3060 12GB from $0.12/hr ($0 markup), or ~$0.07/1M via your own API key.
• EuroLLM 22B Instruct 2512 (utter-project, 22.6B) — needs ~19 GB at Q4_K_M: run it locally for $0 compute + ~$1.6674/1M in electricity, rent 2× NVIDIA RTX 3060 12GB from $0.12/hr ($0 markup), or ~$0.28/1M via your own API key (size estimate).
• gpt oss safeguard 20b (openai, 21.5B) — needs ~16 GB at Q4_K_M: run it locally for $0 compute + ~$1.6021/1M in electricity, rent 2× NVIDIA RTX 3060 12GB from $0.12/hr ($0 markup), or ~$0.19/1M via your own API key.

• Laguna XS.2 — full cost breakdown
• sarvam 30b — full cost breakdown
• llm jp 4 32b a3b thinking — full cost breakdown
• NVIDIA Nemotron 3 Nano 30B A3B BF16 — full cost breakdown
• Nemotron Cascade 2 30B A3B — full cost breakdown
• Qwen3 30B A3B — full cost breakdown
• Qwen3 Coder 30B A3B Instruct — full cost breakdown
• Qwen3 30B A3B Instruct 2507 — full cost breakdown
• Qwen3 30B A3B Thinking 2507 — full cost breakdown
• Tongyi DeepResearch 30B A3B — full cost breakdown
• Qwen3 30B A3B Base — full cost breakdown
• lynx instruct 30b — full cost breakdown
• North Mini Code 1.0 — full cost breakdown
• granite 4.1 30b — full cost breakdown
• Gemma 2 27B Instruct — full cost breakdown
• Trinity Mini — full cost breakdown
• LFM2 24B A2B — full cost breakdown
• Mistral Small 3 (24B, 2501) — full cost breakdown
• EuroLLM 22B Instruct 2512 — full cost breakdown
• gpt oss safeguard 20b — full cost breakdown

The honest cost of owning Used NVIDIA Tesla P40 24GB

• The full ownership math for this card — its dated street price, 3-year amortization, electricity, and the own-vs-rent break-evens — lives on the dedicated NVIDIA Tesla P40 24GB GPU page (linked under "Keep exploring" below), so those numbers are published once, in one place.

Too big for Used NVIDIA Tesla P40 24GB — rent or use an API instead

• These need more than the 24 GB VRAM on this card. Closest first — you can still run them on a rented GPU ($0 markup) or via your own API key:
• Yi-1.5-34B-Chat (01.AI, 34.4B) — needs ~25 GB; rent 3× NVIDIA RTX 3060 12GB from $0.18/hr, or ~$0.38/1M via your own API key (size estimate).
• Qwen3-32B (Alibaba, 32.8B) — needs ~25 GB; rent 3× NVIDIA RTX 3060 12GB from $0.18/hr, or ~$0.18/1M via your own API key.
• granite 4.0 h small (ibm-granite, 32.2B) — needs ~25 GB; rent 3× NVIDIA RTX 3060 12GB from $0.18/hr, or ~$0.36/1M via your own API key (size estimate).
• Qwen2.5-Coder 32B Instruct (Alibaba, 32B) — needs ~25 GB; rent 3× NVIDIA RTX 3060 12GB from $0.18/hr, or ~$0.83/1M via your own API key.
• Gemma 4 31B IT NVFP4 (nvidia, 20.9B) — needs ~25 GB; rent 3× NVIDIA RTX 3060 12GB from $0.18/hr, or ~$0.27/1M via your own API key (size estimate).
• Seed OSS 36B Instruct (ByteDance-Seed, 36.2B) — needs ~27 GB; rent 3× NVIDIA RTX 3060 12GB from $0.18/hr, or ~$0.39/1M via your own API key (size estimate).

Keep exploring

• NVIDIA Tesla P40 24GB — rent rates, own-vs-rent math & what fits
• Check a different GPU or Mac
• All GPUs — rental rates compared
• Free cost calculator — local vs rent vs API
• All models — the real cost to run each
• How we stay honest

Open the free Spanvero advisor → · GPU rates as of 2026-07-02, API prices as of 2026-07-06. Honest, $0-markup — your own accounts, we never resell compute. © 2026 Cynosure LLC.