The real cost to run gpt oss 120b

unsloth · 120.4B parameters · 131.1K context · commercial OK

gpt oss 120b — 120.4B params (unsloth). Auto-indexed from the Hugging Face Hub (98,635 downloads). Parameter count is exact; download size and quantizations are estimates.

What it costs to run gpt oss 120b — $0 markup

On your own machine — $0. Runs free locally if you have about 82 GB of VRAM at Q4_K_M (point Spanvero at LM Studio, Ollama, or llama.cpp).
On your own rented GPU — from $0.98/hr. 2× NVIDIA RTX A6000 48GB at the direct RunPod price (≈ $1.49 a session), $0 markup.
Via your own API key — $1.06/1M tokens (blended input + output). No GPU to manage (rough estimate for this size).

Key facts

Parameters	120.4B
Context window	131.1K tokens
Recommended quant	Q4_K_M
VRAM to run	~82 GB (at Q4_K_M, 16.4K context)
Download size	~72 GB
License	Commercial use OK

Open the free Spanvero advisor → for the live, interactive math for your exact workload and hardware.

Related models

Llama 3.2 1B Instruct — 1.2B, unsloth
GLM 4.7 Flash — 31.2B, unsloth
Meta Llama 3.1 8B Instruct — 8B, unsloth
Nemotron 3 Nano 30B A3B — 31.6B, unsloth
Llama 3.1 8B Instruct — 8B, unsloth

Browse: All models · Compare