The real cost to run OpenCoder 8B Instruct

infly · 7.8B parameters · 8.2K context · license restricted

OpenCoder 8B Instruct — 7.8B params (infly). Auto-indexed from the Hugging Face Hub (10,906 downloads). Parameter count is exact; download size and quantizations are estimates.

What it costs to run OpenCoder 8B Instruct — $0 markup

On your own machine — $0. Runs free locally if you have about 7 GB of VRAM at Q4_K_M (point Spanvero at LM Studio, Ollama, or llama.cpp).
On your own rented GPU — from $0.26/hr. NVIDIA RTX 3090 24GB at the direct Vast.ai price (≈ $0.10 a session), $0 markup.
Via your own API key — $0.16/1M tokens (blended input + output). No GPU to manage (rough estimate for this size).

Key facts

Parameters	7.8B
Context window	8.2K tokens
Recommended quant	Q4_K_M
VRAM to run	~7 GB (at Q4_K_M, 8.2K context)
Download size	~5 GB
License	License restricted

Open the free Spanvero advisor → for the live, interactive math for your exact workload and hardware.

Related models

MiMo 7B Base — 7.8B, XiaomiMiMo
EXAONE 3.5 7.8B Instruct — 7.8B, LGAI-EXAONE
hf moshiko — 7.8B, kmhf
MiMo 7B RL — 7.8B, XiaomiMiMo
Qwen1.5 7B — 7.7B, Qwen

Browse: All models · Compare