The real cost to run gemma 4 12B coder fable5 composer2.5 v1

yuxinlu1 · 12B parameters · 8.2K context · commercial OK

gemma 4 12B coder fable5 composer2.5 v1 — 12B params (yuxinlu1). Auto-indexed from the Hugging Face Hub (34,210 downloads). Parameter count is exact; context window, download size, and quantizations are estimates.

What it costs to run gemma 4 12B coder fable5 composer2.5 v1 — $0 markup

On your own machine — $0. Runs free locally if you have about 14 GB of VRAM at Q4_K_M (point Spanvero at LM Studio, Ollama, or llama.cpp).
On your own rented GPU — from $0.26/hr. NVIDIA RTX 3090 24GB at the direct Vast.ai price (≈ $0.14 a session), $0 markup.
Via your own API key — $0.20/1M tokens (blended input + output). No GPU to manage (rough estimate for this size).

Key facts

Parameters	12B
Context window	8.2K tokens
Recommended quant	Q4_K_M
VRAM to run	~14 GB (at Q4_K_M, 8.2K context)
Download size	~7 GB
License	Commercial use OK

Open the free Spanvero advisor → for the live, interactive math for your exact workload and hardware.

Related models

Gemma 3 12B — 12B, Google
Gemma 4 12B OBLITERATED — 12B, OBLITERATUS
Mellum2 12B A2.5B Thinking — 12.1B, JetBrains
Mellum2 12B A2.5B Base — 12.1B, JetBrains
MN 12B Mag Mell R1 — 12.2B, inflatebot

Browse: All models · Compare