bigscience · 176.2B parameters · 8.2K context · license restricted
Local (your GPU) $0 · ~203 GB VRAM | Rent a GPU from $2.45/hr | Your API key $1.51/1M est. |
Best next step
Already have 203 GB of VRAM? Run Q4_K_M locally for $0 compute. Check what your hardware can run →
No matching GPU? For the same representative session, the chosen rented GPU is about $2.23 at $2.45/hr. Open RunPod at its current rate →
Decision basis: 4,000 input + 2,000 output tokens, rate table dated 2026-08-24. Size-based API estimates never beat a provider-sourced rate here; referral status never changes the winner.
Novita AI offers model APIs and GPU instances. We do not include its prices in Spanvero's ranking yet, so compare Novita's current price and fit yourself.
Check Novita AI — referral link. You use your own account and pay Novita's normal price; Novita may pay Spanvero a commission.
Watch this price — free
Get an email when bloom's tracked price drops — checked against the append-only daily record. No account needed.
Free accounts watch one price. Exact multi-price targets remain available to existing Pro accounts; the old subscription is no longer sold — see current products.
bloom — 176.2B params (bigscience).
bloom needs more memory than any of our consumer hardware presets — running it locally means multi-GPU or workstation territory, so the API price is the honest baseline here.
Local is never $0 — every figure here includes electricity and hardware amortization. Speeds come from published 7-8B Q4 benchmarks (your model, quant, and context will differ); break-even volumes are rounded to 2 significant figures.
| Parameters | 176.2B |
|---|---|
| Context window | 8.2K tokens |
| Recommended quant | Q4_K_M |
| VRAM requirement | ~203 GB (at Q4_K_M, 8.2K context) |
| Download size | ~106 GB |
| License | License restricted |
Open the free LLM cost calculator → to model your workload, monthly cost, and break-even assumptions.
Three paths: $0 marginal compute on already-owned hardware if the calculated 203 GB VRAM baseline at Q4_K_M fits your exact build and runner (electricity and allocated hardware excluded); a rented GPU from $2.45/hr (5× NVIDIA RTX A6000 48GB at the direct RunPod price); or about $1.51 per 1M blended tokens via your own API key (a rough estimate for this size). Spanvero adds $0 markup on every path.
Only with serious hardware: at Q4_K_M, bloom needs about 203 GB of VRAM/unified memory — more than any consumer GPU or Mac we track — so local means multi-GPU workstation territory. Most people use a rented GPU or their own API key instead.
No single consumer GPU we track holds bloom — it needs about 203 GB at Q4_K_M. That is multi-GPU, cluster, or API territory.
Browse: All models · Compare
Spanvero · What's new · Prices as of 2026-08-24. We're an honest advisor — $0 markup, your own accounts, we never resell compute. Catalog specs auto-indexed from the Hugging Face Hub — parameter count is exact; download size and quantizations are estimates. © 2026 Cynosure LLC.
A short email of real AI price moves, straight from the daily log — no hype. We're collecting the list now; the first issue goes out when it opens. Unsubscribe with one click.