A100 40GB for local LLMs — what fits in 40 GB & the real cost
Rent a A100 40GB from $1.29/hr ($0 markup, as of 2026-07-09). 446 of the 565 models in our catalog fit its 40 GB — plus the honest own-vs-rent-vs-API math, electricity and amortization included.
Three honest ways to run AI on a A100 40GB
Own it: buy the card and pay electricity + amortization — local is real money, not "$0".
Rent it: from $1.29/GPU-hr on your own vendor account (as of 2026-07-09, $0 markup — we never resell compute).
Skip it: run a comparable open model through your own API key, paying per million tokens (prices as of 2026-08-10).
Rent a A100 40GB — real vendor rates, $0 markup
Verda: $1.29/GPU-hr — vendor's own price as of 2026-07-09; you pay them directly.
Lambda: $1.99/GPU-hr — vendor's own price as of 2026-07-09; you pay them directly.
As an Amazon Associate we earn from qualifying purchases. Each link opens an Amazon search for the category — not an endorsement of any specific product — and Cynosure LLC may earn a commission at no extra cost to you.
A short email of real AI price moves, straight from the daily log — no hype. We're collecting the list now; the first issue goes out when it opens. Unsubscribe with one click.