Run Qwen2.5 Coder 7B on an H100 80GB
7.5 GiB needed. 80 GiB on the card. It fits.
Deploy picks the cheapest GPU that fits. Flat 5% fee, shown before you start.
Versions that fit
A coding model.
| Version | Needs | |
|---|---|---|
| llama.cpp · Q4_K_M | 7.5 GiB | Deploy |
Other GPUs for Qwen2.5 Coder 7B
Questions
Does Qwen2.5 Coder 7B fit on an H100 80GB?
Yes. It needs 7.5 GiB of VRAM and the H100 80GB has 80 GiB.
What does it cost to run Qwen2.5 Coder 7B on an H100 80GB?
Hosts set the hourly price. You see it, with our flat 5% fee inside, before anything starts. See live H100 80GB offers.
How do I use Qwen2.5 Coder 7B once it runs?
It serves an OpenAI-compatible API. The rental page gives you the URL and a key.