Run Qwen3 8B on an H100 80GB

7.5 GiB needed. 80 GiB on the card. It fits.

Deploy picks the cheapest GPU that fits. Flat 5% fee, shown before you start.

Versions that fit

A general chat and reasoning model.

VersionNeeds
llama.cpp · Q4_K_M7.5 GiBDeploy
vLLM · AWQ11 GiBDeploy

Other GPUs for Qwen3 8B

Questions

Does Qwen3 8B fit on an H100 80GB?
Yes. It needs 7.5 GiB of VRAM and the H100 80GB has 80 GiB.
What does it cost to run Qwen3 8B on an H100 80GB?
Hosts set the hourly price. You see it, with our flat 5% fee inside, before anything starts. See live H100 80GB offers.
How do I use Qwen3 8B once it runs?
It serves an OpenAI-compatible API. The rental page gives you the URL and a key.