DeepSeek-R1-Distill-Qwen 32B

vLLM · 66 GB

DeepSeek-R1-Distill-Qwen 32B in BF16 on vLLM; needs an 80 GB card.

Chat in your browser, plus an OpenAI-compatible API.

Publishedvllmbf16LLM inference

Needs 75 GiB of GPU memory · CUDA on NVIDIA

Pick a machine

No machine can run this right now.

New machines appear as hosts connect them.

A smaller version runs now:

DeepSeek-R1-Distill-Qwen 32B Q4_K_M (llama.cpp, any GPU) from $0.115/h

Have a GPU? Earn with it See all machines

Doesn't fit (4)

1× Apple M5 Max (40-core GPU) · New hostno inference runtime for this machine's backend1× Apple M4 Pro (20-core GPU) · New hostno inference runtime for this machine's backend1× Apple M4 · New hostno inference runtime for this machine's backend1× Apple M1 Pro (14-core GPU) · New hostno inference runtime for this machine's backend

Template details

Rating: No ratings yet
Runs: 0
Min VRAM: 81 GB
Backend: Set by the machine you pick
Weights: 66 GB
Version: vllm-deepseek-r1-distill-qwen-32b-v1.0.0
Image digest: 4895d4c39da6…
Health check: SSH probe on the leased endpoint

We match GPUs on their measured runtime and dedicated VRAM. A hardware report doesn't qualify another vendor's backend.

#llm #reasoning #openai-api #vllm

Reviews

No reviews yet.