Llama 3.3 70B

llama.cpp · Q4_K_M · 43 GB

Meta's Llama 3.3 70B, 4-bit GGUF, on llama.cpp; one 48 GB card runs it; runs on NVIDIA, AMD, Intel Arc and Apple silicon.

Chat in your browser, plus an OpenAI-compatible API.

Publishedllamacppgguf-q4_k_mLLM inference

Needs 44 GiB of GPU memory · Runs on NVIDIA, AMD, Intel, Apple silicon

Pick a machine

No machine can run this right now.

New machines appear as hosts connect them.

Have a GPU? Earn with it See all machines

Doesn't fit (4)

1× Apple M5 Max (40-core GPU) · New hostinsufficient VRAM: need 47244640256 bytes, device has 402003066881× Apple M4 Pro (20-core GPU) · New hostinsufficient VRAM: need 47244640256 bytes, device has 386547056641× Apple M4 · New hostinsufficient VRAM: need 47244640256 bytes, device has 114525470721× Apple M1 Pro (14-core GPU) · New hostinsufficient VRAM: need 47244640256 bytes, device has 12712935424

Template details

Rating: No ratings yet
Runs: 0
Min VRAM: 47 GB
Backend: Set by the machine you pick
Weights: 43 GB
Version: llamacpp-llama-3-3-70b-v2-v2.0.0
Image digest: 1f4b9cf58982…
Health check: SSH probe on the leased endpoint

We match GPUs on their measured runtime and dedicated VRAM. A hardware report doesn't qualify another vendor's backend.

#llm #openai-api #gguf

Reviews

No reviews yet.