Ollama

Ollama daemon; pull models on demand and call its API through an SSH tunnel; the same template runs on NVIDIA (CUDA) and AMD (ROCm) GPUs.

PublishedociLLM inference

Needs 7.5 GiB of GPU memory · Runs on NVIDIA, AMD

Pick a machine

No machine can run this right now.

New machines appear as hosts connect them.

Have a GPU? Earn with it See all machines

Doesn't fit (4)

1× Apple M5 Max (40-core GPU) · New hostno inference runtime for this machine's backend1× Apple M4 Pro (20-core GPU) · New hostno inference runtime for this machine's backend1× Apple M4 · New hostno inference runtime for this machine's backend1× Apple M1 Pro (14-core GPU) · New hostno inference runtime for this machine's backend

Template details

Rating: No ratings yet
Runs: 0
Min VRAM: 8.1 GB
Backend: Set by the machine you pick
Version: ollama-tunnel-v2-v2.0.0
Image digest: d696622202b0…
Health check: SSH probe on the leased endpoint

We match GPUs on their measured runtime and dedicated VRAM. A hardware report doesn't qualify another vendor's backend.

#llm #ollama

Reviews

No reviews yet.