AmpleRun
Deploy

Model catalog

Pick a category, pick a model, and deploy in one click.

Code

Coding and debugging

5 models

  • Devstral Small 2507

    llama.cpp · Q4_K_M

    • M4 Pro · 24 GB unifiedBest value

      Q4_K_M · needs 22 GB · est. 11–17 tok/s

      Deployable now · $0.12/h

    • RTX 4090 · 24 GBFastest

      Q4_K_M · needs 22 GB · est. 42–60 tok/s

      Unavailable

    • RTX 3090 · 24 GB

      Q4_K_M · needs 22 GB · est. 39–56 tok/s

      Unavailable

    • RX 7900 XTX · 24 GB

      Q4_K_M · needs 22 GB

      Unavailable

    7 more

  • Qwen2.5 Coder 1.5B Instruct

    1.5B

    llama.cpp · Q4_K_M

    • M4 Pro · 24 GB unifiedBest value

      Q4_K_M, Q8, FP16 · needs 4 GB · est. 146–208 tok/s

      Deployable now · $0.12/h

    • RTX 4090 · 24 GBFastest

      Q4_K_M, Q8, FP16 · needs 4 GB · est. 541–767 tok/s

      Unavailable

    • RTX 3080 Ti · 12 GB

      Q4_K_M, Q8, FP16 · needs 4 GB · est. 489–694 tok/s

      Unavailable

    • M1 · 16 GB unified

      Q4_K_M, Q8, FP16 · needs 4 GB

      Unavailable

    16 more

  • Qwen2.5 Coder 14B

    14B

    llama.cpp · Q4_K_M

    • M4 Pro · 24 GB unifiedBest value

      Q4_K_M, Q8 · needs 11 GB · est. 18–26 tok/s

      Deployable now · $0.12/h

    • RTX 4090 · 24 GBFastest

      Q4_K_M, Q8 · needs 11 GB · est. 67–96 tok/s

      Unavailable

    • RTX 3080 Ti · 12 GB

      Q4_K_M · needs 11 GB · est. 60–87 tok/s

      Unavailable

    • M1 · 16 GB unified

      Q4_K_M · needs 11 GB

      Unavailable

    16 more

  • Qwen2.5-Coder 32B

    32B

    llama.cpp · Q4_K_M

    • M4 Pro · 24 GB unifiedBest value

      Q4_K_M · needs 22 GB · est. 8–12 tok/s

      Deployable now · $0.12/h

    • RTX 4090 · 24 GBFastest

      Q4_K_M · needs 22 GB · est. 30–44 tok/s

      Unavailable

    • RTX 3090 · 24 GB

      Q4_K_M · needs 22 GB · est. 28–41 tok/s

      Unavailable

    • RX 7900 XTX · 24 GB

      Q4_K_M · needs 22 GB

      Unavailable

    7 more

  • Qwen3 Coder 30B A3B

    30B

    llama.cpp · Q4_K_M

    • M4 Pro · 24 GB unifiedBest value

      Q4_K_M · needs 22 GB · est. 8–13 tok/s

      Deployable now · $0.12/h

    • RTX 4090 · 24 GBFastest

      Q4_K_M · needs 22 GB · est. 32–47 tok/s

      Unavailable

    • RTX 3090 · 24 GB

      Q4_K_M · needs 22 GB · est. 30–43 tok/s

      Unavailable

    • RX 7900 XTX · 24 GB

      Q4_K_M · needs 22 GB

      Unavailable

    7 more

Deploy any Hugging Face model

Paste a repo URL or ID like Qwen/Qwen3-32B. We'll estimate VRAM and suggest an engine.

Not sure what runs on your machine? See what fits.