Advanced app details
OpenAI-compatible API on the leased HTTP endpoint (per-job API key from the rental's access panel), context 8192 tokens. Weights (7.5 GB, commit-pinned) are warmed into the host cache and mounted read-only. Needs one GPU with at least 12 GB. Upstream image pinned by digest (ghcr.io/ggml-org/llama.cpp:server-cuda12-b11176@sha256:1f4b9cf58982dd4d7cc497aea31b1a456ca9a3a1f94f527d317d3fdee0d60ab6), verified via the registry API on 2026-09-26. Licence: MIT (https://github.com/ggml-org/llama.cpp/blob/master/LICENSE). Weights: Apache-2.0 (mistralai/Mistral-Nemo-Instruct-2407) (https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407). Needs an NVIDIA driver that supports CUDA 12.8 or newer. Runs on NVIDIA (CUDA), AMD (ROCm; Vulkan on Tier B hosts), Intel Arc (Vulkan, Tier B) and Apple silicon (Metal, Tier B) from the same pinned weights; on Apple silicon the fit uses the GPU share of unified memory. Draft (2026-10-02), not on any approve list. Status: not hardware-tested.
ghcr.io/ggml-org/llama.cpp@sha256:1f4b9cf58982dd4d7cc497aea31b1a456ca9a3a1f94f527d317d3fdee0d60ab6