Help center

Answers to common questions. Can't find what you need? Contact us.

Getting started with Inferno
Inferno is a local AI inference server written in Rust. It runs language models entirely on your own hardware - no cloud, no telemetry - and…
Models and formats in Inferno
Inferno runs models that live on your own disk. The best-supported path is GGUF. GGUF recommended GGUF is the format used by the llama.cpp e…
Serving Inferno and troubleshooting
Once a model is in place, Inferno runs as a server you can point tools at. Start the server By default it listens on http://localhost:8080.…