Runs onThe places the vendor's own pages say the product runs: your machine, a container environment you run, or a cloud service the vendor runs. It is not a limit.
Models runWhere the vendor's own pages say the product's models run, not a limit: your machine, a container environment you run, the model company's cloud (servers of the company that makes or serves the model), or a cloud provider's model service. For a cloud, read the data and compliance lines of the company running it, linked by its name.
Use a local model: How to set it up(github.com page, read 2026-10-22) Settings the guide names: --host, --port, --ctx-size.
Works with
Claude Code: llama.cpp server has a /v1/messages endpoint; the README does not strongly claim Anthropic compatibility and does not name Claude Code in the sentence (github.com)
Same role (model server) at the same layer (Model hosting). Up to 4 others, in alphabetical order; nothing is ranked.
Product
Model on your machineThe tool can use a model running on your own computer, for example through Ollama, LM Studio, oMLX or llama.cpp.
Local and cloudA local model (on your machine or in a container environment you run) and a cloud model (in its model company's cloud or a cloud provider's model service) can both be used in the same session or setup.
Words in the cells: YesA page we read says so., PartlyA page says part of it, for example separate models per agent without saying the providers can differ., Via a proxyOnly with a proxy, or a local server that imitates a cloud provider's interface, in front of the tool., NoA page we read says the product does not support it., ClaimedA vendor page says so on a marketing or overview page, and we found no guide showing how to set it up., Not foundWe read pages for it and found nothing there. It says nothing about whether the product has the feature., n/aThe question does not apply to the product, for example because it is a model server and not a tool that connects to models., BlankNothing is published for it yet.
Data and compliance
Compliance: Set by whoever runs itThe answer belongs to whoever runs the software, because open-source software has no maker running it for you., for their own deployment.
Data: Set by whoever runs itThe answer belongs to whoever runs the software, because open-source software has no maker running it for you., with telemetry not checked yetWe have not read a page of the right kind for this question yet..
Model and where it runs: Run by its operator.
Details: What the project's own pages state, not a compliance determination.
What the maker's own pages said on the dates shown, not a compliance determination.
GitHub page: llama.cpp(the product's own site, from our list of products; not read for these lines)
The readings behind this page
Our summary of the vendor's pages as of the dates shown on each line (2026-10-21 to 2026-10-24); confirm on the vendor's page.
A model on your machine
The llama.cpp server README describes it as a fast, lightweight HTTP server written in pure C/C++, built on llama.cpp, httplib and nlohmann::json. (github.com page, read 2026-10-21)
The llama.cpp server README's quick-start command (./llama-server -m models/7B/ggml-model.gguf -c 2048, with a Windows form) starts a server listening on 127.0.0.1, port 9931, unless set otherwise; its --host and --port options list the same defaults. (github.com page, read 2026-10-21)
Claude Code with a local server
Under its POST /v1/messages heading, the llama.cpp server README says compatibility with Anthropic's API specification is not strongly claimed, and that in the authors' experience the endpoint is enough for many apps. (github.com page, read 2026-10-21)Caveat: The Claude Code gateway page says Anthropic provides no support when a gateway sends Claude Code's requests to models that are not Claude (code.claude.com page, read 2026-10-21).
About the product
llama.cpp's Docker page lists three Docker images published for the project. (github.com page, read 2026-10-24)
Our reading of vendors' pages, as of the dates shown. Confirm on the vendor's page before relying on any line that cites it. To report an error write to report@crinaro.ai