What you run yourself in a container environment, on your own server or in a cloud account you control: services you host and inference servers, and what their pages say about using a model you run alongside a cloud model. The environment can be your own laptop running Docker as much as a server or a cloud account.
| Product | Models from different providers in one session | Several endpoints, built in (no proxy) | A model in a container environment you run | Local and cloud in one session |
|---|---|---|---|---|
| LibreChat | YesHow to set it up | YesHow to set it up | YesHow to set it up | |
| LiteLLM | YesHow to set it up | YesHow to set it up | YesHow to set it up | |
| Open WebUI | PartlyHow to set it up | |||
| OpenHands | Partly | YesHow to set it up | PartlyHow to set it up | |
| Stack AI | PartlyHow to set it up | PartlyHow to set it up |
Words in the cells: Yes, Partly, Via a proxy, No, Claimed, Not found, n/a, Blank
A container environment you run can sit in several places: your own laptop running Docker, a server in your office, or a virtual machine or a Kubernetes cluster in a cloud account you control. In each case you run the software and choose where it sits, and no vendor runs it for you. The figure shows the step a service takes before it answers.
The container route each one names
Model servers that you host are in the table of inference servers further down.
These come in forms that run in more than one place, so each is on every page that fits one of its forms.
On this page as gateway. Also as library, on the page Hybrid on your own machine.
On this page as server you run. Also as hosted or cloud agent, on the page Hybrid as a cloud service.
On this page as server you run. Also as hosted or cloud agent, on the page Hybrid as a cloud service.
Where each product's models run, as its vendor's pages state it.
| Product | Models run |
|---|---|
| LiteLLM | The model company's cloud (OpenAI, Anthropic, Gemini) and a cloud provider's model service (Bedrock, Azure) |
| Open WebUI | The model company's cloud (Anthropic, OpenAI) |
| Stack AI | The model company's cloud (OpenAI, Anthropic) |
Our summary of the vendor's pages as of the dates shown on each line (2026-10-19 to 2026-10-23); confirm on the vendor's page.
Rendered 2026-10-28
An inference server loads a model and answers requests from the tools on the other pages. You run it yourself, in a container, on a GPU server or in a cloud account you control. The table shows what each server's pages say about the two formats a tool can speak to it, and whether its pages cover Claude Code.
| Server | Anthropic-format endpoint | OpenAI-format endpoint | Claude Code page |
|---|---|---|---|
| Ollama | Yes (docs.ollama.com page, read 2026-10-21) | Yes (docs.ollama.com page, read 2026-10-19) | Yes (docs.ollama.com page, read 2026-10-21) |
| vLLM | Yes (docs.vllm.ai page, read 2026-10-21) | Yes (docs.vllm.ai page, read 2026-10-21) | |
| llama.cpp server | Yes (github.com page, read 2026-10-21) | Not found in the one page read (the server README) (github.com page, read 2026-10-21) |
Servers that run in more than one place
Model servers we have not read for these questions: Atomic-Chat, BentoML, foundry-local, model-runner, sglang.
Our reading of vendors' pages, as of the dates shown. Confirm on the vendor's page before relying on any line that cites it. To report an error write to report@crinaro.ai