Crinaro.AI · horizontal CRINARO.AI

Hybrid in a container environment you run

What you run yourself in a container environment, on your own server or in a cloud account you control: services you host and inference servers, and what their pages say about using a model you run alongside a cloud model. The environment can be your own laptop running Docker as much as a server or a cloud account.

Services you run in containers, on your own server or in your own cloud account

ProductModels from different providers in one sessionSeveral endpoints, built in (no proxy)A model in a container environment you runLocal and cloud in one session
LibreChatYesHow to set it upYesHow to set it upYesHow to set it up
LiteLLMYesHow to set it upYesHow to set it upYesHow to set it up
Open WebUIPartlyHow to set it up
OpenHandsPartlyYesHow to set it upPartlyHow to set it up
Stack AIPartlyHow to set it upPartlyHow to set it up

Words in the cells: Yes, Partly, Via a proxy, No, Claimed, Not found, n/a, Blank

A container environment you run can sit in several places: your own laptop running Docker, a server in your office, or a virtual machine or a Kubernetes cluster in a cloud account you control. In each case you run the software and choose where it sits, and no vendor runs it for you. The figure shows the step a service takes before it answers.

The container step for a service you host A diagram of the step a service you host takes on a machine you control, which can be your laptop, a server or a virtual machine in your own cloud account. An image published by the project is pulled and started by a container runtime, which is Docker, Podman or containerd, and the service then runs inside a container. The service reaches models, which run in a model server you run, in the model company's own cloud, or in a cloud provider's model service over the internet. On a machine you control: a laptop, a server or your own cloud account Container image published by the project Container runtime Docker, Podman or containerd Service you host inside the container Models a model server you run, the model company's cloud, or a cloud provider's service
Docker, Podman and containerd are three container runtimes: each one starts the same kind of image.

The container route each one names

Model servers that you host are in the table of inference servers further down.

Products that run in more than one place

These come in forms that run in more than one place, so each is on every page that fits one of its forms.

LiteLLM

On this page as gateway. Also as library, on the page Hybrid on your own machine.

OpenHands

On this page as server you run. Also as hosted or cloud agent, on the page Hybrid as a cloud service.

Stack AI

On this page as server you run. Also as hosted or cloud agent, on the page Hybrid as a cloud service.

Where their models run

Where each product's models run, as its vendor's pages state it.

ProductModels run
LiteLLMThe model company's cloud (OpenAI, Anthropic, Gemini) and a cloud provider's model service (Bedrock, Azure)
Open WebUIThe model company's cloud (Anthropic, OpenAI)
Stack AIThe model company's cloud (OpenAI, Anthropic)

Our summary of the vendor's pages as of the dates shown on each line (2026-10-19 to 2026-10-23); confirm on the vendor's page.

Rendered 2026-10-28

Inference servers you host

An inference server loads a model and answers requests from the tools on the other pages. You run it yourself, in a container, on a GPU server or in a cloud account you control. The table shows what each server's pages say about the two formats a tool can speak to it, and whether its pages cover Claude Code.

ServerAnthropic-format endpointOpenAI-format endpointClaude Code page
OllamaYes (docs.ollama.com page, read 2026-10-21)Yes (docs.ollama.com page, read 2026-10-19)Yes (docs.ollama.com page, read 2026-10-21)
vLLMYes (docs.vllm.ai page, read 2026-10-21)Yes (docs.vllm.ai page, read 2026-10-21)
llama.cpp serverYes (github.com page, read 2026-10-21)Not found in the one page read (the server README) (github.com page, read 2026-10-21)

Servers that run in more than one place

Model servers we have not read for these questions: Atomic-Chat, BentoML, foundry-local, model-runner, sglang.

Terms·Catalog home

Our reading of vendors' pages, as of the dates shown. Confirm on the vendor's page before relying on any line that cites it. To report an error write to report@crinaro.ai