Runs onThe places the vendor's own pages say the product runs: your machine, a container environment you run, or a cloud service the vendor runs. It is not a limit.
Models runWhere the vendor's own pages say the product's models run, not a limit: your machine, a container environment you run, the model company's cloud (servers of the company that makes or serves the model), or a cloud provider's model service. For a cloud, read the data and compliance lines of the company running it, linked by its name.
Use a local model: How to set it up(github.com page, read 2026-10-22) Settings the guide names: mlx_lm.server, --model.
Compared with similar tools
Same role (model server) at the same layer (Model hosting). Up to 4 others, in alphabetical order; nothing is ranked.
Product
Model on your machineThe tool can use a model running on your own computer, for example through Ollama, LM Studio, oMLX or llama.cpp.
Local and cloudA local model (on your machine or in a container environment you run) and a cloud model (in its model company's cloud or a cloud provider's model service) can both be used in the same session or setup.
Words in the cells: YesA page we read says so., PartlyA page says part of it, for example separate models per agent without saying the providers can differ., Via a proxyOnly with a proxy, or a local server that imitates a cloud provider's interface, in front of the tool., NoA page we read says the product does not support it., ClaimedA vendor page says so on a marketing or overview page, and we found no guide showing how to set it up., Not foundWe read pages for it and found nothing there. It says nothing about whether the product has the feature., n/aThe question does not apply to the product, for example because it is a model server and not a tool that connects to models., BlankNothing is published for it yet.
Data and compliance
Compliance: Set by whoever runs itThe answer belongs to whoever runs the software, because open-source software has no maker running it for you., for their own deployment.
Data: Set by whoever runs itThe answer belongs to whoever runs the software, because open-source software has no maker running it for you., with telemetry not checked yetWe have not read a page of the right kind for this question yet..
Model and where it runs: Run by its operator.
Details: What the project's own pages state, not a compliance determination.
What the maker's own pages said on the dates shown, not a compliance determination.
GitHub page: mlx-lm(the product's own site, from our list of products; not read for these lines)
The readings behind this page
Our summary of the vendor's pages as of the dates shown on each line (2026-10-19 to 2026-10-21); confirm on the vendor's page.
A model on your machine
mlx-lm can serve an HTTP API that generates text using any supported model. (github.com page, read 2026-10-21)
The MLX-LM server document shows mlx_lm.server --model mlx-community/Mistral-7B-Instruct-v0.3-4bit and says it starts a server on localhost at port 8080 that generates text with Mistral 7B Instruct. (github.com page, read 2026-10-21)
Claude Code with a local server
The MLX-LM server document says its HTTP API is meant to resemble OpenAI's chat API. An Anthropic Messages endpoint and Claude Code are not found in that document, the only page read. (github.com page, read 2026-10-21)
What a local model must meet
mlx-lm's README says a model that is large for the machine's RAM can run slowly, and that if the model still fits in RAM, raising the system wired memory limit can often speed it up. (github.com page, read 2026-10-19)
Our reading of vendors' pages, as of the dates shown. Confirm on the vendor's page before relying on any line that cites it. To report an error write to report@crinaro.ai