deepeval

An evaluation framework for large language models from Confident AI, per its GitHub description.

Our description, from the project's GitHub description, as of 2026-09-24.

Rendered 2026-10-28

Key facts

Fact	Answer
Layer	Testing agent output (main layer)
Forms	library

Our reading, beyond the maker's pages

Each item below is our own view of how the product compares or groups with other products in the catalog, or of a limit worth knowing about. It goes beyond what the maker's pages cited here say; no maker has said it or reviewed it, and it cannot be confirmed on a vendor's page. A second AI model read each item on 2026-10-25. Terms

We group it with promptfoo: the catalog lists both as libraries in the layer for testing agent output. (as of 2026-09-24)

Data and compliance

Compliance: Set by whoever runs it, for their own deployment.
Data: Set by whoever runs it, with telemetry not checked yet.
Model and where it runs: Run by its operator.
Details: What the project's own pages state, not a compliance determination.

What the maker's own pages said on the dates shown, not a compliance determination.

Sources

GitHub page: deepeval (the product's own site, from our list of products; not read for these lines)

Terms·Catalog home

Our reading of vendors' pages, as of the dates shown. Confirm on the vendor's page before relying on any line that cites it. To report an error write to report@crinaro.ai