$ the open-source LLM evaluation framework

Regression Testing in Python

Simple functions to unit test LLM applications in the CLI

Built in Observability

Gain insights to quickly iterate towards optimal hyperparameters

Integrate with Popular Frameworks

Evaluate existing LLM applications built with other frameworks