How to: Evals

Phoenix Evaluators

• Hallucinations

• Q&A on Retrieved Data

• Retrieval (RAG) Relevance

• Summarization

• Code Generation

• Toxicity

• AI vs Human

• Reference (Citation) Eval

Bring Your Own Evaluator

• Categorical evaluator (llm_classify)

• Numeric evaluator (llm_generate)

Online Evals

Run evaluations via a job to visualize in the UI as traces stream in.