How to: Evals

Phoenix Evaluators

• Hallucinations

• Q&A on Retrieved Data

• Retrieval (RAG) Relevance

• Summarization

• Code Generation

• Toxicity

• AI vs Human

• Reference (Citation) Eval

• User Frustration

• SQL Generation Eval

• Agent Function Calling Eval

• Audio Emotion Detection

Bring Your Own Evaluator

• Categorical evaluator (llm_classify)

• Numeric evaluator (llm_generate)

Online Evals

Run evaluations via a job to visualize in the UI as traces stream in.

Evaluating Phoenix Traces

Evaluate traces captured in Phoenix and export results to the Phoenix UI.

Multimodal Evals

Evaluate tasks with multiple inputs/outputs (ex: text, audio, image) using versatile evaluation tasks.