Generative Skills

Available via the filter bar

AI Search consists of four powerful skills to help you curate your data:

  1. Column Search

    • Description: Refined semantic search within a single column based on user criteria.

    • Suggested Prompt: “Find me confused inputs”

    • Use When: Copilot will automatically select this skill when you need to search within a specific column.

  2. Table Search

    • Description: Search across multiple or all columns within a table to find patterns and outliers.

    • Suggested Prompt: “Find inputs that reference pricing that are hallucinated”

    • Use When: Copilot will automatically select this skill when you want to search across mutliple columns or entire table.

  3. Text to Filter

    • Description: Generates query filters from natural language commands to refine your data search. Use keyword Filter to trigger this skill.

    • Suggested Prompt: "Filter by input contains SDK"

    • Use When: You want copilot to construct a query filter for you.

  4. LLM Analysis Lite

    • Description: Lightweight analysis skill to find patterns and provide filter suggestions.

    • Suggested Prompt: "What are the top 5 types of questions asked?"

    • Use When: You need a lightweight analysis of your data.

Create Custom Evaluations

Available via the Task Creation Modal (Mini Chat) or in the main chat

  • Suggested Prompt: "Write a custom evaluation that meets the following criteria:<criteria>"

  • Use When: You need a tailored eval for your application.

  • Description: Writes a tailored eval for your application. Specify your goal or let Copilot analyze your data and make suggestions.

Suggest Phoenix Eval

  • Suggested Prompt: "Suggest a Phoenix eval for my application."

  • Use When: You want need help choosing the best prebuilt eval.

  • Description: Assesses your data and determines the most helpful prebuilt Eval .

Diagnose RAG Issues

Debug retrieval directly from trace details or in the main chat

  • Suggested Prompt: "Debug retrieval step of RAG app for <trace_id>"

  • Use When: You need to refine your retrieval process.

  • Description: Evaluate and refine your retrieval process. Analyzes responses to ensure relevance and accuracy, and provides improvement strategies.

Optimize Prompts

Available directly in the prompt playground and via the main chat

  • Suggested Prompt: "Optimize my prompt to <goal>"

  • Use When: You want to fine-tune your prompts.

  • Description: Optimize your prompt to address specific issues or enhance overall response quality.

Summarize Evaluation Metrics

  • Suggested Prompt: "Summarize my <eval_name> eval"

  • Use When: You want to understand the performance of your LLM application.

  • Description: Assesses and summarizes your evaluation metrics, offering targeted suggestions for enhancing your LLM application.

Last updated

Copyright © 2023 Arize AI, Inc