Generative Skills
AI Search
Available via the filter bar
AI Search consists of four powerful skills to help you curate your data:
Column Search
Description: Refined semantic search within a single column based on user criteria.
Suggested Prompt: “Find me confused inputs”
Use When: Copilot will automatically select this skill when you need to search within a specific column.
Table Search
Description: Search across multiple or all columns within a table to find patterns and outliers.
Suggested Prompt: “Find inputs that reference pricing that are hallucinated”
Use When: Copilot will automatically select this skill when you want to search across mutliple columns or entire table.
Text to Filter
Description: Generates query filters from natural language commands to refine your data search. Use keyword
Filter
to trigger this skill.Suggested Prompt: "Filter by input contains SDK"
Use When: You want copilot to construct a query filter for you.
LLM Analysis Lite
Description: Lightweight analysis skill to find patterns and provide filter suggestions.
Suggested Prompt: "What are the top 5 types of questions asked?"
Use When: You need a lightweight analysis of your data.
Create Custom Evaluations
Available via the Task Creation Modal (Mini Chat) or in the main chat
Suggested Prompt: "Write a custom evaluation that meets the following criteria:<criteria>"
Use When: You need a tailored eval for your application.
Description: Writes a tailored eval for your application. Specify your goal or let Copilot analyze your data and make suggestions.
Suggest Phoenix Eval
Suggested Prompt: "Suggest a Phoenix eval for my application."
Use When: You want need help choosing the best prebuilt eval.
Description: Assesses your data and determines the most helpful prebuilt Eval .
Diagnose RAG Issues
Debug retrieval directly from trace details or in the main chat
Suggested Prompt: "Debug retrieval step of RAG app for <trace_id>"
Use When: You need to refine your retrieval process.
Description: Evaluate and refine your retrieval process. Analyzes responses to ensure relevance and accuracy, and provides improvement strategies.
Optimize Prompts
Available directly in the prompt playground and via the main chat
Suggested Prompt: "Optimize my prompt to <goal>"
Use When: You want to fine-tune your prompts.
Description: Optimize your prompt to address specific issues or enhance overall response quality.
Summarize Evaluation Metrics
Suggested Prompt: "Summarize my <eval_name> eval"
Use When: You want to understand the performance of your LLM application.
Description: Assesses and summarizes your evaluation metrics, offering targeted suggestions for enhancing your LLM application.
Last updated