Production Replay

Any span on the LLM Tracing page can be loaded into the Prompt Playground for replay and iteration. The LLM parameters, prompt template, input messages, variables, and function definitions are automatically populated in the playground. From there, you can replay the LLM call precisely and iteratively refine the prompt for continuous improvements.

Click the 'Prompt Playground' button to import the span into the playground, allowing you to reproduce the LLM call for detailed testing and refinement.

The LLM parameters, prompt template, input messages, variables, and function definitions are automatically populated in the playground to match the span.

The LLM Parameters match the Invocation Parameters from the span.

The Invocation Params on the trace can include the model, temperature, max completion tokens and other parameters that will automatically be populated in the playground