How-to: Tracing

Guides on how to use traces

Tracing Core Concepts

• How to log traces

• How to turn off tracing

Customize Traces

• How to log to a specific project

• How to switch projects in a notebook

• How to add auto-instrumentation

• How to create custom spans

• How to add custom metadata

Customize Spans

How to set custom attributes and semantic attributes to child spans and spans created by auto-instrumentors.

• Setting metadata

• Setting tags

• Setting a user

• Setting prompt template attributes

• How to read attributes from context

Auto Instrumentation

Use auto-instrumentation to export traces for common frameworks and libraries

Auto Instrument: Python

• Instrument LlamaIndex

• Instrument LangChain

• Instrument OpenAI

• Instrument DSPy

• Instrument AWS Bedrock

• Instrument AutoGen

Auto Instrument: TypeScript

• Instrument OpenAI Node SDK

• Instrument LangChain.js

Manual Instrumentation

Create and customize spans for your use-case

Instrument: Python

• How to acquire a Tracer

• How to create spans

• How to create nested spans

• How to create spans with decorators

• How to get the current span

• How to add attributes to a span

• How to add semantic attributes

• How to add events

• How to set a span's status

• How to record exceptions

Instrument: TypeScript

Querying Spans

How to query spans for to construct DataFrames to use for evaluation

• How to run a query

• How to specify a project

• How to query for documents

• How to apply filters

• How to extract attributes

• How to use data for evaluation

• How to use pre-defined queries

Log Evaluation Results

How to log evaluation results to annotate traces with evals

• How to log span evaluations

• How to log document evaluations

• How to specify a project for logging evaluations

Save and Load Traces

• Saving Traces

• Loading Traces

Trace a Deployed Application

• How to instrument an application

• How to deploy a Phoenix server (collector)

• How to use Arize as a collector