Phoenix
Ask or search…
⌃K
Links

Instrumentation

How OpenInference facilitates automatic and manual instrumentation of applications.
Instrumentations available via OpenInference
In order to make a system observable, it must be instrumented: That is, code from the system’s components must emit traces.
Without being required to modify the source code you can collect telemetry from an application using automatic instrumentation. If you previously used an APM agent to extract telemetry from your application, Automatic Instrumentation will give you a similar out of the box experience.
To facilitate the instrumentation of applications even more, you can manually instrument your applications by coding against the OpenTelemetry APIs.
For that you don’t need to instrument all the dependencies used in your application:
  • some of your libraries will be observable out of the box by calling the OpenTelemetry API themselves directly. Those libraries are sometimes called natively instrumented.
  • for libraries without such an integration the OpenTelemetry projects provide language specific Instrumentation Libraries​
Note, that for most languages it is possible to use both manual and automatic instrumentation at the same time: Automatic Instrumentation will allow you to gain insights into your application quickly and manual instrumentation will enable you to embed granular observability into your code.
Phoenix natively supports collecting traces generated via OpenInference automatic instrumentation. The supported instrumentations are:
OpenInference provides a set of instrumentations for popular machine learning SDKs and frameworks in a variety of languages.

Python

Package
Description
Version
Semantic conventions for tracing of LLM Apps.
​​
PyPI Version
​
​
OpenInference Instrumentation for OpenAI SDK.
​​
PyPI Version
​
​
OpenInference Instrumentation for LlamaIndex.
​​
PyPI Version
​
​
OpenInference Instrumentation for DSPy.
​​
PyPI Version
​
​
OpenInference Instrumentation for AWS Bedrock.
​​
PyPI Version
​
​
OpenInference Instrumentation for LangChain.
​​
PyPI Version
​
​

JavaScript

Package
Description
Version
Semantic conventions for tracing of LLM Apps.
​​
NPM Version
​
​
OpenInference Instrumentation for OpenAI SDK.
​​
NPM Version
​
​