What is OpenInference?

An OSS package to enable standardized tracing of AI applications

GitHub - Arize-ai/openinference: Auto-Instrumentation for AI ObservabilityGitHub

OpenInference is a set of conventions and plugins that is complimentary to OpenTelemetry to enable tracing of AI applications. It instruments and monitors different code executions across models, frameworks, and vendors and maps them to a set of standardized attributes for traces and spans.

OpenInference is natively supported by Arize, but can be used with any OpenTelemetry-compatible backend as well. OpenInference provides a set of instrumentations for popular machine learning SDKs and frameworks in a variety of languages.

Python

Package	Description	Version
openinference-semantic-conventions	Semantic conventions for tracing of LLM Apps.
openinference-instrumentation-openai	OpenInference Instrumentation for OpenAI SDK.
openinference-instrumentation-llama-index	OpenInference Instrumentation for LlamaIndex.
openinference-instrumentation-dspy	OpenInference Instrumentation for DSPy.
openinference-instrumentation-bedrock	OpenInference Instrumentation for AWS Bedrock.
openinference-instrumentation-langchain	OpenInference Instrumentation for LangChain.
openinference-instrumentation-mistralai	OpenInference Instrumentation for MistralAI.
openinference-instrumentation-guardrails	OpenInference Instrumentation for Guardrails.
openinference-instrumentation-vertexai	OpenInference Instrumentation for VertexAI.
openinference-instrumentation-crewai	OpenInference Instrumentation for CrewAI.
openinference-instrumentation-haystack	OpenInference Instrumentation for Haystack.
openinference-instrumentation-litellm	OpenInference Instrumentation for liteLLM.
openinference-instrumentation-groq	OpenInference Instrumentation for Groq.
openinference-instrumentation-instructor	OpenInference Instrumentation for Instructor.
openinference-instrumentation-anthropic	OpenInference Instrumentation for Anthropic.

Javascript

Package	Description	Version
@arizeai/openinference-semantic-conventions	Semantic conventions for tracing of LLM Apps.
@arizeai/openinference-core	Core utility functions for instrumentation
@arizeai/openinference-instrumentation-openai	OpenInference Instrumentation for OpenAI SDK.
@arizeai/openinference-instrumentation-langchain	OpenInference Instrumentation for LangChain.js.
@arizeai/openinference-vercel	OpenInference Support for Vercel AI SDK