What is OpenInference?
An OSS package to enable standardized tracing of AI applications
Last updated
Was this helpful?
An OSS package to enable standardized tracing of AI applications
Last updated
Was this helpful?
OpenInference is a set of conventions and plugins that is complimentary to to enable tracing of AI applications. It instruments and monitors different code executions across models, frameworks, and vendors and maps them to a set of standardized attributes for traces and spans.
OpenInference is natively supported by Arize, but can be used with any OpenTelemetry-compatible backend as well. OpenInference provides a set of instrumentations for popular machine learning SDKs and frameworks in a variety of languages.
openinference-semantic-conventions
Semantic conventions for tracing of LLM Apps.
openinference-instrumentation-openai
OpenInference Instrumentation for OpenAI SDK.
openinference-instrumentation-llama-index
OpenInference Instrumentation for LlamaIndex.
openinference-instrumentation-dspy
OpenInference Instrumentation for DSPy.
openinference-instrumentation-bedrock
OpenInference Instrumentation for AWS Bedrock.
openinference-instrumentation-langchain
OpenInference Instrumentation for LangChain.
openinference-instrumentation-mistralai
OpenInference Instrumentation for MistralAI.
openinference-instrumentation-guardrails
OpenInference Instrumentation for Guardrails.
openinference-instrumentation-vertexai
OpenInference Instrumentation for VertexAI.
openinference-instrumentation-crewai
OpenInference Instrumentation for CrewAI.
openinference-instrumentation-haystack
OpenInference Instrumentation for Haystack.
openinference-instrumentation-litellm
OpenInference Instrumentation for liteLLM.
openinference-instrumentation-groq
OpenInference Instrumentation for Groq.
openinference-instrumentation-instructor
OpenInference Instrumentation for Instructor.
openinference-instrumentation-anthropic
OpenInference Instrumentation for Anthropic.
Semantic conventions for tracing of LLM Apps.
Core utility functions for instrumentation
OpenInference Instrumentation for OpenAI SDK.
OpenInference Instrumentation for LangChain.js.
OpenInference Support for Vercel AI SDK