OpenInference

OpenInference is an open standard that encompasses model inference and LLM application tracing.

For a in-depth specification of the OpenInference specification, please consult the spec https://github.com/Arize-ai/openinference

OpenInference is a set of specifications for model inferences and LLM traces

OpenInference is a specification that encompass two data models:

Inferences

designed to capture inference logs from a variety of model types and use-cases

Tracing

capture the execution of an application that results in invocations of an LLM.