OpenInference
OpenInference is an open standard that encompasses model inference and LLM application tracing.
Last updated
OpenInference is an open standard that encompasses model inference and LLM application tracing.
Last updated
For a in-depth specification of the OpenInference specification, please consult the spec
OpenInference is a specification that encompass two data models:
Tracing
capture the execution of an application that results in invocations of an LLM.
Inferences
designed to capture inference logs from a variety of model types and use-cases
