Groq
Instrument LLM applications built with Groq
Last updated
Was this helpful?
Instrument LLM applications built with Groq
Last updated
Was this helpful?
Groq provides low latency and lightning-fast inference for AI models. Arize supports instrumenting Groq API calls, including role types such as system, user, and assistant messages, as well as tool use. You can create a free GroqCloud account and generate a Groq API Key here to get started.
In this example we will instrument an LLM application built using Groq.
Install the following packages
Set up GroqInstrumentor
to trace calls to Groq LLM in the application and sends the traces to an Arize model endpoint as defined below.
Run a simple Chat Completion via Groq and see it instrumented