Arize has first-class support for instrumenting VertexAI SDK and the Google Cloud AI Platform. Traces are fully OpenTelemetry compatible and can be sent to any OpenTelemetry collector for viewing.
In this example we will instrument generate_content calls.
Set up VertexAIInstrumentor to trace your application and sends the traces to Phoenix at the endpoint defined below.
from openinference.instrumentation.vertexai import VertexAIInstrumentor# Import open-telemetry dependenciesfrom arize_otel import register_otel, Endpoints# Setup OTEL via our convenience functionregister_otel( endpoints = Endpoints.ARIZE, space_id ="your-space-id", # in app space settings page api_key ="your-api-key", # in app space settings page project_name ="your-project-name", # name this to whatever you would like)VertexAIInstrumentor().instrument()
Now, all calls by generative_models are instrumented!
import vertexaifrom vertexai.generative_models import GenerativeModelvertexai.init(location="us-central1")model =GenerativeModel("gemini-1.5-flash")print(model.generate_content("Why is sky blue?"))