Integration tutorial for Anyscale's LLM Endpoints offering

Anyscale Endpoints is a service enabling developers to integrate fast, cost-efficient, and scalable large language models (LLMs) into their applications using popular LLM APIs.

This Colab notebook walks through how to get started with Anyscale Endpoints and the integration, including:

  • Importing and setting up the Arize client

  • Defining a chat model supported by Anyscale Endpoints

  • Testing LLM responses and logging into Arize

  • Testing LLM chains and agents with Arize integration

Read the full blog post here.

Last updated

Copyright © 2023 Arize AI, Inc