Anyscale
Integration tutorial for Anyscale's LLM Endpoints offering
Anyscale Endpoints is a service enabling developers to integrate fast, cost-efficient, and scalable large language models (LLMs) into their applications using popular LLM APIs.
This Colab notebook walks through how to get started with Anyscale Endpoints and the integration, including:
Importing and setting up the Arize client
Defining a chat model supported by Anyscale Endpoints
Testing LLM responses and logging into Arize
Testing LLM chains and agents with Arize integration
Read the full blog post here.
Last updated
