Integrations

Anthropic

Phoenix supports tracing Anthropic API calls, and using Anthropic models for LLM as a Judge evaluations.

Eval Models Tracing

Autogen

AutoGen is a framework for creating multi-agent AI applications that can act autonomously or work alongside humans.

Tracing

AWS Bedrock

Instrument LLM calls to AWS Bedrock via the boto3 client using the BedrockInstrumentor

Eval Models Tracing

CrewAI

Streamline workflows across industries with powerful AI agents. Build and deploy automated workflows using any LLM and cloud platform.

Tracing

DSPy

Algorithmically optimizing LM prompts and weights.

Tracing

Google Vertex

Vertex AI is a fully-managed, unified AI development platform for building and using generative AI.

Eval Models Tracing

Groq

Hardware and software platform that delivers exceptional compute speed, quality, and energy efficiency.

Tracing

Guardrails AI

Open-source framework for adding validation, safety, and structure to LLM outputs using schema-based constraints

Tracing

Haystack

An open-source Python framework that helps developers build LLM-powered custom applications.

Tracing

Hugging Face smolagents

smolagents is a minimalist AI agent framework developed by Hugging Face, designed to simplify the creation and deployment of powerful agents with just a few lines of code

Tracing

Langchain

Orchestration framework designed to simplify the creation of applications using LLMs.

Tracing

LiteLLM

LiteLLM allows developers to call all LLM APIs using the openAI format.

Tracing

LlamaIndex

Simple, flexible data framework for connecting custom data sources to large language models (LLMs).

Tracing

Mistral

Streamline workflows with powerful AI agents. Build and deploy using any LLM and cloud platform.

Eval Models Tracing

OpenAI

OpenAI provides AI models and API services.

Eval Models Tracing

Pinecone

Pinecone is a vector database that can be used to power RAG in various applications.

Vector DBs

Ragas

Generate synthetic test data, evaluate RAG quality, trace retrieval steps, and analyze cluster behavior for RAG pipelines.

Evaluation

Vercel

Deploy AI apps in seconds with Vercel's AI SDK and Frontend Cloud.

Tracing

Weaviate

Weaviate is an open source, AI-native vector database.

Vector DBs