AI Gateway

Most popular

Unified access to 200+ LLMs

Passthrough

The AI Gateway provides unified access to 200+ large language models from OpenAI, Anthropic, Google, Meta, and more. Features automatic fallbacks, response caching, streaming support, and detailed usage tracking. One API, all models.

Overview
Pricing
Usage
Docs
Examples

Key Features

Multi-Provider Support

GPT-4o, Claude 3.5, Gemini 2, Llama 3.3, and 200+ more models

Automatic Fallbacks

If one provider fails, automatically try alternatives

Response Caching

Cache identical requests to reduce costs and latency

Streaming Support

Real-time streaming responses for chat applications

Usage Tracking

Track tokens, costs, and latency per request

Rate Limit Handling

Automatic retries with exponential backoff

Use Cases

Chat applications and conversational AI
Content generation and summarization
Code generation and analysis
Document processing and extraction
AI-powered search and recommendations

At a Glance

Type
Passthrough
Pricing
Pass-through + 25%
per 1M tokens
Free Tier
-
Features
6 included

Ready to get started?

Check out the docs tab for quick start guides, code examples, and API reference.

View Documentation