Batch API
Send up to 5,000 chat completion requests in one JSONL file and collect the results when they are ready, at half the standard token price. The Eden AI Batch API follows the OpenAI Batch format and runs OpenAI and Anthropic models with the same API key.
Trusted by 500+ Companies, from Startups to Industry Leaders
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
How to run LLM requests in batch with Eden AI?
What is a Batch API?
A batch API takes many requests at once, runs them asynchronously and returns all the results together, within minutes or hours instead of seconds. Providers price this work lower because they can schedule it when capacity is free. It suits jobs that do not need an instant answer: classifying a backlog of tickets, tagging a product catalog, summarizing documents or running evaluations.
Upload One JSONL File
One chat request per line, results back as JSONL.
.avif)
29 Models at Half Price
Every OpenAI and Anthropic model with batch rates costs 50% less, on input and output. Claude Sonnet 5.5 goes from $2 / $10 to $1 / $5 per 1M tokens. Find them with supports_batch in GET /v3/models.
Value delivered
Save time
Integrate once and access hundreds of models without managing multiple APIs.
Model updates, provider changes, and new releases are handled transparently.
Reduce costs
Use the most efficient model for each need. Avoid vendor lock-in and adapt quickly to pricing or performance changes.
Reduce risk
Built-in fallback mechanisms protect applications from model outages. Routing flexibility allows rapid adaptation to evolving technologies and providers.
They are using Batch API
Got specific needs? We're here to help
AI API Gateway
5.5% platform fee
Advanced AI Platform
Custom price
Other features
Name a model and let Eden AI choose which provider serves it, by cost, latency or region, with automatic failover when a provider fails. Add fallbacks to switch to another model, or save the whole chain as a routing policy and call it by name.
Connect any MCP client or agent to the Eden AI hosted MCP server and give it 42 tools: OCR and document parsing, web search and scraping, speech, translation, image analysis and more. One URL, one API key, no server to run.
.avif)
Unlock the power of AI with our Custom Chatbot featuring RAG. Seamlessly integrate advanced conversational capabilities into your applications with ease.
Start building with Eden AI
A single interface to integrate the best AI technologies into your products.