GPT-4

gpt-4 by OpenAI Released May 28, 2023
ReasoningFunction callingStructured outputPrompt cachingWeb searchComputer useImage inputFile inputAudio inputVideo inputEU hostingFree endpointUp to % off
Input from
$30 / 1M
Output from
$60 / 1M
Cached input from
$ / 1M
Context window
8K
Endpoints
2
from 2 providers
Regions
Global

About GPT-4

OpenAI's flagship model, GPT-4 is a large-scale multimodal language model capable of solving difficult problems with greater accuracy than previous models due to its broader general knowledge and advanced reasoning…

GPT-4 is a chat model by OpenAI, available on Eden AI through 2 endpoints from 2 providers, from $30 per million input tokens and $60 per million output tokens, with a context window of up to 8K tokens.

Providers and prices

2 endpoints from 2 providers, cheapest first, in USD per million tokens. Every one is called with the same Eden AI key: pin one with its endpoint ID, or let Eden AI route for you. .

Endpoint
Region
Context
Input / 1M
Output / 1M
Cached / 1M
Supports
Microsoft AzureOfficial−%microsoft/gpt-4
Global
8K
$30$30
$60
$
ReasoningToolsJSONCacheVisionWeb
OpenAIOfficial−%openai/gpt-4
Global
8K
$30$30
$60
$
ReasoningToolsJSONCacheVisionWeb

Performance

Measured on real Eden AI traffic over the last 30 days. Endpoints with too little traffic are not shown.

Fastest first token
0.68 s
OpenAI
Lowest latency
1.24 s
Microsoft Azure
Highest throughput
26.81 tok/s
OpenAI
Best availability
100%
Microsoft Azure
Endpoint
First token
Latency p50
Latency p95
Throughput
Availability
Cache hits
Tool errors
JSON errors
Microsoft Azure
1.1 s
1.24 s
2.03 s
3.15 tok/s
100%
0.35%
0%
0%
OpenAI
0.68 s
3.69 s
3.69 s
26.81 tok/s
99.49%
86.46%
0%
0%

Estimate your monthly cost

Enter your expected volume to compare every endpoint at once.

Call GPT-4 with Eden AI

Use the model ID to let Eden AI pick an endpoint, or an endpoint ID from the table above to pin one.

import requests

response = requests.post(
    "https://api.edenai.run/v3/chat/completions",
    headers={"Authorization": "Bearer YOUR_EDENAI_API_KEY"},
    json={
        "model": "",
        "messages": [{"role": "user", "content": "Hello!"}],
    },
)
print(response.json())

Questions about GPT-4

On Eden AI, prices for this model start at $30 per million input tokens and $60 per million output tokens. Prices differ by endpoint; the providers table lists each one. .

Up to 8K tokens, depending on the endpoint.

2 endpoints from 2 providers, available in: Global. All of them are called with the same Eden AI API key.

Yes. At least one endpoint is hosted in Europe; pin it with its endpoint ID from the providers table to keep requests in the EU.

Over the last 30 days, the fastest first token was 0.68 s (OpenAI) and the highest throughput was 26.81 tokens per second (OpenAI).