GPT-3.5 Turbo 16K

gpt-3.5-turbo-16k by OpenAI Released August 28, 2023
ReasoningFunction callingStructured outputPrompt cachingWeb searchComputer useImage inputFile inputAudio inputVideo inputEU hostingFree endpointUp to % off
Input from
$3 / 1M
Output from
$4 / 1M
Cached input from
$ / 1M
Context window
16K
Endpoints
2
from 2 providers
Regions
Monde, États-Unis

About GPT-3.5 Turbo 16K

Ce modèle offre une longueur de contexte quatre fois supérieure à celle du gpt-3.5-turbo, ce qui lui permet de traiter environ 20 pages de texte en une seule requête, moyennant un coût plus élevé.

GPT-3.5 Turbo 16K est un modèle conversationnel développé par OpenAI, disponible sur Eden AI via 2 endpoints chez 2 fournisseurs, à partir de 3 $ par million de tokens en entrée et 4 $ par million de tokens en sortie, avec une fenêtre de contexte allant jusqu'à 16K tokens.

Providers and prices

2 endpoints from 2 providers, cheapest first, in USD per million tokens. Every one is called with the same Eden AI key: pin one with its endpoint ID, or let Eden AI route for you. .

Endpoint
Region
Context
Input / 1M
Output / 1M
Cached / 1M
Supports
Microsoft AzureOfficial−%microsoft/gpt-35-turbo-16k
Monde
16K
$3$3
$4
$
ReasoningToolsJSONCacheVisionWeb
OpenAI (États-Unis)Official−%openai/gpt-3.5-turbo-16k
États-Unis
16K
$3$3
$4
$
ReasoningToolsJSONCacheVisionWeb

Performance

Performance figures appear here once GPT-3.5 Turbo 16K has enough traffic on Eden AI to report them without exposing any single customer.

Estimate your monthly cost

Enter your expected volume to compare every endpoint at once.

Call GPT-3.5 Turbo 16K with Eden AI

Use the model ID to let Eden AI pick an endpoint, or an endpoint ID from the table above to pin one.

import requests

response = requests.post(
    "https://api.edenai.run/v3/chat/completions",
    headers={"Authorization": "Bearer YOUR_EDENAI_API_KEY"},
    json={
        "model": "",
        "messages": [{"role": "user", "content": "Hello!"}],
    },
)
print(response.json())

Questions about GPT-3.5 Turbo 16K

On Eden AI, prices for this model start at $3 per million input tokens and $4 per million output tokens. Prices differ by endpoint; the providers table lists each one. .

Up to 16K tokens, depending on the endpoint.

2 endpoints from 2 providers, available in: Monde, États-Unis. All of them are called with the same Eden AI API key.

Yes. At least one endpoint is hosted in Europe; pin it with its endpoint ID from the providers table to keep requests in the EU.

Over the last 30 days, the fastest first token was s () and the highest throughput was tokens per second ().