Llama 3.1 8B Instruct

llama-3.1-8b-instruct by Meta Released January 6, 2026

ReasoningFunction callingStructured outputPrompt cachingWeb searchComputer useImage inputFile inputAudio inputVideo inputEU hostingFree endpointUp to % off

Input from

$0.02 / 1M

Output from

$0.05 / 1M

Cached input from

$0.015 / 1M

Context window

200K

Endpoints

from 4 providers

Regions

Global, Europe, United States

About Llama 3.1 8B Instruct

Llama 3.1 is a state-of-the-art 8B parameter dense language model trained and released by Meta. The model supports a context length of 128K tokens. The model is optimized for multilingual dialogue use cases and aligned with human preferences for helpfulness and safety. It is not intended for use in languages other than English. Meta Llama 3.1 is licensed under the Meta Llama 3.1 Community License, Copyright © Meta Platforms, Inc. All Rights Reserved. Customers are responsible for ensuring compliance with applicable model licenses.

Llama 3.1 8B Instruct is a chat model by Meta, available on Eden AI through 4 endpoints from 4 providers, from $0.02 per million input tokens and $0.05 per million output tokens, with a context window of up to 200K tokens.

Providers and prices

4 endpoints from 4 providers, cheapest first, in USD per million tokens. Every one is called with the same Eden AI key: pin one with its endpoint ID, or let Eden AI route for you. .

Endpoint

Region

Context

Input / 1M

Output / 1M

Cached / 1M

Supports

DeepInfra (United States)Official−%deepinfra/meta-llama/Meta-Llama-3.1-8B-Instruct

United States

131K

$0.02$0.02

$0.05

ReasoningToolsJSONCacheVisionWeb

DatabricksOfficial−%databricks/databricks-meta-llama-3-1-8b-instruct

Global

200K

$0.15$0.15

$0.45

$0.015

ReasoningToolsJSONCacheVisionWeb

IONOS (Europe)Official−%ionos/meta-llama/Meta-Llama-3.1-8B-Instruct

Europe

$0.1681$0.1681

$0.1681

ReasoningToolsJSONCacheVisionWeb

Amazon Web Services (United States)Official−%amazon/meta.llama3-1-8b-instruct-v1:0

United States

128K

$0.22$0.22

$0.22

ReasoningToolsJSONCacheVisionWeb

Performance

Measured on real Eden AI traffic over the last 30 days. Endpoints with too little traffic are not shown.

Fastest first token

0.69 s

DeepInfra (United States)

Lowest latency

0.73 s

IONOS (Europe)

Highest throughput

121.14 tok/s

Amazon Web Services (United States)

Best availability

100%

Amazon Web Services (United States)

Endpoint

First token

Latency p50

Latency p95

Throughput

Availability

Cache hits

Tool errors

JSON errors

DeepInfra (United States)

0.69 s

9.22 s

64.75 s

34.47 tok/s

100%

8.18%

5.88%

Databricks

tok/s

IONOS (Europe)

0.91 s

0.73 s

4.04 s

46.44 tok/s

98.83%

Amazon Web Services (United States)

3.09 s

6.57 s

121.14 tok/s

100%

2.62%

Estimate your monthly cost

Enter your expected volume to compare every endpoint at once.

Call Llama 3.1 8B Instruct with Eden AI

Use the model ID to let Eden AI pick an endpoint, or an endpoint ID from the table above to pin one.

import requests

response = requests.post(
    "https://api.edenai.run/v3/chat/completions",
    headers={"Authorization": "Bearer YOUR_EDENAI_API_KEY"},
    json={
        "model": "",
        "messages": [{"role": "user", "content": "Hello!"}],
    },
)
print(response.json())

curl https://api.edenai.run/v3/chat/completions \
  -H "Authorization: Bearer YOUR_EDENAI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model": "", "messages": [{"role": "user", "content": "Hello!"}]}'

const response = await fetch("https://api.edenai.run/v3/chat/completions", {
  method: "POST",
  headers: {
    Authorization: "Bearer YOUR_EDENAI_API_KEY",
    "Content-Type": "application/json",
  },
  body: JSON.stringify({
    model: "",
    messages: [{ role: "user", content: "Hello!" }],
  }),
});
console.log(await response.json());

Questions about Llama 3.1 8B Instruct

How much does Llama 3.1 8B Instruct cost?

On Eden AI, prices for this model start at $0.02 per million input tokens and $0.05 per million output tokens. Prices differ by endpoint; the providers table lists each one. .

What is the context window of Llama 3.1 8B Instruct?

Up to 200K tokens, depending on the endpoint.

Which providers serve Llama 3.1 8B Instruct?

4 endpoints from 4 providers, available in: Global, Europe, United States. All of them are called with the same Eden AI API key.

Can I run Llama 3.1 8B Instruct in the EU?

Yes. At least one endpoint is hosted in Europe; pin it with its endpoint ID from the providers table to keep requests in the EU.

How fast is Llama 3.1 8B Instruct?

Over the last 30 days, the fastest first token was 0.69 s (DeepInfra (United States)) and the highest throughput was 121.14 tokens per second (Amazon Web Services (United States)).

About Llama 3.1 8B Instruct

Providers and prices

Performance

Estimate your monthly cost

Call Llama 3.1 8B Instruct with Eden AI

Questions about Llama 3.1 8B Instruct

More from Meta