Hermes 3 Llama 3.1 405B

hermes-3-llama-3.1-405b by Nous Research Released August 16, 2024

ReasoningFunction callingStructured outputPrompt cachingWeb searchComputer useImage inputFile inputAudio inputVideo inputEU hostingFree endpointUp to % off

Input from

$1 / 1M

Output from

$1 / 1M

Cached input from

$ / 1M

Context window

131K

Endpoints

from 1 providers

Regions

États-Unis

About Hermes 3 Llama 3.1 405B

Hermes 3 est un modèle linguistique généraliste qui présente de nombreuses améliorations par rapport à Hermes 2, notamment des capacités agentiques avancées, une bien meilleure gestion des jeux de rôle, un raisonnement plus performant, des conversations à plusieurs tours, une cohérence contextuelle sur le long terme, ainsi que des améliorations dans les domaines…

Hermes 3 Llama 3.1 405B est un modèle conversationnel développé par Nous Research, disponible sur Eden AI via 1 endpoint chez 1 fournisseur, à partir de 1 $ par million de tokens en entrée et 1 $ par million de tokens en sortie, avec une fenêtre de contexte allant jusqu'à 131K tokens.

Providers and prices

1 endpoints from 1 providers, cheapest first, in USD per million tokens. Every one is called with the same Eden AI key: pin one with its endpoint ID, or let Eden AI route for you. .

Endpoint

Region

Context

Input / 1M

Output / 1M

Cached / 1M

Supports

DeepInfra (États-Unis)Official−%deepinfra/NousResearch/Hermes-3-Llama-3.1-405B

États-Unis

131K

$1$1

ReasoningToolsJSONCacheVisionWeb

Performance

Performance figures appear here once Hermes 3 Llama 3.1 405B has enough traffic on Eden AI to report them without exposing any single customer.

Estimate your monthly cost

Enter your expected volume to compare every endpoint at once.

Call Hermes 3 Llama 3.1 405B with Eden AI

Use the model ID to let Eden AI pick an endpoint, or an endpoint ID from the table above to pin one.

import requests

response = requests.post(
    "https://api.edenai.run/v3/chat/completions",
    headers={"Authorization": "Bearer YOUR_EDENAI_API_KEY"},
    json={
        "model": "",
        "messages": [{"role": "user", "content": "Hello!"}],
    },
)
print(response.json())

curl https://api.edenai.run/v3/chat/completions \
  -H "Authorization: Bearer YOUR_EDENAI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model": "", "messages": [{"role": "user", "content": "Hello!"}]}'

const response = await fetch("https://api.edenai.run/v3/chat/completions", {
  method: "POST",
  headers: {
    Authorization: "Bearer YOUR_EDENAI_API_KEY",
    "Content-Type": "application/json",
  },
  body: JSON.stringify({
    model: "",
    messages: [{ role: "user", content: "Hello!" }],
  }),
});
console.log(await response.json());

Questions about Hermes 3 Llama 3.1 405B

How much does Hermes 3 Llama 3.1 405B cost?

On Eden AI, prices for this model start at $1 per million input tokens and $1 per million output tokens. Prices differ by endpoint; the providers table lists each one. .

What is the context window of Hermes 3 Llama 3.1 405B?

Up to 131K tokens, depending on the endpoint.

Which providers serve Hermes 3 Llama 3.1 405B?

1 endpoints from 1 providers, available in: États-Unis. All of them are called with the same Eden AI API key.

Can I run Hermes 3 Llama 3.1 405B in the EU?

Yes. At least one endpoint is hosted in Europe; pin it with its endpoint ID from the providers table to keep requests in the EU.

How fast is Hermes 3 Llama 3.1 405B?

Over the last 30 days, the fastest first token was s () and the highest throughput was tokens per second ().