Llama 3.1 405B Instruct — Model

The highly anticipated 400B class of Llama3 is here, offering a 128k context window and impressive evaluation scores. This 405B instruct-tuned version is optimized for high-quality dialogue and demonstrates strong performance compared to leading closed-source models, including GPT-4o and Claude 3.5 Sonnet.

Pricing

Pay-as-you-go rates for this model. More details can be found here.

Input Tokens (1M)

$1.50

Output Tokens (1M)

$1.50

Capabilities

Input Modalities

Text

Output Modalities

Text

Supported Parameters

Available parameters for API requests

Frequency PenaltyLogit BiasLogprobsMax Completion TokensPresence PenaltyResponse FormatStopTemperatureTool ChoiceToolsTop P

Usage Analytics

Token usage of this model on our platform

Uptime

Reliability over the last 7 days

Not enough uptime data to display a chart

Throughput

Not enough throughput data

Time-To-First-Token (TTFT)

Not enough TTFT data

Code Example

Example code for using this model through our API with Python (OpenAI SDK) or cURL. Replace placeholders with your API key and model ID.

Basic request example. Ensure API key permissions. For more details, see our documentation.

from openai import OpenAI

client = OpenAI(
    base_url="https://api.naga.ac/v1",
    api_key="YOUR_API_KEY",
)

resp = client.chat.completions.create(
    model="llama-3.1-405b-instruct",
    messages=[
        {"role": "user", "content": "What's 2+2?"}
    ],
    temperature=0.2,
)
print(resp.choices[0].message.content)