Llama 3.1 405B Instruct

Chat Completions

llama-3.1-405b-instruct

Meta Llama|Created May 25, 2025|131k context

Chat Completions

The highly anticipated 400B class of Llama3 is here, offering a 128k context window and impressive evaluation scores. This 405B instruct-tuned version is optimized for high-quality dialogue and demonstrates strong performance compared to leading closed-source models, including GPT-4o and Claude 3.5 Sonnet.

Overview Specifications Activity Performance Uptime Examples API Reference

Compare

Endpoints and request shape

This page collects the public integration surface for the model: supported endpoints, available request parameters, and example calls through the NagaAI API.

Chat Completions

Code Example

Example code for using this model through our API with Python (OpenAI SDK) or cURL. Replace placeholders with your API key and model ID.

Basic request example. Ensure API key permissions. For more details, see our documentation.

from openai import OpenAI

client = OpenAI(
    base_url="https://api.naga.ac/v1",
    api_key="YOUR_API_KEY",
)

resp = client.chat.completions.create(
    model="llama-3.1-405b-instruct",
    messages=[
        {"role": "user", "content": "What's 2+2?"}
    ],
    temperature=0.2,
)
print(resp.choices[0].message.content)

Supported Parameters

Available parameters for API requests

Frequency PenaltyMax Completion TokensPresence PenaltyResponse FormatTemperatureTop PLogit BiasLogprobsStopTool ChoiceTools