Llama 3.1 70B Instruct

Chat Completions

llama-3.1-70b-instruct

Meta Llama|Created May 26, 2025|131.1k context

Chat Completions

Meta’s Llama 3.1 70B instruct-tuned model, optimized for high-quality dialogue use cases. It demonstrates strong performance in human evaluations and is suitable for a wide range of conversational AI applications.

Overview Specifications Activity Performance Uptime Examples API Reference

Compare

Pricing-50%

Pay-as-you-go rates for this model. More details can be found here.

Input Tokens (1M)

$0.30

Output Tokens (1M)

$0.40

Capabilities

Input Modalities

Text

Output Modalities

Text

Supported Parameters

Available parameters for API requests

Frequency PenaltyMax Completion TokensPresence PenaltyResponse FormatTemperatureTop PLogit BiasLogprobsStopTool ChoiceTools

Usage Analytics

Token usage of this model on our platform

Throughput

Not enough throughput data

Time-To-First-Token (TTFT)

Not enough TTFT data

Code Example

Example code for using this model through our API with Python (OpenAI SDK) or cURL. Replace placeholders with your API key and model ID.

Basic request example. Ensure API key permissions. For more details, see our documentation.

from openai import OpenAI

client = OpenAI(
    base_url="https://api.naga.ac/v1",
    api_key="YOUR_API_KEY",
)

resp = client.chat.completions.create(
    model="llama-3.1-70b-instruct",
    messages=[
        {"role": "user", "content": "What's 2+2?"}
    ],
    temperature=0.2,
)
print(resp.choices[0].message.content)