Meta’s Llama 3.1 70B instruct-tuned model, optimized for high-quality dialogue use cases. It demonstrates strong performance in human evaluations and is suitable for a wide range of conversational AI applications.
$0.20market price $0.40
$0.20market price $0.40
Throughput is how fast the model writes (tokens per second, higher is better). Time to first token is how long before the answer starts (lower is better).
Share of requests served without a server error. Client errors (4xx) do not count.
Works with the OpenAI SDK pointed at our base URL. Every parameter is in the API reference.
Daily usage of this model on NagaAI.
Meta’s Llama 3.1 70B instruct-tuned model, optimized for high-quality dialogue use cases. It demonstrates strong performance in human evaluations and is suitable for a wide range of conversational AI applications.
On NagaAI, Llama 3.1 70B Instruct costs $0.20 per 1M input tokens and $0.20 per 1M output tokens. You pay only for what you use, with no subscription.
Llama 3.1 70B Instruct reads up to 131.1k tokens in one request, counting the prompt and the answer together.
Yes. Llama 3.1 70B Instruct can call your functions as tools and can answer in a JSON schema you give it.
It takes text as input and returns text.
Create an API key, copy the model ID from the top of this page and send requests with the OpenAI or Anthropic SDK pointed at NagaAI. The API section on this page has a ready example.
Muse WonderMeta LlamaMuse Spark OpenMeta LlamaMuse Glimmer 30BMeta LlamaLlama 3.2 11B Vision InstructMeta Llama$0.10 / $0.10 per 1MLlama 4 Scout 17B 16E InstructMeta Llama$0.24 / $0.96 per 1MLlama 3.2 3B InstructMeta LlamaNot enough throughput data