Llama 3.1 70B Instruct

Chat Completions

llama-3.1-70b-instruct

Meta Llama|Created May 26, 2025|131.1k context

Chat Completions

Meta’s Llama 3.1 70B instruct-tuned model, optimized for high-quality dialogue use cases. It demonstrates strong performance in human evaluations and is suitable for a wide range of conversational AI applications.

Overview Specifications Activity Performance Uptime Examples

Throughput

Not enough throughput data

Time-To-First-Token (TTFT)

Not enough TTFT data

Llama 3.1 70B Instruct Chat Completions API – Performance & Latency Metrics