Llama 3.1 8B Instruct

Chat Completions

llama-3.1-8b-instruct

Meta Llama|Created May 26, 2025|16.4k context

Chat Completions

Meta’s Llama 3.1 8B instruct-tuned model, designed for fast and efficient dialogue. It performs strongly in human evaluations and is ideal for applications requiring a balance of speed and quality.

Overview Specifications Activity Performance Uptime Examples

Throughput

Time-To-First-Token (TTFT)

Not enough TTFT data

Llama 3.1 8B Instruct Chat Completions API – Performance & Latency Metrics