Llama 3.1 8B Instruct
Review Llama 3.1 8B Instruct on key metrics including price, context length, throughput, and model features.
AuthorMeta Llama
Context Length16.4k
Supports Tools
Meta’s Llama 3.1 8B instruct-tuned model, designed for fast and efficient dialogue. It performs strongly in human evaluations and is ideal for applications requiring a balance of speed and quality.
Activity
Last 14 daysPrompt
747MCompletion
33MTotal
781MStartup
Startup
Latency (p50)-
Throughput (p50)311.9 tok/s
Pricing
Input$0.05/M tokens
Output$0.05/M tokens
Features
Input Modalitiestext
Output Modalitiestext
Supported EndpointsChat Completions
Vision
Supports Tools