meta

Llama-3.1-8B-Instruct

llama

Compact open Llama model for lightweight chat, drafting, and self-hosting

Tool CallingOpen Weights

Context Window

128K

Max Output

4K

Temperature

Yes

Open Weights

Yes

Knowledge Cutoff

2023-12

Released

2024-07-23

Last Updated

2024-07-23

Modalities

Input:Text
→
Output:Text

Available Providers (2)

ProviderInput /1MOutput /1MCache Read /1MCache Write /1MReasoningStatus
InferenceInferenceRp 455Rp 455———Deprecated
Merge GatewayMerge GatewayRp 3.996Rp 3.996————