Llama 3.1 8B Instruct

Name: Llama 3.1 8B Instruct
Brand: Meta
SKU: meta/llama-3.1-8b-instruct

meta/llama-3.1-8b-instructPOST /v1/chat/completions

Small, extremely cheap open-weights model. The floor of the catalogue for simple classification work.

Tool callingStructured outputStreaming

Try this model Compare

Input / 1M

$0.0200

via DeepInfra

Output / 1M

$0.0400

via DeepInfra

Cached input / 1M

—

not published

Context

131K

max out 131K

Providers

failover available

3 providers serve this model

Multigrid picks between them on every request using your policy. Each price is what that route costs us, and we add no spread of our own to it.

Pin a provider

Provider	Upstream model id	In / 1M	Out / 1M	Billing
DeepInfraCheapest	meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo	$0.0200	$0.0400	Credit
Groq	llama-3.1-8b-instant	$0.0500	$0.0800	Credit
OpenRouter	meta-llama/llama-3.1-8b-instruct	$0.0500	$0.0800	Credit

No performance data published yet

Time to first token, throughput and uptime are measurements, and Multigrid has not served enough traffic through Llama 3.1 8B Instruct to publish honest ones. When it has, they will appear here per provider, taken from real requests. Nothing on this page is estimated: prices, context window and capabilities all come from the provider’s own documentation.

Call it

Same request shape as every other model in the catalogue.

example.ts

const res = await client.chat.completions.create({
  model: "meta/llama-3.1-8b-instruct",
  messages: [{ role: "user", content: "Hello" }],
  route: {
    // pin, exclude or order the providers below
    providers: ["deepinfra", "groq", "openrouter"],
    sort: "price",
  },
});

Chat completions reference Provider preferences

Send Llama 3.1 8B Instruct a real request

Signing up takes no card and commits you to nothing — you start at a zero balance, so nothing can be charged until you decide to add credit. The playground opens on Llama 3.1 8B Instruct and prices every answer as it arrives, at the rate shown above — what the route costs us, with nothing of ours added. Already have an account? The second button skips the form.

Create an account Open the playground