Context Window

Compare

Meta Llama 3 1 8b vs Meta Llama3 2 90b Instruct

This page is context-first: how much text each model can take in one request. Full specs adds capabilities and limits; the pricing matrix below is only about $/million tokens from hosts that list both models.

Meta

Model

Meta Llama 3 1 8b

Context window

128K

128,000 tokens · ~96K words

Model page
Meta

Model

Meta Llama3 2 90b Instruct

Image inputTool calling

Context window

128K

128,000 tokens · ~96K words

Model page

Context window · side by side

Bar length is relative to the larger of the two windows (100% = max of this pair). This is not pricing.

Meta Llama 3 1 8b128K
Meta Llama3 2 90b Instruct128K

Same context window size for both models.

Token calculator →Memory savings →

Meta Llama 3 1 8b and Meta Llama3 2 90b Instruct have identical context windows (128K tokens). Meta Llama 3 1 8b is 98% cheaper on input.

Quick verdicts

Short takeaways — validate with your own workloads.

  • RAG / high-volume retrieval

    Use Meta Llama 3 1 8b. Input tokens are 98% cheaper — critical when sending large retrieved contexts.

  • Long output (reports, code files)

    Use Meta Llama3 2 90b Instruct. Its 4K max output lets you generate complete artifacts in one request.

Full specs

Context, output, capabilities, and dates. Green highlights the favorable value where we compute a winner.

SpecMeta Llama 3 1 8bMeta Llama3 2 90b Instruct
Context window128,000 tokens (128K)128,000 tokens (128K)
Max output tokens2,048 tokens (2K)4,096 tokens (4K)
Speed tierFastBalanced
VisionNoYes
Function callingNoYes
Extended thinkingNoNo
Prompt cachingNoNo
Batch APINoNo
Release dateN/AN/A

Pricing matrix

Dollar rates only: hosts that list both models, per 1M tokens. For how much text fits, use the context section above — not this table.

ProviderMeta Llama 3 1 8b inMeta Llama 3 1 8b outMeta Llama3 2 90b Instruct inMeta Llama3 2 90b Instruct out
Aws Bedrock——$2.00/M$2.00/M
Azure$0.300/M$0.610/M——
Deepinfra$0.030/M$0.050/M——
Friendliai$0.100/M$0.100/M——
Hyperbolic$0.120/M$0.300/M——
Nebius$0.020/M$0.060/M——
Sambanova$0.100/M$0.200/M——

Frequently asked questions

Meta Llama3 2 90b Instruct has a larger context window: 128K tokens vs 128K. For long documents, large codebases, or extended agent sessions, the larger context window reduces the need to chunk inputs or summarize history.

Powered by Mem0

Use a smaller model.
Get better results.

Mem0 gives your AI long-term memory so you stop re-sending context on every call. That means you can use a smaller, faster, cheaper model — and still get better answers.

Calculate your savingsLearn about Mem0

Example: a multi-turn chat session

Without Mem0~128K tokens sent
Full history
Repeated info
Old context
With Mem0~20K tokens sent
Key memories
Current turn

80% less to send — works with any model