Llama 3.1 70B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong performance compared to leading closed-source models in human evaluations. To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).
Context window
This model accepts 131K tokens in one request (~98K words of text).
What fits in one request
- FitsShort documentAbout 1,500 words of text
- FitsLong documentAbout 37K words of text
- Won't fitSmall codebaseAbout 150K words of text
- Won't fitFull novelAbout 375K words of text
Specifications
Context size, pricing, and release info in one place.
- Context window
- 131,072 tokens (131K)
- Speed tier
- deep
- Provider
- Meta
- Model family
- Llama 3.1
- Release date
- Jul 2024
Capabilities
See which features this model supports, such as vision, tools, and streaming.
- Tool use
- Can call external tools and APIs
- Supported
- Function calling
- Structured function call interface
- Supported
- Streaming
- Returns tokens as they are generated
- Supported
- Vision
- Accepts image inputs alongside text
- Not supported
- Extended thinking
- Shows its chain-of-thought reasoning
- Not supported
- Web search
- Can browse the web during a request
- Not supported
- Batch API
- Process many requests asynchronously
- Not supported
- Prompt caching
- Reuse repeated prompt prefixes cheaply
- Not supported
Best for
Jump to a guide or ranking that matches each workload.
Compare Llama 3.1 70B Instruct
Open a side-by-side comparison with one click.
- Llama 3.1 70B Instruct vs Codellama 34b Instruct
Llama 3.1 70B Instruct has 3100% larger context window
- Llama 3.1 70B Instruct vs Codellama 70b Instruct
Llama 3.1 70B Instruct has 3100% larger context window
- Llama 3.1 70B Instruct vs Llama 2 13b Chat
Llama 3.1 70B Instruct has 3100% larger context window
- Llama 3.1 70B Instruct vs Llama 2 70b Chat
Llama 3.1 70B Instruct has 3100% larger context window
- Llama 3.1 70B Instruct vs Amazon Titan Text Express
Llama 3.1 70B Instruct has 212% larger context window
- Llama 3.1 70B Instruct vs Amazon Titan Text Lite
Llama 3.1 70B Instruct has 212% larger context window
Frequently asked questions
Short answers about context size and how this model behaves.
More from Meta
Other models by Meta in our catalog.
Powered by Mem0
Use a smaller model.
Get better results.
Mem0 gives your AI long-term memory so you stop re-sending context on every call. That means you can use a smaller, faster, cheaper model — and still get better answers.
Example: a multi-turn chat session
80% less to send — works with any model