Mixtral 8x7B Instruct
Mixtral 8x7B Instruct is a pretrained generative Sparse Mixture of Experts, by Mistral AI, for chat and instruction use. Incorporates 8 experts (feed-forward networks) for a total of 47 billion parameters. Instruct model fine-tuned by Mistral. #moe
Context window
This model accepts 4K tokens in one request (~3K words of text).
What fits in one request
- FitsShort documentAbout 1,500 words of text
- Won't fitLong documentAbout 37K words of text
- Won't fitSmall codebaseAbout 150K words of text
- Won't fitFull novelAbout 375K words of text
Specifications
Context size, pricing, and release info in one place.
- Context window
- 4,096 tokens (4K)
- Max output tokens
- 4,096 tokens (4K)
- Speed tier
- fast
- Provider
- Mistral
- Model family
- Mixtral
- Release date
- Dec 2023
- Input cost
- $0.500/M / 1M tokens
- Output cost
- $0.500/M / 1M tokens
Capabilities
See which features this model supports, such as vision, tools, and streaming.
- Tool use
- Can call external tools and APIs
- Supported
- Function calling
- Structured function call interface
- Supported
- Streaming
- Returns tokens as they are generated
- Supported
- Vision
- Accepts image inputs alongside text
- Not supported
- Extended thinking
- Shows its chain-of-thought reasoning
- Not supported
- Web search
- Can browse the web during a request
- Not supported
- Batch API
- Process many requests asynchronously
- Not supported
- Prompt caching
- Reuse repeated prompt prefixes cheaply
- Not supported
Best for
Jump to a guide or ranking that matches each workload.
Compare Mixtral 8x7B Instruct
Open a side-by-side comparison with one click.
- Mixtral 8x7B Instruct vs Jp Anthropic Claude Sonnet 4 6
Jp Anthropic Claude Sonnet 4 6 has 24314% larger context window
- Mixtral 8x7B Instruct vs Amazon Titan Text Express
Amazon Titan Text Express has 925% larger context window
- Mixtral 8x7B Instruct vs Amazon Titan Text Premier
Amazon Titan Text Premier has 925% larger context window
- Mixtral 8x7B Instruct vs Amazon Titan Text Lite
Amazon Titan Text Lite has 925% larger context window
- Mixtral 8x7B Instruct vs Codellama 34b Instruct
Same context window size
- Mixtral 8x7B Instruct vs Codellama 70b Instruct
Same context window size
Frequently asked questions
Short answers about context size and how this model behaves.
More from Mistral
Other models by Mistral in our catalog.
Powered by Mem0
Use a smaller model.
Get better results.
Mem0 gives your AI long-term memory so you stop re-sending context on every call. That means you can use a smaller, faster, cheaper model — and still get better answers.
Example: a multi-turn chat session
80% less to send — works with any model