WizardLM-2 8x22B
WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models. It is an instruct finetune of [Mixtral 8x22B](/models/mistralai/mixtral-8x22b). To read more about the model release, [click here](https://wizardlm.github.io/WizardLM2/). #moe
Context window
This model accepts 66K tokens in one request (~49K words of text).
What fits in one request
- FitsShort documentAbout 1,500 words of text
- FitsLong documentAbout 37K words of text
- Won't fitSmall codebaseAbout 150K words of text
- Won't fitFull novelAbout 375K words of text
Specifications
Context size, pricing, and release info in one place.
- Context window
- 65,536 tokens (66K)
- Max output tokens
- 65,536 tokens (66K)
- Speed tier
- balanced
- Provider
- Microsoft
- Release date
- Apr 2024
- Input cost
- $0.480/M / 1M tokens
- Output cost
- $0.480/M / 1M tokens
Capabilities
See which features this model supports, such as vision, tools, and streaming.
- Streaming
- Returns tokens as they are generated
- Supported
- Vision
- Accepts image inputs alongside text
- Not supported
- Tool use
- Can call external tools and APIs
- Not supported
- Function calling
- Structured function call interface
- Not supported
- Extended thinking
- Shows its chain-of-thought reasoning
- Not supported
- Web search
- Can browse the web during a request
- Not supported
- Batch API
- Process many requests asynchronously
- Not supported
- Prompt caching
- Reuse repeated prompt prefixes cheaply
- Not supported
Best for
Jump to a guide or ranking that matches each workload.
Compare WizardLM-2 8x22B
Open a side-by-side comparison with one click.
- WizardLM-2 8x22B vs Amazon Titan Text Express
WizardLM-2 8x22B has 56% larger context window
- WizardLM-2 8x22B vs Amazon Titan Text Lite
WizardLM-2 8x22B has 56% larger context window
- WizardLM-2 8x22B vs Amazon Titan Text Premier
WizardLM-2 8x22B has 56% larger context window
- WizardLM-2 8x22B vs Claude Instant
Claude Instant has 52% larger context window
- WizardLM-2 8x22B vs Anthropic Claude
Anthropic Claude has 52% larger context window
- WizardLM-2 8x22B vs Codellama 34b Instruct
WizardLM-2 8x22B has 1500% larger context window
Frequently asked questions
Short answers about context size and how this model behaves.
More from Microsoft
Other models by Microsoft in our catalog.
Powered by Mem0
Use a smaller model.
Get better results.
Mem0 gives your AI long-term memory so you stop re-sending context on every call. That means you can use a smaller, faster, cheaper model — and still get better answers.
Example: a multi-turn chat session
80% less to send — works with any model