Ibmfast

Granite 13b Chat

8K context·~6K words·8K max output

View context details Compare with Amazon Titan Text Express

Context window8Ktokens

Max output8Ktokens

Context window

This model accepts 8K tokens in one request (~6K words of text).

Context window size8K tokens

4K32K128K1M10M

What fits in one request

Short document
About 1,500 words of text
Fits
Long document
About 37K words of text
Won't fit
Small codebase
About 150K words of text
Won't fit
Full novel
About 375K words of text
Won't fit

Specifications

Context size, pricing, and release info in one place.

Context window: 8,192 tokens (8K)
Max output tokens: 8,192 tokens (8K)
Speed tier: fast
Provider: Ibm
Input cost: $0.600/M / 1M tokens
Output cost: $0.600/M / 1M tokens

Capabilities

See which features this model supports, such as vision, tools, and streaming.

Supported (1)

Streaming: Returns tokens as they are generated; Supported

Not supported (7)

Vision: Accepts image inputs alongside text; Not supported
Tool use: Can call external tools and APIs; Not supported
Function calling: Structured function call interface; Not supported
Extended thinking: Shows its chain-of-thought reasoning; Not supported
Web search: Can browse the web during a request; Not supported
Batch API: Process many requests asynchronously; Not supported
Prompt caching: Reuse repeated prompt prefixes cheaply; Not supported

Best for

Jump to a guide or ranking that matches each workload.

Compare Granite 13b Chat

Open a side-by-side comparison with one click.

Frequently asked questions

Short answers about context size and how this model behaves.

Granite 13b Chat has a context window of 8K tokens (8,192 tokens). This is sufficient for most chat, summarization, and moderate document tasks.

More from Ibm

Other models by Ibm in our catalog.

Granite 4 H Small

Granite 13b Instruct

Granite Guardian 3 2 2b

Granite Guardian 3 3 8b

Powered by Mem0

Use a smaller model.
Get better results.

Mem0 gives your AI long-term memory so you stop re-sending context on every call. That means you can use a smaller, faster, cheaper model — and still get better answers.

Calculate your savings Learn about Mem0

Example: a multi-turn chat session

Without Mem0~128K tokens sent

Full history

Repeated info

Old context

With Mem0~20K tokens sent

Key memories

Current turn

80% less to send — works with any model