One request, six sizes for the rate limit
Example request: 2,000 input tokens (1,500 of them cache reads), max_tokens 4,000, an actual answer of 300 tokens including 200 reasoning tokens. Bars to scale in tokens.
max_tokens estimate
input tokens
output tokens (Bedrock: after burndown)
prompt estimate
max_tokens
Azure OpenAI TPM
6,000: prompt estimate plus max_tokens, on arrival
max_tokens, debited up front
OpenAI TPM
4,000: max_tokens, debited before the model runs
300 output x 10 burndown
Bedrock TPM (Claude 5)
3,500: cache reads exempt, output burns 10x
input incl. 1,500 cached
xAI TPM
2,300: every token, cached and reasoning included
input
Gemini TPM
2,000: input only
Anthropic ITPM + OTPM
800: cache reads exempt, output counted as produced
Sources: Azure OpenAI quota guide, OpenAI cookbook, Bedrock token counting page (Claude 5 burndown 10x), xAI, Gemini and Anthropic rate limits pages, fetched 2026-09-03 and 2026-09-04.