Posts tagged tokenizer

4 posts about tokenizer.

• How Many Tokens Is a PDF? 4 Vendors, 4 Rules, 15 to 2,100 a Page

  October 12, 2026 · pdf-input · document-input · tokenizer · pricing

  GPT-6 bills a PDF page as its text. Claude adds 1,558 tokens a page, Qwen 2,098, and Gemini charges a flat 515 with text free. Six measured ways to pay less.

• How Many Tokens Is an Image? 15 APIs Measured, Same Icon 6 to 1,298

  August 14, 2026 · vision · image-input · tokenizer · pricing

  The same 64px icon bills 6 tokens on GPT-5.6 and 1,298 on ByteDance Seed. Three billing schemes, three broken doc rules; dollars follow the rate, not the image.

• Which LLM Is Cheapest for Your Language? Tokenizer Costs Measured

  July 8, 2026 · claude-fable-5 · tokenizer · llm-cost · i18n

  GPT-5.5 bills fewest tokens for European languages, Kimi for Chinese, DeepSeek for Japanese; Claude Fable 5, Opus 4.8 and Sonnet 5 run 1.2-2.3x. Measured.

• Claude Fable 5 Caching: Same Contract, 2.9x the Bill vs Opus 4.6

  June 10, 2026 · claude-fable-5 · prompt-cache · tokenizer · model-update

  Claude Fable 5 is live on Synthorai. Measured prompt caching, TTL, tokenization and cost vs Opus 4.6/4.8: same cache contract, new tokenizer, ~2.9x the bill.