Posts tagged llm-gateway

5 posts about llm-gateway.

• GLM 5.2 Tool Calls in Agent Loops: What 'OpenAI-Compatible' Hides

  June 30, 2026 · glm-5.2 · tool-calling · agents · llm-gateway

  GLM 5.2 speaks the OpenAI tool-calling API, but text rides with the tool calls and reasoning shows on the turn. How it lines up against OpenAI and Anthropic.

• GLM 5.2 Reasoning Effort: the Setting That Cuts Cost 20x (Measured)

  June 24, 2026 · glm · coding · llm-gateway · cost · reasoning

  Same coding answer: $0.0031 with reasoning effort set right vs $0.062 on GLM 5.2's unbounded default. 20x cheaper, 30x faster. How to set the dial per task.

• What Actually Drives Your Image-Generation Bill

  June 19, 2026 · image-generation · billing · llm-gateway · cost

  Image-generation cost on an LLM gateway, measured across model, resolution and quality. Quality, not caching, decides per-token vs per-image billing.

• Provider Drift: How Default Routing Inflates LLM Cost

  June 5, 2026 · prompt-cache · llm-gateway · routing

  On a multi-provider gateway's default routing, identical requests scatter across upstreams with separate caches. Hit rate craters and your bill climbs.

• Does Your LLM Gateway Lie About Cache? A 5-Min Audit

  June 2, 2026 · llm-gateway · prompt-cache · observability

  Gateways can report cache hits while billing full price. One script audits both auto-cache (DeepSeek) and marker-based (Claude) caching in five minutes.