Posts tagged over-refusal

1 post about over-refusal.

• Over-Refusal Measured: Most of It Is the Benchmark, Not the Model

  September 28, 2026 · over-refusal · safety · benchmarks · evals

  We ran XSTest and OR-Bench over ten models, then audited the prompts. Only 77 of 200 hard ones were clearly benign, and Opus 5.5 drops from 23% refused to 4%.