Research
BenchMIRT: What are LLM benchmarks actually measuring?
BenchMIRT is a new method for auditing LLM benchmarks question by question, revealing which capabilities they actually measure and helping researchers build smaller, more focused, and easier-to-interp
BenchMIRT is a new method for auditing LLM benchmarks question by question, revealing which capabilities they actually measure and helping researchers build smaller, more focused, and easier-to-interpret evaluations.
Related
- IG-Lens: Exact Additive Probability Attribution Across Transformer Layers via Telescoping Integrated Gradients
- What Do Audio-Visual Synchronization Metrics Actually Measure?
- ContextGuard: Structured Self-Auditing for Context Learning in Language Models
- Encoded but Not Actionable: Auditing the Decode-Generate-Steer Gap in Frozen LLMs for Geometric Constraints
Source: Ai2 | 2026-09-01