Benchmark Designers Should 'Train on the Test Set' to Expose Exploitable Non-Visual Shortcuts
DGX agentarXiv:2511.04655v2 Announce Type: replace Abstract: Multimodal LLMs can answer many questions in vision-centric benchmarks without looking at the image, using linguistic priors and skewed answer distr