My issue with Artificial Analysis's 'intelligence index'

I swear AA is not the bipartisan they so claim. An open source mode (Qwen 3.8 max) was number 1 on the agentic index, then they just so happen to launch "v4.1.1" of their index in which they just adjusted the weights of the gdpval and t3 banking so that it would be lower than opus, despite the lead in t3 being a 8% lead over opus while opus only has a 5% lead on gdpval. Highly likely to be paid off imo. You can check other subreddits for the score before and after the change, just made it so an open source model would lost and anthropic would continue being number one submitted by /u/Infinite-Local5435 [link] [comments]

Source: r/LocalLLaMA | 2026-08-07