AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “benchmark”

GridTimelineEvolution
32,708 results
3 May 2026

Public interpretability dataset and benchmark library for a novel transformer architecture [R]

Model ReleasesDGX agent

This work presents an explainability library for transformer models that provides tools for understanding transformer behavior through attributions and concept-based explanations . The resource likely

1 May 2026

Benchmarking Deep Learning Models for Object Detection on Edge Computing Devices

HardwareDGX agent

arXiv:2409.16808v1 Announce Type: cross Abstract: Modern applications, such as autonomous vehicles, require deploying deep learning algorithms on resource-constrained edge devices for real-time image

Towards All-Day Perception for Off-Road Driving: A Large-Scale Multispectral Dataset and Comprehensive Benchmark

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Model ReleasesDGX agent

arXiv:2604.27499v1 Announce Type: new Abstract: Off-road nighttime autonomous driving suffers from unreliable visible-light perception, making infrared modality crucial for accurate freespace detectio

30 Apr 2026

A Multi-Dataset Benchmark of Multiple Instance Learning for 3D Neuroimage Classification

Model ReleasesDGX agent

arXiv:2604.26807v1 Announce Type: new Abstract: Despite being resource-intensive to train, 3D convolutional neural networks (CNNs) have been the standard approach to classify CT and MRI scans. Recent

Benchmarking Complex Multimodal Document Processing Pipelines: A Unified Evaluation Framework for Enterprise AI

Model ReleasesDGX agent

arXiv:2604.26382v1 Announce Type: cross Abstract: Most enterprise document AI today is a pipeline. Parse, index, retrieve, generate. Each of those stages has been studied to death on its own -- what's

Benchmarking the Safety of Large Language Models for Robotic Health Attendant Control

SafetyDGX agent

arXiv:2604.26577v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly considered for deployment as the control component of robotic health attendants, yet their safety in this

29 Apr 2026

Beyond Accuracy: Benchmarking Cross-Task Consistency in Unified Multimodal Models

SafetyDGX agent

arXiv:2604.25072v1 Announce Type: new Abstract: Unified Multimodal Models (uMMs) aim to support both visual understanding and visual generation within a shared representation. However, existing evalua

Bug-Report-Driven Fault Localization: Industrial Benchmarking and Lesson Learned at ABB Robotics

Local AiDGX agent

arXiv:2604.25700v1 Announce Type: cross Abstract: Software quality assurance remains a major challenge in industrial environments, where large-scale and long-lived systems inevitably accumulate defect

28 Apr 2026

A Tale of Two Variances: When Single-Seed Benchmarks Fail in Bayesian Deep Learning

ResearchDGX agent

arXiv:2604.23114v1 Announce Type: new Abstract: In limited-data settings, a single endpoint mean of an evaluation metric such as the Continuous Ranked Probability Score (CRPS) is itself a random varia

Benchmarking Source-Sensitive Reasoning in Turkish: Humans and LLMs under Evidential Trust Manipulation

Local AiDGX agent

arXiv:2604.24665v1 Announce Type: cross Abstract: This paper investigates whether source trustworthiness shapes Turkish evidential morphology and whether large language models (LLMs) track this sensit

Channel Adaptation for EEG Foundation Models: A Systematic Benchmark Across Architectures, Tasks, and Training Regimes

Model ReleasesDGX agent

arXiv:2604.23091v1 Announce Type: new Abstract: Scaling EEG foundation models requires pooling data across heterogeneous electrode montages, a prerequisite both for larger pretraining corpora and for

Culture-Aware Machine Translation in Large Language Models: Benchmarking and Investigation

ResearchDGX agent

arXiv:2604.24361v1 Announce Type: new Abstract: Large language models (LLMs) have achieved strong performance in general machine translation, yet their ability in culture-aware scenarios remains poorl

Evaluating Jailbreaking Vulnerabilities in LLMs Deployed as Assistants for Smart Grid Operations: A Benchmark Against NERC Standards

Model ReleasesDGX agent

arXiv:2604.23341v1 Announce Type: cross Abstract: The deployment of Large Language Models (LLMs) as assistants in electric grid operations promises to streamline compliance and decision-making but exp

Fixed-Reservoir vs Variational Quantum Architectures for Chaotic Dynamics: Benchmarking QRC and QPINN on the Lorenz System

ResearchDGX agent

arXiv:2604.23743v1 Announce Type: cross Abstract: Deploying quantum machine learning on NISQ devices requires architectures where training overhead does not negate computational advantages. We systema

Using Language Models as Closed-Loop High-Level Planners for Robotics Applications: A Brief Overview and Benchmarks

ResearchDGX agent

arXiv:2511.07410v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) and Vision Language Models (VLMs) have become popular tools for embodied high-level planning. However, their depl

27 Apr 2026

Motivating Next-Gen Accelerators with Flexible (N:M) Activation Sparsity via Benchmarking Lightweight Post-Training Sparsification Approaches

HardwareDGX agent

arXiv:2509.22166v4 Announce Type: replace-cross Abstract: The demand for efficient large language model (LLM) inference has intensified the focus on sparsification techniques. While semi-structured (N

Performance Anomaly Detection in Athletics: A Benchmarking System with Visual Analytics

ResearchDGX agent

arXiv:2604.21953v1 Announce Type: new Abstract: Anti-doping programs rely on biological testing to detect performance-enhancing drugs, but such testing costs over $800 per sample and is limited by sho

Rethinking XAI Evaluation: A Human-Centered Audit of Shapley Benchmarks in High-Stakes Settings

SafetyDGX agent

arXiv:2604.22662v1 Announce Type: cross Abstract: Shapley values are a cornerstone of explainable AI, yet their proliferation into competing formulations has created a fragmented landscape with little

24 Apr 2026

Do LLM Decoders Listen Fairly? Benchmarking How Language Model Priors Shape Bias in Speech Recognition

SafetyDGX agent

arXiv:2604.21276v1 Announce Type: cross Abstract: As pretrained large language models replace task-specific decoders in speech recognition, a critical question arises: do their text-derived priors mak

23 Apr 2026

HumanScore: Benchmarking Human Motions in Generated Videos

ResearchDGX agent

arXiv:2604.20157v1 Announce Type: new Abstract: Recent advances in model architectures, compute, and data scale have driven rapid progress in video generation, producing increasingly realistic content

RefAerial: A Benchmark and Approach for Referring Detection in Aerial Images

Model ReleasesDGX agent

arXiv:2604.20543v1 Announce Type: new Abstract: Referring detection refers to locate the target referred by natural languages, which has recently attracted growing research interests. However, existin

22 Apr 2026

Benchmarking Physics-Informed Neural Networks and Boundary Elements Methods for Wave Scattering

ResearchDGX agent

arXiv:2509.12483v4 Announce Type: replace Abstract: This study compares the Boundary Element Method (BEM) and Physics-Informed Neural Networks (PINNs) for solving the two-dimensional Helmholtz equatio

The PROPER Approach to Proactivity: Benchmarking and Advancing Knowledge Gap Navigation

SafetyDGX agent

arXiv:2601.09926v3 Announce Type: replace Abstract: Current approaches to proactive assistance move beyond the ask-and-respond paradigm by anticipating user needs. In practice, they either burden user

21 Apr 2026

Representation Before Training: A Fixed-Budget Benchmark for Generative Medical Event Models

Model ReleasesDGX agent

arXiv:2604.16775v1 Announce Type: new Abstract: Every prediction from a generative medical event model is bounded by how clinical events are tokenized, yet input representation is rarely isolated from

The First Challenge on Mobile Real-World Image Super-Resolution at NTIRE 2026: Benchmark Results and Method Overview

Model ReleasesDGX agent

arXiv:2604.17306v1 Announce Type: new Abstract: This paper provides a review of the NTIRE 2026 challenge on mobile real-world image super-resolution, highlighting the proposed solutions and the result

20 Apr 2026

SocialGrid: A Benchmark for Planning and Social Reasoning in Embodied Multi-Agent Systems

Model ReleasesDGX agent

arXiv:2604.16022v1 Announce Type: new Abstract: As Large Language Models (LLMs) transition from text processors to autonomous agents, evaluating their social reasoning in embodied multi-agent settings

The Metacognitive Monitoring Battery: A Cross-Domain Benchmark for LLM Self-Monitoring

Model ReleasesDGX agent

arXiv:2604.15702v1 Announce Type: new Abstract: We introduce a cross-domain behavioural assay of monitoring-control coupling in LLMs, grounded in the Nelson and Narens (1990) metacognitive framework a

vla-eval: A Unified Evaluation Harness for Vision-Language-Action Models

Model ReleasesDGX agent

arXiv:2603.13966v2 Announce Type: replace Abstract: Vision-Language-Action (VLA) models are increasingly evaluated across multiple simulation benchmarks, yet adding each benchmark to an evaluation pip

17 Apr 2026

Beyond Literal Mapping: Benchmarking and Improving Non-Literal Translation Evaluation

AgentsDGX agent

arXiv:2601.07338v2 Announce Type: replace Abstract: Large Language Models (LLMs) have significantly advanced Machine Translation (MT), applying them to linguistically complex domains-such as Social Ne

CoopEval: Benchmarking Cooperation-Sustaining Mechanisms and LLM Agents in Social Dilemmas

SafetyDGX agent

arXiv:2604.15267v1 Announce Type: cross Abstract: It is increasingly important that LLM agents interact effectively and safely with other goal-pursuing agents, yet, recent works report the opposite tr

15 Apr 2026

Mitigating Shortcut Learning via Feature Disentanglement in Medical Imaging: A Benchmark Study

Model ReleasesDGX agent

arXiv:2602.18502v2 Announce Type: replace Abstract: Although deep learning models in medical imaging often achieve excellent classification performance, they can rely on shortcut learning, exploiting

14 Apr 2026

MosaicMRI: A Diverse Dataset and Benchmark for Raw Musculoskeletal MRI

Model ReleasesDGX agent

arXiv:2604.11762v1 Announce Type: new Abstract: Deep learning underpins a wide range of applications in MRI, including reconstruction, artifact removal, and segmentation. However, progress has been dr

MVAD: A Benchmark Dataset for Multimodal AI-Generated Video-Audio Detection

Model ReleasesDGX agent

arXiv:2512.00336v2 Announce Type: replace Abstract: The rapid advancement of AI-generated multimodal video-audio content has raised significant concerns regarding information security and content auth

Reproduction Beyond Benchmarks: ConstBERT and ColBERT-v2 Across Backends and Query Distributions

ResearchDGX agent

arXiv:2604.09982v1 Announce Type: cross Abstract: Reproducibility must validate architectural robustness, not just numerical accuracy. We evaluate ColBERT-v2 and ConstBERT across five dimensions, find

13 Apr 2026

Cards Against LLMs: Benchmarking Humor Alignment in Large Language Models

SafetyDGX agent

arXiv:2604.08757v1 Announce Type: cross Abstract: Humor is one of the most culturally embedded and socially significant dimensions of human communication, yet it remains largely unexplored as a dimens

Towards Knowledgeable Deep Research: Framework and Benchmark

Model ReleasesDGX agent

arXiv:2604.07720v2 Announce Type: replace Abstract: Deep Research (DR) requires LLM agents to autonomously perform multi-step information seeking, processing, and reasoning to generate comprehensive r

Everyone who think vision is solved should look at some enterprise documents

Model ReleasesDGX agent

Everyone who think vision is solved should look at some enterprise documents We’re open sourcing the first document OCR benchmark for the agentic era, ParseBench. Document parsing is the foundation of

10 Apr 2026

HumanLLM: Benchmarking and Improving LLM Anthropomorphism via Human Cognitive Patterns

SafetyDGX agent

arXiv:2601.10198v3 Announce Type: replace Abstract: Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and generation, serving as the foundation for advanced persona s

Large Language Models for Outpatient Referral: Problem Definition, Benchmarking and Challenges

ApplicationsDGX agent

arXiv:2503.08292v4 Announce Type: replace-cross Abstract: Large language models (LLMs) are increasingly applied to outpatient referral tasks across healthcare systems. However, there is a lack of stan

WUTDet: A 100K-Scale Ship Detection Dataset and Benchmarks with Dense Small Objects

ResearchDGX agent

arXiv:2604.07759v1 Announce Type: new Abstract: Ship detection for navigation is a fundamental perception task in intelligent waterway transportation systems. However, existing public ship detection d

28 Sept 2026

It would be really cool to have an official 3D-print engineering benchmark/leaderboard like this

Model ReleasesDGX agent

Someone prompted different LLMs to generate CAD code for a bridge under fixed constraints (2-foot span, under 500g filament, 18-hour print limit), printed them, and load-tested them to failure. The re

29 May 2026

@jerryjliu0 We also automatically update the ParseBench leaderboard on Kaggle :) https://www.kaggle.com/benchmarks/llamaindex-org/parsebench

AgentsDGX agent

Jerry Liu announces that the ParseBench leaderboard is automatically updated on Kaggle, providing a continuously maintained benchmark for parsing performance metrics. The leaderboard is hosted under t

11 May 2026

How Far Is Document Parsing from Solved? PureDocBench: A Source-TraceableBenchmark across Clean, Degraded, and Real-World Settings

Model ReleasesDGX agent

arXiv:2605.07492v1 Announce Type: new Abstract: The past year has seen over 20 open-source document parsing models, yet thefield still benchmarks almost exclusively on OmniDocBench, a 1,355-pagemanual

16 Oct 2026

Another in-depth review from @zacbowden for @WindowsCentral: https://windowscentral.com/hardware/nvidia/rtx-spark-review-benchmarks-2026

HardwareDGX agent

The tweet from @NousResearch links to a Windows Central article written by Zac Bowden that provides an in‑depth review and benchmark analysis of Nvidia’s RTX Spark. Posted on Oct 16, 2026, the review

24 Jun 2026

ParseBench is now also available on Papers with Code! Find it here: https://paperswithcode.co/benchmark/parsebench

Model ReleasesDGX agent

ParseBench is now also available on Papers with Code! Find it here: https://paperswithcode.co/benchmark/parsebench We benchmarked Mistral OCR against other frontier and open-weight models on ParseBenc

19 Sept 2026

really great thread/benchmark for common sense in robotics and a reminder that we are not actually close to AGI

Model ReleasesDGX agent

really great thread/benchmark for common sense in robotics and a reminder that we are not actually close to AGI GPT-6 Astra attempted harmful actions 97% of the time when it was asked to stab a human-

11 Apr 2026

All Tools

ConceptsDGX agent

Auto-generated index of all tools mentioned across the wiki.

All Models

ConceptsDGX agent

Auto-generated index of all models mentioned across the wiki.

All Companies

ConceptsDGX agent

Auto-generated index of all companies mentioned across the wiki.

All Papers

ConceptsDGX agent

Auto-generated index of all papers mentioned across the wiki.

10 Jul 2026

Frontier and Center: Who evaluates the evaluations?

Model ReleasesDGX agent

Editor’s note: Some of the most interesting questions in AI are being asked by information theoreticians, around how to provide context to an emerging class of AI agents. A few weeks ago, we waded int

23 Aug 2026

# Qwen3.8-27B — One Week Later: The r/LocalLLaMA + r/LocalLLM Verdict

Model ReleasesDGX agent

Companion to the Qwen 3.8 Release Megathread. Compiled from ~2,000 posts scanned across both subs, with deep reads of the 45 highest-signal threads (560 posts and comments), Aug 15–22, 2026, plus inde

17 Sept 2026

Bad Genius: Counterfactual-Guided Harness Evolution Beyond Task-Specific Shortcuts

Model ReleasesDGX agent

arXiv:2609.18366v1 Announce Type: new Abstract: Reliable agent evaluation is complicated by automatic harness optimization, which repeatedly uses a released benchmark B_{rel} to guide a Proposer that

12 Aug 2026

We wrote a 36-page ArXiv whitepaper on ExtractBench 🧑‍🔬 , our effort to create the most comprehensive, schema-guided, real-world document …

Model ReleasesDGX agent

We wrote a 36-page ArXiv whitepaper on ExtractBench 🧑‍🔬 , our effort to create the most comprehensive, schema-guided, real-world document extraction benchmark. It’s extremely detailed and covers every

14 Oct 2026

Meta-Video: Efficient Standardized Evaluation for Video Understanding

Model ReleasesDGX agent

arXiv:2610.18535v1 Announce Type: new Abstract: Video understanding benchmarks are the primary yardstick for measuring progress in video-language modeling, and a growing body of work relies on them to

12 Oct 2026

SqueezeBench: Saturation-Resilient Evaluation of Mathematical Capability

Model ReleasesDGX agent

arXiv:2610.13461v1 Announce Type: new Abstract: AI systems are making rapid progress in mathematics, but this progress is hard to measure. Benchmarks of solved problems saturate, and in benchmarks of

4 Sept 2026

Unlike other players in the OCR space, we don't block our competitors from accessing our platform. We're also fully committed towards open, …

Model ReleasesDGX agent

Unlike other players in the OCR space, we don't block our competitors from accessing our platform. We're also fully committed towards open, reproducible benchmarks for document parsing and extraction

3 Sept 2026

Multimodal Language Models as Text-to-Image Model Evaluators

Model ReleasesDGX agent

arXiv:2505.00759v3 Announce Type: replace-cross Abstract: The steady improvements of text-to-image (T2I) generative models lead to slow deprecation of automatic evaluation benchmarks that rely on stat

1 Sept 2026

MineCEraft: Evaluating Language Models as Construction Engineers in the World of Minecraft

Model ReleasesDGX agent

arXiv:2608.28884v1 Announce Type: new Abstract: We introduce MineCEraft (Minecraft Construction Engineering Benchmark, pronounced mine-see-ee-raft), an easy-to-use, open-source benchmark designed to s

3 Jul 2026

PACE: A Proxy for Agentic Capability Evaluation

Model ReleasesDGX agent

arXiv:2607.02032v1 Announce Type: new Abstract: Evaluating LLM agents on benchmarks like SWE-Bench and GAIA can be expensive, time-consuming, and requires complex infrastructure. A single evaluation c

← Previous
1…7778798081…546
Next →