AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “benchmark”

GridTimelineEvolution
32,708 results
7 Oct 2026

Towards Explainable Benchmarking for Data-driven Post-Wildfire Debris Flow Prediction

Model ReleasesDGX agent

arXiv:2610.07358v1 Announce Type: new Abstract: Post-wildfire debris flows (PFDFs) are destructive sediment-laden hazards triggered when intense rainfall strikes recently burned terrain, destabilizing

6 Oct 2026

DABACO: A Multi-Camera Dataset and Benchmark for Screen Localization and Pointing Estimation

Model ReleasesDGX agent

arXiv:2610.03928v1 Announce Type: new Abstract: Screen localization and pointing estimation are key to low-cost interactive devices. Yet developing and evaluating these algorithms requires realistic d

Does Neural Complexity Improve Health Misinformation Detection? A Leakage-Controlled Cross-Corpus Benchmark

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Model ReleasesDGX agent

arXiv:2610.04636v1 Announce Type: cross Abstract: Increasing architectural complexity is often assumed to improve health misinformation detection, yet reported gains are difficult to interpret when st

EXHIB: A Benchmark for Realistic and Diverse Evaluation of Function Similarity in the Wild

Model ReleasesDGX agent

arXiv:2604.01554v2 Announce Type: replace-cross Abstract: Binary Function Similarity Detection (BFSD) is a core problem in software security, supporting tasks such as vulnerability analysis, malware c

RMMBench: A Comprehensive Benchmark for Robotic Mobile Manipulation

Model ReleasesDGX agent

arXiv:2610.05414v1 Announce Type: new Abstract: Although the advancement of vision-language models (VLMs) has endowed robots with enhanced environmental understanding and task reasoning, a comprehensi

Same Pieces, Different Servers: A Tetris Benchmark for AI Agents as Served

Model ReleasesDGX agent

arXiv:2603.02348v2 Announce Type: replace Abstract: An agent meets a model as served: through an endpoint with a price card, a shared cache and other tenants, or on whatever hardware a self-hosted mod

SkillScriptBench: Benchmarking Self-Evolution of Executable Agent Skill Packages Beyond Markdown

Model ReleasesDGX agent

arXiv:2610.04008v1 Announce Type: cross Abstract: Executable Agent Skills combine natural-language instructions and scripts into reusable packages for LLM agents, and revising them requires fixing err

5 Oct 2026

A Benchmark for Spatially Grounded Gesture Generation

Model ReleasesDGX agent

arXiv:2610.03105v1 Announce Type: new Abstract: Communication in shared space interweaves verbal and non-verbal signals, and pointing gestures anchor language to the environment: 'put the cup on that

Benchmarking Candidate Coverage in Typed Decision Models

Model ReleasesDGX agent

arXiv:2610.03387v1 Announce Type: new Abstract: Typed decision models return choices or distributions over answer options supplied at request time. Accuracy with complete options does not establish wh

RNADyn: A Benchmark for Generating and Understanding RNA Dynamics

Model ReleasesDGX agent

arXiv:2610.03712v1 Announce Type: new Abstract: Ribonucleic acid (RNA) functions through conformational changes that are not fully captured by static structures. However, large-scale standardized RNA

TPBench: A Turning-Point Benchmark for Dialogue Compression

Model ReleasesDGX agent

arXiv:2610.02736v1 Announce Type: cross Abstract: A compressor can keep the facts of a dialogue and still drop the turn that changed them. A user corrects a price, reverses a choice, or adds a constra

2 Oct 2026

Benchmarking System One decision models against trained classifiers and language models for automated decision gates

ResearchDGX agent

arXiv:2610.00346v1 Announce Type: new Abstract: Software that hands branching decisions to a model needs a declared option and a probability it can threshold. Typed decision models, also called System

Bounded-Fidelity Sim-as-Demo-Stage: Mocap Handoff for Governance Benchmarks

Model ReleasesDGX agent

arXiv:2610.00008v1 Announce Type: cross Abstract: Sim-to-real research pursues physics fidelity as a primary objective: simulators are judged by how closely they reproduce real-world contact dynamics.

DuplexSpeechBench-Document Grounding: Benchmarking Document Grounding and Hallucinations in Voice Agents

Model ReleasesDGX agent

arXiv:2610.00316v1 Announce Type: cross Abstract: Voice agents enable low-latency, natural interaction, yet their ability to faithfully ground responses in external documents remains underexplored. We

HumanoidToolBench: Benchmarking Humanoid Tool Use from Selection to Mobile Execution

Model ReleasesDGX agent

arXiv:2610.02089v1 Announce Type: cross Abstract: As robotic hardware and learning methods advance, humanoids need tools to perform tasks beyond their inherent physical limits. Successful tool use req

TrueMuse: A Benchmark for Data Attribution in Text-to-Music Models

Model ReleasesDGX agent

arXiv:2610.00835v1 Announce Type: new Abstract: Text-to-music generation models are trained on massive music collections, creating a growing need for data attribution methods that can quantify the con

VoxelSynth3D: Interpretable Volumetric Image-Domain Metal Artifact Reduction with a Paired Synthetic CLINIC-Metal Benchmark

Model ReleasesDGX agent

arXiv:2610.01512v1 Announce Type: new Abstract: Metal artifacts in postoperative musculoskeletal CT obscure bone-implant and adjacent soft-tissue interfaces. Many metal artifact reduction (MAR) method

1 Oct 2026

A Comprehensive Benchmark of Source-Free Universal Domain Adaptation on Time Series Representations

Model ReleasesDGX agent

arXiv:2609.39810v1 Announce Type: new Abstract: Source-Free Universal Domain Adaptation (SF-UniDA) extends Universal Domain Adaptation by removing access to source data at adaptation time while still

Trustworthy Runtime Error Healing in Real-World Repositories: A Benchmark and Guardrail

Model ReleasesDGX agent

arXiv:2609.39086v1 Announce Type: cross Abstract: Runtime error healing lets a crashed program continue by generating code that repairs its live runtime state. Recent work shows that LLMs can generate

30 Sept 2026

A Benchmark & Dataset for Detecting AI-Manipulated Visual Evidence in the Court System

Model ReleasesDGX agent

arXiv:2609.37783v1 Announce Type: cross Abstract: Photographic evidence is becoming increasingly vulnerable to forms of alteration and fabrication that existing legal and technical workflows are not w

A Skill-augmented Agentic Framework and Benchmark for Multi-Video Understanding

Model ReleasesDGX agent

arXiv:2603.14733v2 Announce Type: replace Abstract: Multimodal Large Language Models have achieved strong performance in single-video understanding, yet their ability to reason across multiple videos

Benchmarking Automatic Speech Recognition Tools for Iberian Languages

Model ReleasesDGX agent

arXiv:2609.36920v1 Announce Type: new Abstract: Comprehensive evaluations of automatic speech recognition (ASR) for Iberian languages remain limited, and low-resource languages, biases, and efficiency

Benchmarking graph-based models for in-silico toxicity prediction in drug discovery

TutorialsDGX agent

arXiv:2609.37555v1 Announce Type: new Abstract: Drug discovery is a costly and high-risk process, where toxicity-related failures remain a major cause of attrition in both preclinical and clinical sta

Does Local Video Understanding Transfer Across Encounters? The EgoGears Benchmark

Model ReleasesDGX agent

arXiv:2609.37938v1 Announce Type: cross Abstract: Embodied systems must make knowledge acquired during one encounter usable in another despite changes in viewpoint, motion, and illumination. Yet aggre

Evaluation Choices Shape Biomedical ML Claims: A Pediatric Pneumonia Benchmark Case Study

Model ReleasesDGX agent

arXiv:2609.37848v1 Announce Type: new Abstract: Biomedical machine learning papers often compress model performance into one headline number. That number can look like a property of the model even whe

Event-Only Wingbeat Counting under Camera Motion: A Controlled MuJoCo Benchmark

Model ReleasesDGX agent

arXiv:2609.37465v1 Announce Type: new Abstract: Counting completed wingbeats requires identifying individual cycles, including during frequency changes and pauses; estimating a dominant frequency alon

From Laboratory to Real World: A New Benchmark Towards Privacy-Preserved Visible-Infrared Person Re-Identification

Model ReleasesDGX agent

arXiv:2503.12232v3 Announce Type: replace Abstract: Aiming to match pedestrian images captured under varying lighting conditions, visible-infrared person re-identification (VI-ReID) has drawn intensiv

OmniVCBench: Benchmarking Evidence-Grounded Multimodal Reasoning Towards AI Virtual Cells

Model ReleasesDGX agent

arXiv:2609.37773v1 Announce Type: new Abstract: Artificial Intelligence Virtual Cells (AIVCs) are envisioned as scientific agents that simulate cellular responses, explain underlying mechanisms, and s

PowerMarketJax: A JAX Benchmark Suite for Multi-Agent Reinforcement Learning in Power Markets

Model ReleasesDGX agent

arXiv:2609.37321v1 Announce Type: cross Abstract: Power markets are a natural testbed for multi-agent reinforcement learning (MARL), where multiple self-interested participants repeatedly submit bids.

PowerZooJax: A JAX-based Power System Benchmark for Reinforcement Learning

Model ReleasesDGX agent

arXiv:2609.36052v1 Announce Type: new Abstract: Power system operation is a safety-critical sequential decision-making problem, making it a natural testbed for reinforcement learning (RL). However, ex

RoboChrono: A Real Robot Benchmark for Streaming Task Understanding

Model ReleasesDGX agent

arXiv:2609.36605v1 Announce Type: new Abstract: Understanding ongoing robot manipulation requires models to interpret visual observations in relation to interaction history and task progress. We intro

VISTA-Bench: Benchmarking Multilingual Image Translation with Image-Specific Rubrics

Model ReleasesDGX agent

arXiv:2609.37287v1 Announce Type: cross Abstract: Image translation is a fundamental capability of multimodal models for multilingual applications, requiring visual understanding and meaning preservat

VLM4Cluster: Benchmarking Deep Clustering In the Era of Vision-Language Pre-training

Model ReleasesDGX agent

arXiv:2609.36648v1 Announce Type: new Abstract: Vision-language pre-training has reshaped image clustering, giving rise to language-assisted image clustering (LaIC), which leverages textual semantics

29 Sept 2026

A Large-Scale Benchmark and Risk Assessment of Traffic Analysis Attacks on Cloud LLM Services

Model ReleasesDGX agent

arXiv:2609.31877v1 Announce Type: cross Abstract: Cloud-based Large language model (LLM) services create a network-level traffic side channel that can expose model, prompt, and task behavior despite e

A Multi-Dataset Benchmark of YOLO-Based Weed Detection in Precision Agriculture

Model ReleasesDGX agent

arXiv:2609.33991v1 Announce Type: new Abstract: Weed detection is an important component of precision agriculture, enabling site-specific weed management and reducing unnecessary herbicide use. Althou

AevaScenes: An FMCW LiDAR Dataset and Benchmark for Long-Range Perception

Model ReleasesDGX agent

arXiv:2609.33230v1 Announce Type: new Abstract: FMCW LiDAR measures per-point radial Doppler velocity alongside range, providing a motion cue unavailable in conventional time-of-flight sensors. Exploi

Are We Making Progress in Multimodal Domain Generalization? A Comprehensive Benchmark Study

Model ReleasesDGX agent

arXiv:2605.06643v2 Announce Type: replace Abstract: Despite the growing popularity of Multimodal Domain Generalization (MMDG) for enhancing model robustness, it remains unclear whether reported perfor

Benchmarking EEG Foundation Models at Scale: Lessons from 20,000 Evaluations

Model ReleasesDGX agent

arXiv:2609.32743v1 Announce Type: new Abstract: Electroencephalography (EEG) foundation models (FMs) promise transferable neural representations, yet their advantages over strong supervised baselines

CLIMB: A Clinical Multimorbidity Benchmark for Diagnosing Co-occurring Conditions through Multiturn Conversations

Model ReleasesDGX agent

arXiv:2609.35462v1 Announce Type: new Abstract: Patients often have several co-occurring clinical conditions, and the findings needed to identify and disambiguate them emerge over the course of a cons

ECG-Scroll: A Long-Horizon, Streaming Benchmark and Agent Environment for Interpretation of Ambulatory Electrocardiograms

Model ReleasesDGX agent

arXiv:2609.33117v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) can now interpret a standard ten-second, twelve-lead electrocardiogram (ECG) with clinically grounded, reward-v

ForVis: An In-Field Dataset and Benchmark for VIO Using Under-Canopy UAV Flights in Forests

Model ReleasesDGX agent

arXiv:2609.35482v1 Announce Type: new Abstract: Visual-inertial Simultaneous Localization and Mapping (VI-SLAM) for UAVs remains difficult to evaluate in real forest environments, where motion, illumi

Long Time No See: Benchmarking VLMs for Out-of-Sight Spatiotemporal Reasoning in Egocentric Videos

Model ReleasesDGX agent

arXiv:2609.34630v1 Announce Type: new Abstract: Real-world AI systems must reason about objects that are no longer visible: an AR assistant guiding a user back to an object used earlier, a household r

MixBench-TS: A Multivariate Time Series Forecasting Benchmark Where Channel Mixing Pays Off

Model ReleasesDGX agent

arXiv:2609.32656v1 Announce Type: cross Abstract: Multivariate Time Series Forecasting (MTSF) models that mix information across channels assume that the past of one channel carries information about

OmniSmartHome: A Multimodal Reasoning Benchmark for Smart-Home Agents

Model ReleasesDGX agent

arXiv:2609.32569v1 Announce Type: new Abstract: Smart-home assistants are expected to handle diverse, realistic requests that arise in daily life. In such interactions, users often rely on the surroun

PolyTopoBench: A Benchmark for Complex Vector Polygon Generation from Remote Sensing Imagery

Model ReleasesDGX agent

arXiv:2609.32856v1 Announce Type: new Abstract: Vector polygon generation converts visual inputs, e.g., remote sensing (RS) images, into vectorized polygonal geometries, supporting applications such a

SleuthBench: Benchmarking Statistical LLM Evaluation Using Tabular Hidden Signals

Model ReleasesDGX agent

arXiv:2609.34228v1 Announce Type: new Abstract: Evaluating statistical discovery by large language model (LLM) agents requires verifiable analytical ground truth. Establishing such ground truth for re

SolveEdit: Benchmarking Visual Problem Solving in Generative Models

Model ReleasesDGX agent

arXiv:2609.35504v1 Announce Type: new Abstract: Machine intelligence is often evaluated through abstract reasoning problems, yet many real-world problems are visual, such as arranging objects, repairi

TRACE: Expert-Aligned ECG Representation Learning with Rigorous Benchmarking and Real-World Validation in Acute Cardiac Care

Model ReleasesDGX agent

arXiv:2609.34088v1 Announce Type: new Abstract: TRACE (Text-Reinforced Analysis of Cardio ECGs) is a multimodal electrocardiogram (ECG) representation model that learns clinically grounded signal embe

VEX-Bench: Benchmarking Verification Complexity of LLM-Generated Misinformation

Model ReleasesDGX agent

arXiv:2609.35028v1 Announce Type: new Abstract: Large language models (LLMs) have made misinformation inexpensive to produce but not to verify, creating a growing asymmetry in the information ecosyste

ZeroGAR: Benchmarking the Adversarial Robustness of Zero-Shot Graph Models

Model ReleasesDGX agent

arXiv:2609.33314v1 Announce Type: new Abstract: Zero-shot graph models (ZGMs), which learn transferable knowledge from source graphs and directly apply to unseen target graphs without any adaptation,

28 Sept 2026

A Benchmarking Framework for Context-aware XR Interfaces

ResearchDGX agent

arXiv:2609.30466v1 Announce Type: cross Abstract: Everyday Extended Reality (XR) systems aim to provide context-aware access to the right functionalities at the right time and place, with minimal manu

Auditing System-1 Models on Biosecurity-Relevant Benchmarks: Calibration, Selective Prediction, and Permutation Instability in a Non-Generative Model

ResearchDGX agent

arXiv:2609.30454v1 Announce Type: new Abstract: Non-generative 'System-1' models return structured probabilistic decisions in a single forward pass, without autoregressive decoding, at a small fractio

Benchmarking the Connectomes of Caenorhabditis elegans within the Reservoir Computing Framework

Model ReleasesDGX agent

arXiv:2609.30508v1 Announce Type: new Abstract: The aim of this work is to examine the connectomes of Caenorhabditis elegans through a computational lens using the reservoir computing framework. Conne

JevAdvBench: A Benchmark and Black-Box Attacks for Reinforcement Learning for Calibrated Decisions Models

Model ReleasesDGX agent

arXiv:2609.31142v1 Announce Type: cross Abstract: Models trained with reinforcement learning for calibrated decisions (RLCD), such as Jev, answer a typed question about an input, the state, with a pro

RefRef: A Dataset and Benchmark for Reconstructing Refractive and Reflective Objects

Model ReleasesDGX agent

arXiv:2505.05848v3 Announce Type: replace Abstract: Modern 3D reconstruction and novel view synthesis approaches have demonstrated strong performance on scenes with opaque, non-refractive objects. How

UltraG-Bench: A Multi-task Benchmark for assessing Large Vision-Language Models on Pixel-level Evidence Grounding in Ultrasound

Model ReleasesDGX agent

arXiv:2609.30928v1 Announce Type: cross Abstract: Ultrasound is one of the most widely used medical imaging modalities, and recent large vision-language models(VLMs) have shown increasing capabilities

25 Sept 2026

Benchmarking and Domain Adaptation of Automatic Speech Recognition (ASR) for Adolescent Health Communication in Ghanaian Languages

Model ReleasesDGX agent

arXiv:2609.29798v1 Announce Type: cross Abstract: This paper presents an end-to-end study of automatic speech recognition (ASR) for adolescent health communication in three Ghanaian languages (Twi, Da

COILD: An Indic-Centric Parallel Corpus and Benchmark for Machine Translation Across Indian Languages

Model ReleasesDGX agent

arXiv:2609.28826v1 Announce Type: new Abstract: Machine translation (MT) for Indian languages remains constrained by the limited availability of high-quality, Indic-centric parallel corpora and evalua

Delay-of-Gratification as a Multi-Agent Survival Micro-benchmark for Long-Horizon LLMs: Social Exposure, Personas, and Tool Use Budgets

Model ReleasesDGX agent

arXiv:2609.29509v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed as multi-turn agents that must sustain goals, use tools, and adapt to other agents over extended

EnSiTa - A Trilingual Multi-Domain Parallel Dataset and Benchmark for Domain-Specific Machine Translation

Model ReleasesDGX agent

arXiv:2609.29511v1 Announce Type: new Abstract: Machine Translation (MT) for low-resource languages remains far behind that of high-resource languages, and the gap is widest in specialised domains, wh

← Previous
1…4748495051…546
Next →