AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “benchmark”

GridTimelineEvolution
32,708 results
14 Apr 2026

Exploring the best way for UAV visual localization under Low-altitude Multi-view Observation Condition: a Benchmark

Model ReleasesDGX agent

arXiv:2503.10692v2 Announce Type: replace Abstract: Absolute Visual Localization (AVL) enables an Unmanned Aerial Vehicle (UAV) to determine its position in GNSS-denied environments by establishing ge

Knowing What to Stress: A Discourse-Conditioned Text-to-Speech Benchmark

Model ReleasesDGX agent

arXiv:2604.10580v1 Announce Type: new Abstract: Spoken meaning often depends not only on what is said, but also on which word is emphasized. The same sentence can convey correction, contrast, or clari

LookBench: A Live and Holistic Open Benchmark for Fashion Image Retrieval

Model ReleasesDGX agent
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

arXiv:2601.14706v3 Announce Type: replace Abstract: In this paper, we present LookBench (We use the term 'look' to reflect retrieval that mirrors how people shop -- finding the exact item, a close sub

ReXSonoVQA: A Video QA Benchmark for Procedure-Centric Ultrasound Understanding

Model ReleasesDGX agent

arXiv:2604.10916v1 Announce Type: cross Abstract: Ultrasound acquisition requires skilled probe manipulation and real-time adjustments. Vision-language models (VLMs) could enable autonomous ultrasound

Simulating Organized Group Behavior: New Framework, Benchmark, and Analysis

Model ReleasesDGX agent

arXiv:2604.09874v1 Announce Type: new Abstract: Simulating how organized groups (e.g., corporations) make decisions (e.g., responding to a competitor's move) is essential for understanding real-world

SPEED-Bench: A Unified and Diverse Benchmark for Speculative Decoding

Model ReleasesDGX agent

arXiv:2604.09557v1 Announce Type: cross Abstract: Speculative Decoding (SD) has emerged as a critical technique for accelerating Large Language Model (LLM) inference. Unlike deterministic system optim

SRBench: A Comprehensive Benchmark for Sequential Recommendation with Large Language Models

Model ReleasesDGX agent

arXiv:2604.09553v1 Announce Type: cross Abstract: LLM development has aroused great interest in Sequential Recommendation (SR) applications. However, comprehensive evaluation of SR models remains lack

Unified Removal of Raindrops and Reflections: A New Benchmark and A Novel Pipeline

Model ReleasesDGX agent

arXiv:2603.16446v3 Announce Type: replace Abstract: When capturing images through glass surfaces or windshields on rainy days, raindrops and reflections frequently co-occur to significantly reduce the

13 Apr 2026

Compositional-Degradation UAV Image Restoration: Conditional Decoupled MoE Network and A Benchmark

Model ReleasesDGX agent

arXiv:2604.09313v1 Announce Type: cross Abstract: UAV images are critical for applications such as large-area mapping, infrastructure inspection, and emergency response. However, in real-world flight

LuMon: A Comprehensive Benchmark and Development Suite with Novel Datasets for Lunar Monocular Depth Estimation

Model ReleasesDGX agent

arXiv:2604.09352v1 Announce Type: new Abstract: Monocular Depth Estimation (MDE) is crucial for autonomous lunar rover navigation using electro-optical cameras. However, deploying terrestrial MDE netw

MedConceal: A Benchmark for Clinical Hidden-Concern Reasoning Under Partial Observability

Model ReleasesDGX agent

arXiv:2604.08788v1 Announce Type: new Abstract: Patient-clinician communication is an asymmetric-information problem: patients often do not disclose fears, misconceptions, or practical barriers unless

R2G: A Multi-View Circuit Graph Benchmark Suite from RTL to GDSII

Model ReleasesDGX agent

arXiv:2604.08810v1 Announce Type: new Abstract: Graph neural networks (GNNs) are increasingly applied to physical design tasks such as congestion prediction and wirelength estimation, yet progress is

SEA-Eval: A Benchmark for Evaluating Self-Evolving Agents Beyond Episodic Assessment

Model ReleasesDGX agent

arXiv:2604.08988v1 Announce Type: new Abstract: Current LLM-based agents demonstrate strong performance in episodic task execution but remain constrained by static toolsets and episodic amnesia, faili

TaxPraBen: A Scalable Benchmark for Structured Evaluation of LLMs in Chinese Real-World Tax Practice

Model ReleasesDGX agent

arXiv:2604.08948v1 Announce Type: new Abstract: While Large Language Models (LLMs) excel in various general domains, they exhibit notable gaps in the highly specialized, knowledge-intensive, and legal

Temporal Dropout Risk in Learning Analytics: A Harmonized Survival Benchmark Across Dynamic and Early-Window Representations

Model ReleasesDGX agent

arXiv:2604.08870v1 Announce Type: cross Abstract: Student dropout is a persistent concern in Learning Analytics, yet comparative studies frequently evaluate predictive models under heterogeneous proto

10 Apr 2026

Riemann-Bench: A Benchmark for Moonshot Mathematics

Model ReleasesDGX agent

arXiv:2604.06802v1 Announce Type: new Abstract: Recent AI systems have achieved gold-medal-level performance on the International Mathematical Olympiad, demonstrating remarkable proficiency at competi

The Traveling Thief Problem with Time Windows: Benchmarks and Heuristics

Model ReleasesDGX agent

arXiv:2604.06724v1 Announce Type: cross Abstract: While traditional optimization problems were often studied in isolation, many real-world problems today require interdependence among multiple optimiz

16 Oct 2026

Can MLLMs Read the Room? A Multimodal Benchmark for Assessing Deception in Multi-Party Social Interactions

Model ReleasesDGX agent

arXiv:2511.16221v2 Announce Type: replace-cross Abstract: Despite their advanced reasoning capabilities, state-of-the-art Multimodal Large Language Models (MLLMs) still lack a core component of human

RLDF: A Region-Level Deepfake Dataset and Benchmark for Partial-Face Manipulation Detection

Model ReleasesDGX agent

arXiv:2610.21438v1 Announce Type: new Abstract: Existing deepfake detection models are built upon manipu- lated images that are tampered with either exclusively fully swapped or fully synthesised face

VALCON: Benchmarking and Enhancing Value Consistency in Large Language Models via Dual-Role Variation

Model ReleasesDGX agent

arXiv:2610.21304v1 Announce Type: new Abstract: Current value alignment evaluations for large language models (LLMs) heavily rely on output compliance, overlooking whether LLMs maintain value consiste

WEAVE: Weaving Real-World Code Evolution into Dependency-Structured Tasks for Benchmarking and Training Code Agents

AgentsDGX agent

arXiv:2610.22039v1 Announce Type: cross Abstract: Real-world software engineering rarely consists of isolated changes. Features, migrations, and systematic fixes often unfold across multiple pull requ

15 Oct 2026

Distinguishing Process Change, Instrument Fault and Data-Path Corruption in Streaming Telemetry: A Reference Implementation and Benchmark

Model ReleasesDGX agent

arXiv:2610.18904v1 Announce Type: cross Abstract: A reading departs from what a monitoring system expects for one of three reasons: the physical process changed, the instrument is failing, or the valu

Do Vision CIL Methods Transfer to Protein? A Diagnostic Benchmark of Frozen Protein Encoders

Model ReleasesDGX agent

arXiv:2610.18879v1 Announce Type: new Abstract: Protein function annotation operates over an expanding label space, making class-incremental learning (CIL) a natural framework for incorporating newly

ForceBench: Benchmarking Force Integration for Robotic Manipulation

Model ReleasesDGX agent

arXiv:2610.19604v1 Announce Type: new Abstract: Force feedback provides vision-language-action (VLA) policies with physical observations that can guide action selection and execution. However, differe

14 Oct 2026

[AINews] AI Engineer NYC: Gemini 4 Argon, Vals AI Benchmarks

Model ReleasesDGX agent

Google’s Gemini 4 Argon is now generally available (GA), offering coding, knowledge‑work, enterprise‑workflow, and cyber‑defense features via the paid Gemini API, Google AI Pro/Ultra in the Gemini app

CryptoFlowBench: Benchmarking Multi-Hop Reasoning on Blockchains for Cryptocurrency Fund Tracing

Model ReleasesDGX agent

arXiv:2610.16449v1 Announce Type: cross Abstract: Pseudonymous accounts and complex smart-contract ecosystems substantially hinder the tracing of illicit cryptocurrency fund flows. Existing Graph Neur

Energy-Efficient Deep Learning Without Backpropagation: A Rigorous Hardware-Validated Benchmarking Study of Forward-Only Algorithms

HardwareDGX agent

arXiv:2511.01061v2 Announce Type: replace Abstract: Backpropagation (BP) powers modern deep learning, but it must hold every activation in memory until a global backward sweep consumes it, and that sw

Interactive Navigation Beyond Reachability: Benchmark and Agentic Framework

Model ReleasesDGX agent

arXiv:2610.17089v1 Announce Type: new Abstract: Existing embodied navigation tasks commonly assume that traversability and object states remain fixed during an episode. Yet reaching a goal may require

LabInstruct: Benchmarking Situated Instructional Video Generation for Lab Procedures

Model ReleasesDGX agent

arXiv:2610.14020v1 Announce Type: new Abstract: Self-driving laboratories (SDLs) aim to automate the full experimental loop, from scientific decision-making to physical execution. Ideally, AI-generate

LynxScenes: A Large-Scale Real-World Benchmark for Outdoor Wheel-Legged Robot Perception, Navigation, Imagination and Reconstruction

Model ReleasesDGX agent

arXiv:2610.18093v1 Announce Type: new Abstract: Wheel-legged robots operating in outdoor spaces shared with humans require accurate perception, socially compliant navigation, future-scene reasoning, a

OpenDGO: Benchmarking Multi-Agent Organizations Across Diverse Application Domains

Model ReleasesDGX agent

arXiv:2610.17143v1 Announce Type: new Abstract: Large language model (LLM)-based multi-agent systems are increasingly applied across diverse domains, yet different applications require different forms

Pixels or Code? Benchmarking Instruction-Guided Visual Artifact Operation

AgentsDGX agent

arXiv:2610.16444v1 Announce Type: new Abstract: Visual artifacts such as charts, technical diagrams, webpages, and document pages underpin scientific, commercial, and engineering workflows. Editing th

RoboBugBench: Benchmarking Automated Repair of Real Robot Software Under an Audited Behavioral Oracle

Model ReleasesDGX agent

arXiv:2610.16369v1 Announce Type: new Abstract: Language agents increasingly modify robot software, but whether they can repair it is unmeasured, because the domain supplies no oracle to inherit: a ro

Successful but Unsafe: An Analytical Benchmark for Revealing Collisions in Vision-and-Language Navigation

Model ReleasesDGX agent

arXiv:2610.14682v1 Announce Type: new Abstract: Vision-and-language navigation (VLN) agents are typically evaluated by whether they reach a target and how efficiently they follow an instructed route,

Tanawpamana: Benchmarking Vision-Language Models on Philippine Cultural Heritage Sites

Model ReleasesDGX agent

arXiv:2610.17596v1 Announce Type: new Abstract: Vision-language models are increasingly used to identify and describe places, yet their recognition and knowledge of specific cultures remain poorly und

12 Oct 2026

AutoBio+: Benchmarking Dexterous Manipulation with Dynamic Experimental Phenomena in Realistic Laboratories

Model ReleasesDGX agent

arXiv:2610.13643v1 Announce Type: new Abstract: Automating biological laboratories requires robots to perform dexterous tool interactions under realistic visual conditions while handling dynamic exper

CoBe: A Benchmark For Conversational Counterfactual Text Editing

Model ReleasesDGX agent

arXiv:2610.13057v1 Announce Type: cross Abstract: Counterfactual text editing is the ability to revise a given text in light of a hypothetical change while preserving facts not causally affected by th

In-Context Learning for System Identification: Probabilistic Formulation, Long-Sequence Handling, and Benchmark Validation

Model ReleasesDGX agent

arXiv:2610.13411v1 Announce Type: cross Abstract: Traditional system identification typically involves two steps: initially, training data is processed to estimate a model of the system of interest; t

9 Oct 2026

A Closer Look at Agentic BBO: Benchmarking LLM Agents for Black-Box Optimization

Model ReleasesDGX agent

arXiv:2610.12183v1 Announce Type: cross Abstract: Black-box optimization (BBO) arises in many scientific and engineering problems where objective evaluations are expensive and limited. Recent large la

Agent4RE: A Self-Refining Multi-agent Framework for End-to-End Software Requirements Engineering and Benchmarking

Model ReleasesDGX agent

arXiv:2610.10628v1 Announce Type: cross Abstract: Existing LLM-based approaches for software Requirements Engineering (RE) typically rely on basic prompting strategies or rudimentary agent collaborati

Beyond Imitation: A Framework and Benchmark for LLM-Assisted Peer Review

Model ReleasesDGX agent

arXiv:2610.11087v1 Announce Type: new Abstract: The rapid growth of scientific publishing has strained peer review, particularly in machine learning, raising concerns about declining review quality an

Conversational Task Disambiguation over Tabular Data: Leakage-Aware Formulation, Benchmark Suite, and Training

Model ReleasesDGX agent

arXiv:2610.10740v1 Announce Type: cross Abstract: Conversational task disambiguation over tabular data uses dialogue to resolve missing information about a user's intended task before producing a solu

How Narrative Wrapping Affects LLM Refusal: A Cross-Language Benchmark and Defense

Model ReleasesDGX agent

arXiv:2610.11005v1 Announce Type: new Abstract: Safety-aligned language models often refuse a harmful request stated directly but answer the same request inside a role-play or narrative wrapper. We me

LIVIN: Benchmarking Spatial and Embodied Intelligence in Digital Twins of Lived-In Homes

Model ReleasesDGX agent

arXiv:2610.12069v1 Announce Type: new Abstract: Realistic household simulation must capture not only diverse environments but also the lived-in object arrangements and spatial constraints that shape r

READ-Bench: Benchmarking Historical Instance Retrieval for Time-Series Diagnosis

Model ReleasesDGX agent

arXiv:2609.32123v2 Announce Type: replace Abstract: Time-series diagnostic systems rarely rely on retrieving relevant historical cases, and when they do, retrieval is evaluated only indirectly through

RideBench: A Large-Scale Exogenous-Aware Benchmark for Ride-Hailing Time Series Forecasting

Model ReleasesDGX agent

arXiv:2610.11164v1 Announce Type: new Abstract: We release Ride-Hailing, a large-scale ride-hailing time series dataset synthesized from DiDi's marketplace data across 200 spatial areas. Ride-Hailing

Seeing Through the Glare: A Multi-Source Benchmark and Ocular-Adaptive Pixel MeanFlow for Eyeglass Reflection Removal

Model ReleasesDGX agent

arXiv:2610.10703v1 Announce Type: new Abstract: Eyeglass reflection removal is important across smartphone imaging, video conferencing, and other face-centric visual applications. The task is challeng

TypedBench: A Benchmark for Calibration, Framing Sensitivity, and Cost in System One Decision Models

Model ReleasesDGX agent

arXiv:2610.11392v1 Announce Type: new Abstract: System One models output calibrated probabilities over typed answers such as categorical choices, ordinal levels, or binary outcomes, via a non-generati

8 Oct 2026

Benchmarking Behavioral Steerability in Behavior Foundation Models

Model ReleasesDGX agent

arXiv:2610.10198v1 Announce Type: new Abstract: Behavior Foundation Models (BFMs) are emerging as a paradigm for translating human intentions into executable humanoid behaviors. As these models evolve

CARES: A Controlled Synthetic Benchmark of Speaker Reactions to Sound

Model ReleasesDGX agent

arXiv:2610.10208v1 Announce Type: cross Abstract: Automatic audio scene description turns a recording into a text account of a situation. One difficulty is deciding which elements of the audio should

Do Vision Models Learn Physical Constraints or Rendering Shortcuts? A Counterfactual Benchmark for Grounded Physical Consistency

Model ReleasesDGX agent

arXiv:2610.09205v1 Announce Type: new Abstract: Modern image editing models can satisfy a text instruction while breaking the physics of the edited scene. A new object may cast no shadow, a mirror may

InsClaimBench: Benchmarking Insurance Claim Adjudication Across the Decision Chain

Model ReleasesDGX agent

arXiv:2610.09671v1 Announce Type: new Abstract: Recent advances in reasoning-oriented large language models (LLMs) have motivated increasing evaluation of their ability to perform professional decisio

RT-Safe: Benchmarking Agent Safety in Real-Time Embodied Environment

Model ReleasesDGX agent

arXiv:2610.09294v1 Announce Type: cross Abstract: Rapid progress in AI agents has brought growing attention to agent safety, with extensive evaluation focused on digital environments. As agents move i

UltraText Bench: A Comprehensive Bilingual Benchmark for Evaluating Visual Text Rendering in Image Generation

Model ReleasesDGX agent

arXiv:2610.09823v1 Announce Type: new Abstract: Dense visual text requires image generators to reproduce long strings across multiple regions with correct placement and legibility. As short-string ren

7 Oct 2026

HygieneRoboBench: Benchmarking Hygiene-Aware Planning for Household Robots

ResearchDGX agent

arXiv:2610.08642v1 Announce Type: cross Abstract: Contact with contaminated objects can spread hazards through a household robot's grippers, tools, and shared surfaces, while new contacts can make an

Label-Efficient Deep Learning for ECG Delineation: A Multi-Dataset Benchmark against Widely Used Delineation Tools

Model ReleasesDGX agent

arXiv:2610.07885v1 Announce Type: cross Abstract: Electrocardiogram (ECG) delineation, the identification of waveform boundaries, is a foundational step that translates raw ECG signals into clinically

Neutrosophic Ensemble Classification for Uncertainty-Aware Bearing Fault Detection: Evidence from Laboratory and Variable-Speed Industrial Benchmarks

Model ReleasesDGX agent

arXiv:2610.06880v1 Announce Type: cross Abstract: Machine learning classifiers for bearing fault detection produce scalar confidence scores that conflate confident errors with genuinely ambiguous pred

TabiBERT: A Large-Scale ModernBERT Foundation Model and A Unified Benchmark for Turkish

Model ReleasesDGX agent

arXiv:2512.23065v4 Announce Type: replace Abstract: The introduction of BERT established encoder-only transformer models as a foundational paradigm in natural language processing. Encoder-only models

6 Oct 2026

Benchmarking Generative Trajectory Models for Active-Inference Control

Model ReleasesDGX agent

arXiv:2610.05692v1 Announce Type: new Abstract: Learning from trajectory demonstrations offers a route to active-inference control of complex systems whose dynamics are difficult to model explicitly.

How Execution Assumptions Change Short-Horizon Sharpe Rankings: Evidence from a Synthetic Trading Benchmark

Model ReleasesDGX agent

arXiv:2610.05077v1 Announce Type: new Abstract: Backtests of LLM trading agents often assume that every order fills at the closing price. We ask whether this choice changes only reported returns or al

← Previous
1…6061626364…546
Next →