AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “benchmark”

GridTimelineEvolution
32,708 results
10 Sept 2026

Development and Validation of a Physics-Guided Machine Learning Extrapolation Framework Using a Classical Transient Diffusion Benchmark

Model ReleasesDGX agent

arXiv:2609.09912v1 Announce Type: new Abstract: Machine learning models used in engineering are typically trained within limited operating ranges, yet reliable predictions are often required beyond th

Safety boundary maintenance in consumer AI systems responding to pediatric health queries: a cross-platform benchmark evaluation under naturalistic and adversarially pressured conditions

Model ReleasesDGX agent

arXiv:2601.09721v2 Announce Type: replace-cross Abstract: Consumer artificial intelligence chatbots are now accessed by hundreds of millions of users seeking health information, yet systematic evaluat

SciLitBench: Benchmark and Design Principles for LLM-Powered Systematic Literature Reviews

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Model ReleasesDGX agent

arXiv:2609.05505v1 Announce Type: new Abstract: Systematic reviews require sustained human judgment across thousands of records, yet existing evaluations of large language models (LLMs) typically exam

SWE-Test: Benchmarking LLM Vulnerability Discovery via Input Prediction

Model ReleasesDGX agent

arXiv:2609.06229v1 Announce Type: cross Abstract: Vulnerability discovery is becoming an important ability of large language model (LLM) agents: agents that silently miss real defects leave critical s

9 Sept 2026

BrachistoneLR: A Brachistochrone-Inspired Learning-Rate Schedule and a Controlled Benchmark of Scheduling Policies

Model ReleasesDGX agent

arXiv:2609.08069v1 Announce Type: new Abstract: The learning-rate schedule is a consequential choice in training deep networks, yet the policies in common use are heuristic, and published comparisons

CausalBN-Bench: A Comprehensive Benchmark for Causal Learning Capability of LLMs

Model ReleasesDGX agent

arXiv:2404.06349v3 Announce Type: replace Abstract: The ability to understand causality significantly impacts the competence of large language models (LLMs) in output explanation and counterfactual re

Remove360: Benchmarking Residuals After Object Removal in 3D Gaussian Splatting

Model ReleasesDGX agent

arXiv:2508.11431v3 Announce Type: replace Abstract: An object can disappear from a 3D scene, yet still be detectable. Even after visual removal, modern vision models may infer what was originally pres

7 Sept 2026

ConsensusBench: Benchmark of Consensus Nodes for LLM Reasoning via Outcome Reward Densifying

Model ReleasesDGX agent

arXiv:2609.04648v1 Announce Type: new Abstract: Reinforcement learning (RL) has become one of the primary paradigms for reasoning enhancement of large language models (LLMs). In particular, Group Rela

Counting Beyond Instances: A Benchmark for Group-Individual Object Counting

Model ReleasesDGX agent

arXiv:2609.04716v1 Announce Type: new Abstract: Visual counting is commonly formulated at the instance level, aiming to estimate how many objects of a queried category appear in an image. However, rea

FinalityBench: An Effect-Level Benchmark for Agent Decisions Under Delayed and Conflicting Financial Finality

Model ReleasesDGX agent

arXiv:2609.04706v1 Announce Type: new Abstract: A merchant's payment processor, ledger, ERP and bank feed are updated by messages that get delayed, duplicated, dropped and reordered, so for minutes at

One Word, Different Action: A Real-Robot Benchmark for Language-Conditioned Embodied Reasoning

Model ReleasesDGX agent

arXiv:2609.05260v1 Announce Type: new Abstract: Natural-language instruction changes can directly alter robot behavior. A reliable embodied system should preserve its action when the task is unchanged

TeleTables: A Benchmark for Large Language Models in Telecom Table Interpretation

Model ReleasesDGX agent

arXiv:2601.04202v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) are increasingly applied to telecom engineering tasks, yet perform poorly on 3GPP specifications. These standards

You Really Didn't Get That? Benchmarking Social Pragmatic Inference for Indirect and Playful Chinese Online Comments

Model ReleasesDGX agent

arXiv:2609.04384v1 Announce Type: cross Abstract: Chinese online comments often convey social meaning through indirect and playful language that is hard to interpret without context. Existing evaluati

4 Sept 2026

Report: OpenAI agents took over a website, used it to collaborate on benchmarks

IndustryDGX agent

Artificial intelligence agents linked to OpenAI Group PBC reportedly took over a German website and used it to exchange information. Reuters revealed the incident today, citing two unnamed sources and

3 Sept 2026

MV-dVRK: A Multi-Viewpoint Benchmark for Spatial Surgical Perception

Model ReleasesDGX agent

arXiv:2609.02717v1 Announce Type: new Abstract: Large-scale training and refined optimization techniques have greatly improved sparse multi-view 3D reconstruction. Despite their relevance to surgery,

Thinking in Pictures: A Systematic Benchmark for Reasoning-driven Image Generation

Model ReleasesDGX agent

arXiv:2609.02864v1 Announce Type: new Abstract: Recent advancements in unified generative models (UGMs) and world simulators have achieved unprecedented results in visual perception and synthesis. How

VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulation

Model ReleasesDGX agent

arXiv:2609.02462v1 Announce Type: new Abstract: End-to-end autonomous driving in urban environments requires robust decision-making under partial observability and complex multi-agent interactions. Se

2 Sept 2026

CHARM: Character Hallucination for Multicultural Role Play Benchmark

Model ReleasesDGX agent

arXiv:2609.01352v1 Announce Type: cross Abstract: Role-playing large language models (LLMs) are expected to adopt a character's style while also respecting that character's knowledge boundaries. Prior

Cleaner Speech, Weaker Generalization: Revisiting Pitt-Derived Benchmarks for Alzheimer's Disease Detection

ApplicationsDGX agent

arXiv:2609.00276v1 Announce Type: cross Abstract: Speech-based Alzheimer's disease (AD) detection increasingly relies on speech-enhanced and curated versions of the Pitt Corpus, where speech enhanceme

Toward Workflow-Aware Benchmarking for Healthcare NLP Agents

AgentsDGX agent

arXiv:2609.00296v1 Announce Type: new Abstract: Large language model (LLM) agents are increasingly proposed for healthcare tasks such as clinical documentation, evidence retrieval, patient messaging,

1 Sept 2026

AssetOpsBench: Benchmarking AI Agents for Task Automation in Industrial Asset Operations and Maintenance

AgentsDGX agent

arXiv:2506.03828v4 Announce Type: replace Abstract: AI for Industrial Asset Lifecycle Management aims to automate complex operational workflows, such as condition monitoring and maintenance scheduling

ImageCAS-X: a dataset and benchmark for coronary artery segmentation and centerline extraction in coronary CT angiography

Model ReleasesDGX agent

arXiv:2608.30404v1 Announce Type: cross Abstract: Accurate segmentation of the coronary vessel lumen is a prerequisite for quantitative assessment of atherosclerotic plaque and perivascular adipose ti

Is Deformable Image Registration Ready for Brain Metastasis Reirradiation Dose Accumulation? A Longitudinal MRI Benchmark of Registration Accuracy

Model ReleasesDGX agent

arXiv:2608.28705v1 Announce Type: cross Abstract: Dose accumulation is increasingly important in adaptive radiation therapy and reirradiation, but its clinical validity depends on the performance of d

LexRubric: A Rubric-Guided Diagnostic Benchmark for Open-Ended Legal Tasks

Model ReleasesDGX agent

arXiv:2606.09389v2 Announce Type: replace Abstract: As large language models (LLMs) are increasingly applied to real-world legal tasks, evaluating the reliability of their open-ended legal responses h

Multi-Group Pipe Routing under Permanent Geometric Occupancy: Problem, Benchmark, and Classical Baselines

Model ReleasesDGX agent

arXiv:2608.28697v1 Announce Type: new Abstract: Additive manufacturing (AM) enables compact hydraulic components whose internal fluid channels can follow free-form 3D paths rather than conventionally

Sleight of Word Benchmark: Can Language Models Notice If Their Own Output Was Tampered With?

Model ReleasesDGX agent

arXiv:2608.29921v1 Announce Type: cross Abstract: The output of a Language Model can be tampered with while the model is writing it. A simple test can thus be constructed by evaluating the model's per

31 Aug 2026

A comprehensive and trustworthy benchmark of AI methods for change detection in Earth observation

Model ReleasesDGX agent

arXiv:2608.28247v1 Announce Type: new Abstract: Change detection in Earth observation (EO) is critical for monitoring land surface transformations, yet recent research in the field is constrained by i

28 Aug 2026

ANTShapes Benchmarking Datasets for Event-Based Neuromorphic Object Classification

ResearchDGX agent

arXiv:2608.27150v1 Announce Type: cross Abstract: Object classification in event-based computer vision is a task that is attracting considerable research attention. Event-based object classification i

Cross-Platform Benchmark of Neural 3D Reconstruction for Autonomous Laboratory Robots

Model ReleasesDGX agent

arXiv:2608.26383v1 Announce Type: new Abstract: Autonomous robots performing laboratory tasks depend on 3D reconstruction pipelines that can turn raw camera streams into actionable object representati

OS-Marathon: Benchmarking Computer-Use Agents on Vast-Horizon, Repetitive Tasks

Model ReleasesDGX agent

arXiv:2601.20650v3 Announce Type: replace Abstract: Vast-horizon, repetitive workflows are common in daily routines, e.g., processing expense reports from a stack of receipts, organising a collection

27 Aug 2026

EgoArgus: Benchmarking VLMs as Situational Assistants for Modality-Grounded User Supports

SafetyDGX agent

arXiv:2608.25561v1 Announce Type: new Abstract: VLMs are increasingly positioned as daily assistants that perceive first-person environments, follow user dialogue, and decide how to help. Existing ego

26 Aug 2026

FraudBench: Protocol-Sensitive Benchmarking of Adversarial Robustness for Financial Risk Assessment

Model ReleasesDGX agent

arXiv:2608.24551v1 Announce Type: cross Abstract: Machine learning models are widely used in financial fraud and credit-risk detection, yet their adversarial robustness remains difficult to evaluate b

25 Aug 2026

A Fixed-Radius Distance-Band Benchmark for Dimensionality-Reduction Fidelity

Model ReleasesDGX agent

arXiv:2608.21779v1 Announce Type: new Abstract: Dimensionality-reduction (DR) methods are routinely judged by how well each point's k nearest neighbors survive the 2-D embedding (recall@k, trustworthi

Benchmarking Composable Compression Techniques in Mixture-of-Experts LLMs

Model ReleasesDGX agent

arXiv:2608.21693v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) LLMs scale model capacity efficiently through sparse activation, but their large expert parameter footprint, routing imbalance,

Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift

Model ReleasesDGX agent

arXiv:2607.10358v2 Announce Type: replace-cross Abstract: Foundation models are increasingly used as image feature extractors for mammography, but their robustness under external domain shift remains

BeTaL-GBI: Admission-Aware Benchmark Tuning and Full-Stack Verification of Geometric Belief Interfaces

Model ReleasesDGX agent

arXiv:2608.21503v1 Announce Type: cross Abstract: A verification substrate is more credible when exposing errors in its own claims, not just model outputs. GBI-DCSE v3 falsified an architectural claim

Beyond Benchmarking: Scenario-Based Evaluation of Large Language Models for Personalized Learning

Model ReleasesDGX agent

arXiv:2509.05346v3 Announce Type: replace Abstract: While large language models (LLMs) are increasingly being adopted to support personalized learning, there remains limited understanding of how their

Beyond Factual Knowledge: Benchmarking and Learning Step-Level Procedural Rule Reasoning in Large Language Models

Model ReleasesDGX agent

arXiv:2608.22753v1 Announce Type: new Abstract: Large language models (LLMs) excel at text understanding and generation, yet still struggle to reliably understand and apply externally provided procedu

CRS-Bench: A Reference-Relative Reliability Benchmark for Medical Image Encoders

Model ReleasesDGX agent

arXiv:2608.22059v1 Announce Type: cross Abstract: Pretrained image encoders are central to medical image classification, where expert annotation is costly and task-specific cohorts are often limited.

Data-Centric Benchmark for Label Noise Estimation and Ranking in Remote Sensing Binary Building Segmentation

Model ReleasesDGX agent

arXiv:2603.00604v2 Announce Type: replace Abstract: High-quality pixel-level annotations are essential for the semantic segmentation of remote sensing imagery. However, such labels are expensive to ob

EarthVerse: Benchmarking Scientific Agents Across Dynamic Earth Systems and Natural Hazards

Model ReleasesDGX agent

arXiv:2608.23525v1 Announce Type: new Abstract: Earth-system analysis reconstructs changing physical processes from observations that differ in source, scale, timing, and modality. Natural hazards mak

GRACE: Step-Level Benchmark for Faithful Reasoning over Context

Model ReleasesDGX agent

arXiv:2606.16151v2 Announce Type: replace Abstract: Many reasoning tasks require models to reason over input context, from document-grounded question answering to rule-based deduction. Chain-of-Though

PUMA: A Polish Benchmark for Culturally Grounded Multimodal Understanding

Model ReleasesDGX agent

arXiv:2608.21853v1 Announce Type: new Abstract: Large language models are increasingly moving beyond text processing, adding support for other modalities such as images and audio. While text understan

Register Shifts Break LLM Safety: A Bengali Benchmark with Culturally Grounded Harms

Model ReleasesDGX agent

arXiv:2608.22335v1 Announce Type: cross Abstract: Bengali is the seventh-most-spoken language globally, yet LLM safety evaluation remains overwhelmingly English-centric. We introduce BanglaSafe, a ben

The Imitator Game: Benchmarking Robot Imitative Ability Beyond Action Prediction

Model ReleasesDGX agent

arXiv:2608.22301v1 Announce Type: cross Abstract: Humans imitate at the level of intent: given a demonstration, we infer its goal and carry it out with whatever tools, objects, and layouts are at hand

Through the Schrodinger Bridge: Benchmarking Antemortem Image Restoration from Postmortem Autolysis to Enhance Forensic Diagnostics

Model ReleasesDGX agent

arXiv:2608.21813v1 Announce Type: new Abstract: Forensic histopathology, essential for determining cause of death and disease diagnosis, is severely impeded by postmortem autolysis, i.e., an irreversi

Toward Sub-1 kB Identity-Preserving Face Compression: A Benchmark of Codecs, a Custom Learned Codec, and Studies of Resolution, Demographic Fairness, Recompression, and Adversarial Robustness

Model ReleasesDGX agent

arXiv:2608.22866v1 Announce Type: new Abstract: Storing face images under a hard sub-kilobyte budget, as required for identity documents, smart-card biometrics and bandwidth-constrained verification,

When Names Cross Scripts: A Source-Grounded Benchmark for Historical Entity Reconciliation in the Mongol World

Model ReleasesDGX agent

arXiv:2608.23507v1 Announce Type: cross Abstract: Historical people may appear under different languages, scripts, and transcription traditions, while distinct individuals may share highly similar or

24 Aug 2026

BackDFL: A Unified Benchmark For Backdoor Attacks and Defenses In Decentralized Federated Learning

Model ReleasesDGX agent

arXiv:2608.21137v1 Announce Type: new Abstract: Decentralized Federated Learning (DFL) promises trust-free collaborative learning by replacing the centralized parameter server with peer-to-peer model

Generalization Measures under Controlled Covariate Shift: A Regime-Aware Benchmark

Model ReleasesDGX agent

arXiv:2602.01718v2 Announce Type: replace Abstract: Predicting generalization from quantities available before target-test evaluation remains a central challenge in deep learning. The systematic bench

21 Aug 2026

Hear2Act: Benchmarking When Prosody Should Change What an Assistant Does

ResearchDGX agent

arXiv:2608.19515v1 Announce Type: new Abstract: Prosodic cues can convey task-relevant information that alters the trajectory and outcome of a task-oriented dialogue, even when the words themselves re

I benchmarked Ox Alpha on SWE-bench Verified Mini (50 tasks): 96% resolved. Now I’m skeptical of myself.

Model ReleasesDGX agent

TL;DR: The result looks TOO GOOD TO BE TRUE — that's exactly why I'm posting it. I ran Ox alpha on the entire SWE-bench Verified-Mini set with the official mini-swe-agent scaffold — the same agent use

20 Aug 2026

How Quantum Is the Advantage? A Fair, Calibration- and Noise-Aware Benchmark and Attribution Audit of Quantum Machine Learning for Network Intrusion Detection

Model ReleasesDGX agent

arXiv:2608.18155v1 Announce Type: cross Abstract: Quantum machine learning (QML) for network intrusion detection (NIDS) is routinely reported to reach near-perfect accuracy, yet the most rigorous stud

19 Aug 2026

An Empirical Study of Reward Specification and Benchmark Reliability in GRPO-based LLM Unlearning

Model ReleasesDGX agent

arXiv:2608.17804v1 Announce Type: cross Abstract: Practical LLM unlearning is usually evaluated through two objectives: suppress target-specific knowledge and preserve non-target utility. In generativ

LIBERO-VIFO: Benchmarking the Capability and Safety of Visual Cue Following in Vision-Language-Action Models

Model ReleasesDGX agent

arXiv:2608.17600v1 Announce Type: new Abstract: Visual cues are increasingly adopted to guide robot learning, but whether Vision-Language-Action (VLA) models can reliably follow authorized cues while

MANIGUARD: A Benchmark and Data Suite for Specification-Grounded Safety Evaluation and Improvement of Robotic Manipulation

Model ReleasesDGX agent

arXiv:2608.17386v1 Announce Type: new Abstract: Foundation-model policies for robotic manipulation are advancing rapidly on task success, but rigorous evaluation of whether they succeed safely is stil

18 Aug 2026

A Human-Centred Approach to Benchmarking LLMs for Parenting Advice

ResearchDGX agent

arXiv:2608.14622v1 Announce Type: new Abstract: People are increasingly using large language models (LLMs) to seek advice, including for parenting. Parenting is a critical and socially sensitive domai

Accuracy and Reliability of Large Language Models in Cosmetic Chemistry and Skin Health: A Benchmarking Study

ResearchDGX agent

arXiv:2608.14631v1 Announce Type: new Abstract: As consumers increasingly turn to AI chatbots for skincare advice, the technical accuracy of Large Language Models (LLMs) in cosmetic chemistry remains

AeroCopilotBench: A Two-Tier Benchmark for Evaluating LLM Agents as Aviation Copilots in an Interactive Virtual Cockpit Environment

Model ReleasesDGX agent

arXiv:2608.16349v1 Announce Type: new Abstract: Large language model (LLM) agents may assist flight crews with complex decisions and task execution, but existing aviation evaluations centered on stati

Auxiliary uncertainty signals for LLM-assisted systematic review screening: a benchmark across eight Cohen drug-class reviews

Model ReleasesDGX agent

arXiv:2608.14551v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for title-abstract screening in systematic reviews, but their decisions lack calibrated uncertainty.

← Previous
1…6364656667…546
Next →