AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “evaluation”

GridTimelineEvolution
41,190 results
12 May 2026

ASTRA-QA: A Benchmark for Abstract Question Answering over Documents

Model ReleasesDGX agent

arXiv:2605.10168v1 Announce Type: new Abstract: Document-based question answering (QA) increasingly includes abstract questions that require synthesizing scattered information from long documents or a

Behavior-Centric Extraction of Scenarios from Highway Traffic Data and their Domain-Knowledge-Guided Clustering using CVQ-VAE

ApplicationsDGX agent

arXiv:2603.16964v2 Announce Type: replace Abstract: Approval of ADS depends on evaluating its behavior within representative real-world traffic scenarios. A common way to obtain such scenarios is to e

Benchmarking Safety Risks of Knowledge-Intensive Reasoning under Malicious Knowledge Editing

Model Releases
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
DGX agent

arXiv:2605.10146v1 Announce Type: new Abstract: Large language models (LLMs) increasingly rely on knowledge editing to support knowledge-intensive reasoning, but this flexibility also introduces criti

ChaosNetBench: Benchmarking Spatio-Temporal Graph Neural Networks on Chaotic Lattice Dynamics

Model ReleasesDGX agent

arXiv:2605.09676v1 Announce Type: cross Abstract: Spatio-temporal graph neural networks (STGNNs) are widely used for short-term forecasting in dynamic physical systems such as traffic and weather. How

Code Mixologist : A Practitioner's Guide to Building Code-Mixed LLMs

SafetyDGX agent

arXiv:2602.11181v2 Announce Type: replace Abstract: Code-mixing and code-switching (CSW) remain challenging phenomena for large language models (LLMs). Despite recent advances in multilingual modeling

CUDABeaver: Benchmarking LLM-Based Automated CUDA Debugging

Model ReleasesDGX agent

arXiv:2605.08455v1 Announce Type: new Abstract: Debugging CUDA programs has long been challenging because failures often arise from subtle interactions among hardware behavior, compiler decisions, mem

DRIVE-C: A Controlled Corruption Dataset for Autonomous Driving

AgentsDGX agent

arXiv:2605.09774v1 Announce Type: new Abstract: DRIVE-C is a controlled corruption dataset designed to evaluate visual perception robustness in autonomous driving systems. It is built from real-world

EpiGraph: A Knowledge Graph and Benchmark for Evidence-Intensive Reasoning in Epilepsy

Model ReleasesDGX agent

arXiv:2605.09505v1 Announce Type: new Abstract: Epilepsy diagnosis and treatment require evidence-intensive reasoning across heterogeneous clinical knowledge, including biosignal patterns, genetic mec

Execution Envelopes: A Shared Admission Contract for Backend AI Execution Requests

SafetyDGX agent

arXiv:2605.08267v1 Announce Type: cross Abstract: Enterprise AI backends increasingly admit heterogeneous execution requests across model deployment, inference, evaluation, data movement, and agentic

FinTSB: A Comprehensive and Practical Benchmark for Financial Time Series Forecasting

Model ReleasesDGX agent

arXiv:2502.18834v2 Announce Type: replace-cross Abstract: Financial time series (FinTS) record the behavior of human-brain-augmented decision-making, capturing valuable historical information that can

Forge: Quality-Aware Reinforcement Learning for NP-Hard Optimization in LLMs

Model ReleasesDGX agent

arXiv:2605.08905v1 Announce Type: new Abstract: Large Language Models (LLMs) have achieved remarkable success on reasoning benchmarks through Reinforcement Learning with Verifiable Rewards (RLVR), exc

FragileFlow: Spectral Control of Correct-but-Fragile Predictions for Foundation Model Robustness

ResearchDGX agent

arXiv:2605.08896v1 Announce Type: cross Abstract: Robust adaptation of LLMs and VLMs is often evaluated by average accuracy or average consistency under perturbations. However, these averages can hide

From Pixels to Concepts: Do Segmentation Models Understand What They Segment?

Model ReleasesDGX agent

arXiv:2605.09591v1 Announce Type: new Abstract: Segmentation is a fundamental vision task underlying numerous downstream applications. Recent promptable segmentation models, such as Segment Anything M

From Single-Step Edit Response to Multi-Step Molecular Optimization

Local AiDGX agent

arXiv:2605.10035v1 Announce Type: new Abstract: Conditional molecular optimization aims to edit a molecule to realize a specified property shift. In practice, structurally similar molecule data is sca

Gender Fairness in Audio Deepfake Detection: Performance and Disparity Analysis

SafetyDGX agent

arXiv:2603.09007v2 Announce Type: replace-cross Abstract: Audio deepfake detection aims to detect real human voices from those generated by Artificial Intelligence (AI) and has emerged as a significan

GLEAM: A Multimodal Imaging Dataset and HAMM for Glaucoma Classification

ResearchDGX agent

arXiv:2603.12800v2 Announce Type: replace-cross Abstract: We propose glaucoma lesion evaluation and analysis with multimodal imaging (GLEAM), the first publicly available tri-modal glaucoma dataset co

Grounded Satirical Generation with RAG

ResearchDGX agent

arXiv:2605.10853v1 Announce Type: new Abstract: Humor generation remains challenging task for Large Language Models (LLMs), due to their subjective nature. We focus on satire, a form of humor strongly

How Much Do Circuits Tell Us? Measuring the Consistency and Specificity of Language Model Circuits

ResearchDGX agent

arXiv:2605.08348v1 Announce Type: new Abstract: The circuits framework in mechanistic interpretability aims to identify causally important sparse subgraphs of model components, typically evaluated by

Human-Inspired Memory Architecture for LLM Agents

Model ReleasesDGX agent

arXiv:2605.08538v1 Announce Type: new Abstract: Current LLM agents lack principled mechanisms for managing persistent memory across long interaction horizons. We present a biologically-grounded memory

Inductive Entity Representations from Text via Link Prediction

TutorialsDGX agent

arXiv:2010.03496v4 Announce Type: replace-cross Abstract: Knowledge Graphs (KG) are of vital importance for multiple applications on the web, including information retrieval, recommender systems, and

Is Your Driving World Model an All-Around Player?

Model ReleasesDGX agent

arXiv:2605.10858v1 Announce Type: new Abstract: Today's driving world models can generate remarkably realistic dash-cam videos, yet no single model excels universally. Some generate photorealistic tex

Large Language Models as Students Who Think Aloud: Overly Coherent, Verbose, and Confident

Model ReleasesDGX agent

arXiv:2602.01015v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly embedded in AI-based tutoring systems. Can they faithfully model novice reasoning and metacognitive ju

Learning to Compress Time-to-Control: A Reinforcement Learning Framework for Chronic Disease Management

SafetyDGX agent

arXiv:2605.09818v1 Announce Type: new Abstract: Reinforcement learning (RL) in healthcare has had mixed results, with reward sparsity, unreliable off-policy evaluation, and deployment-simulation gap a

LogitTrace: Detecting Benchmark Contamination via Layerwise Logit Trajectories

Model ReleasesDGX agent

arXiv:2509.20909v2 Announce Type: replace Abstract: Large language models (LLMs) are commonly evaluated on challenging benchmarks such as AIME and Math500, where benchmark contamination can make memor

MECAT: A Multi-Experts Constructed Benchmark for Fine-Grained Audio Understanding Tasks

Model ReleasesDGX agent

arXiv:2507.23511v3 Announce Type: replace-cross Abstract: While large audio-language models have advanced open-ended audio understanding, they still fall short of nuanced human-level comprehension. Th

MedThink: Enhancing Diagnostic Accuracy in Small Models via Teacher-Guided Reasoning Correction

ResearchDGX agent

arXiv:2605.08094v1 Announce Type: cross Abstract: Accurate clinical diagnosis requires extensive domain knowledge and complex clinical reasoning capabilities. Although large language models (LLMs) hol

ML-CLIPSim: Multi-Layer CLIP Similarity for Machine-Oriented Image Quality

ResearchDGX agent

arXiv:2605.09479v1 Announce Type: cross Abstract: We study full-reference image quality assessment from a machine-centric perspective, where images are evaluated by how well they preserve information

Model-Free Neural Filtering: A Comparison with Classical Filters in Nonlinear Systems

Model ReleasesDGX agent

arXiv:2601.21266v3 Announce Type: replace Abstract: Neural network models are increasingly used for state estimation in control and decision-making, yet it remains unclear to what extent they behave a

Nectar: Neural Estimation of Cached-Token Attention via Regression

ApplicationsDGX agent

arXiv:2605.09778v1 Announce Type: cross Abstract: Evaluating softmax attention over a fixed long context requires reading every cached key-value pair for each new query token. For a given context (a b

NeuralBench: A Unifying Framework to Benchmark NeuroAI Models

Model ReleasesDGX agent

arXiv:2605.08495v1 Announce Type: new Abstract: Deep learning and large public datasets have recently catalyzed the proliferation of AI models for processing brain recordings. However, systematically

On the Generation and Mitigation of Harmful Geometry in Image-to-3D Models

SafetyDGX agent

arXiv:2605.09606v1 Announce Type: cross Abstract: Recent advances in image-to-3D models have significantly improved the fidelity and accessibility of 3D content creation. Such a powerful reconstructio

On the Overscaling Curse of Parallel Thinking: System Efficacy Contradicts Sample Efficiency

ApplicationsDGX agent

arXiv:2601.21619v2 Announce Type: replace-cross Abstract: Parallel thinking improves LLM reasoning through multi-path sampling and aggregation. In standard evaluations, due to a lack of sample-specifi

Optimal FALQON for Quantum Approximate Optimization via Layer-wise Parameter Tuning

Model ReleasesDGX agent

arXiv:2605.08332v1 Announce Type: cross Abstract: Feedback-based adaptive quantum optimization (FALQON) is a promising approach for solving combinatorial problems on noisy intermediate-scale quantum (

Oracle Poisoning: Corrupting Knowledge Graphs to Weaponise AI Agent Reasoning

Model ReleasesDGX agent

arXiv:2605.09822v1 Announce Type: cross Abstract: We define Oracle Poisoning, an attack class in which an adversary corrupts a structured knowledge graph that AI agents query at runtime via tool-use p

PDEAgent-Bench: A Multi-Metric, Multi-Library Benchmark for PDE Solver Generation

Model ReleasesDGX agent

arXiv:2605.09636v1 Announce Type: new Abstract: PDE-to-solver code generation aims to automatically synthesize executable numerical solvers from partial differential equation (PDE) specifications. Thi

Process Matters more than Output for Distinguishing Humans from Machines

Model ReleasesDGX agent

arXiv:2605.06524v2 Announce Type: replace Abstract: Reliable human-machine discrimination is becoming increasingly important as large language models and autonomous agents are deployed in online setti

Pseudo-Deliberation in Language Models: When Reasoning Fails to Align Values and Actions

SafetyDGX agent

arXiv:2605.09893v1 Announce Type: cross Abstract: Large language models (LLMs) are often evaluated based on their stated values, yet these do not reliably translate into their actions, a discrepancy t

Reasoning emerges from constrained inference manifolds in large language models

Model ReleasesDGX agent

arXiv:2605.08142v1 Announce Type: cross Abstract: Reasoning in large language models is predominantly evaluated through labeled benchmarks, conflating task performance with the quality of internal inf

RelBench v2: A Large-Scale Benchmark and Repository for Relational Data

Model ReleasesDGX agent

arXiv:2602.12606v2 Announce Type: replace Abstract: Relational deep learning (RDL) has emerged as a powerful paradigm for learning directly on relational databases by modeling entities and their relat

Reward Auditor: Inference on Reward Modeling Suitability in Real-World Perturbed Scenarios

SafetyDGX agent

arXiv:2512.00920v4 Announce Type: replace Abstract: Reliable reward models (RMs) are critical for ensuring the safe alignment of large language models (LLMs). However, current RM evaluation methods fo

SeePhys Pro: Diagnosing Modality Transfer and Blind-Training Effects in Multimodal RLVR for Physics Reasoning

Model ReleasesDGX agent

arXiv:2605.09266v1 Announce Type: new Abstract: We introduce SeePhys Pro, a fine-grained modality transfer benchmark that studies whether models preserve the same reasoning capability when critical in

SEIS: Subspace-based Equivariance and Invariance Scores for Neural Representations

ResearchDGX agent

arXiv:2602.04054v2 Announce Type: replace-cross Abstract: Understanding how neural representations respond to geometric transformations is essential for evaluating whether learned features preserve me

SenseBench: A Benchmark for Remote Sensing Low-Level Visual Perception and Description in Large Vision-Language Models

Model ReleasesDGX agent

arXiv:2605.10576v1 Announce Type: cross Abstract: Low-level visual perception underpins reliable remote sensing (RS) image analysis, yet current image quality assessment (IQA) methods output uninterpr

SleepWalk: A Three-Tier Benchmark for Stress-Testing Instruction-Guided Vision-Language Navigation

Model ReleasesDGX agent

arXiv:2605.10376v1 Announce Type: new Abstract: Vision-Language Models (VLMs) have advanced rapidly in multimodal perception and language understanding, yet it remains unclear whether they can reliabl

SpatiaLab: Can Vision-Language Models Perform Spatial Reasoning in the Wild?

Model ReleasesDGX agent

arXiv:2602.03916v3 Announce Type: replace-cross Abstract: Spatial reasoning is a fundamental aspect of human cognition, yet it remains a major challenge for contemporary vision-language models (VLMs).

StereoTales: A Multilingual Framework for Open-Ended Stereotype Discovery in LLMs

Local AiDGX agent

arXiv:2605.10442v1 Announce Type: cross Abstract: Multilingual studies of social bias in open-ended LLM generation remain limited: most existing benchmarks are English-centric, template-based, or rest

Sufficient conditions for a Heuristic Rating Estimation Method application

ResearchDGX agent

arXiv:2605.08991v1 Announce Type: new Abstract: A series of papers has introduced the Heuristic Rating Estimation method, which evaluates a set of alternatives based on pairwise comparisons and the we

SYNCR: A Cross-Video Reasoning Benchmark with Synthetic Grounding

Model ReleasesDGX agent

arXiv:2605.08412v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have made rapid progress in single-video understanding, yet their ability to reason across multiple independent

TeleResilienceBench: Quantifying Resilience for LLM Reasoning in Telecommunications

Model ReleasesDGX agent

arXiv:2605.09929v1 Announce Type: new Abstract: Deploying large language models in telecommunications requires more than task accuracy. In realistic workflows, a model may inherit partially completed

Temporal Sampling Frequency Matters: A Capacity-Aware Study of End-to-End Driving Trajectory Prediction

AgentsDGX agent

arXiv:2605.10388v1 Announce Type: new Abstract: End to end (E2E) autonomous driving trajectory prediction is often trained with camera frames sampled at the highest available temporal frequency, assum

The Art of the Jailbreak: Formulating Jailbreak Attacks for LLM Security Beyond Binary Scoring

SafetyDGX agent

arXiv:2605.09225v1 Announce Type: cross Abstract: Jailbreak attacks -- adversarial prompts that bypass LLM alignment through purely linguistic manipulation -- pose a growing operational security threa

The Last Word Often Wins: A Format Confound in Chain-of-Thought Corruption Studies

Model ReleasesDGX agent

arXiv:2605.10799v1 Announce Type: cross Abstract: Corruption studies, the primary tool for evaluating chain-of-thought (CoT) faithfulness, identify which chain positions are 'computationally important

TOC-Bench: A Temporal Object Consistency Benchmark for Video Large Language Models

Model ReleasesDGX agent

arXiv:2605.09904v1 Announce Type: new Abstract: Video large language models (Video-LLMs) have achieved remarkable progress in general video understanding, yet their ability to maintain temporal object

Trustworthy AI: Ensuring Reliability and Accountability from Models to Agents

SafetyDGX agent

arXiv:2605.08964v1 Announce Type: new Abstract: In this thesis, we develop algorithms with theoretical guarantees for ensuring reliability and accountability of Machine Learning (ML) systems. As ML sy

When Agents Overtrust Environmental Evidence: An Extensible Agentic Framework for Benchmarking Evidence-Grounding Defects in LLM Agents

SafetyDGX agent

arXiv:2605.08828v1 Announce Type: new Abstract: Large language model agents increasingly operate through environment-facing scaffolds that expose files, web pages, APIs, and logs. These observations i

When Independent Sampling Outperforms Agentic Reasoning

AgentsDGX agent

arXiv:2605.08478v1 Announce Type: new Abstract: We study how to allocate inference-time compute for competitive programming under fixed budgets. Evaluating 216 Codeforces problems across Divisions 1-3

Willful Disobedience: Automatically Detecting Failures in Agentic Traces

AgentsDGX agent

arXiv:2603.23806v2 Announce Type: replace-cross Abstract: AI agents are increasingly embedded in real software systems, where they execute multi-step workflows through multi-turn dialogue, tool invoca

11 May 2026

A Resilience Framework for Bi-Criteria Combinatorial Optimization with Bandit Feedback

ResearchDGX agent

arXiv:2503.12285v2 Announce Type: replace-cross Abstract: We study bi-criteria combinatorial optimization under noisy function evaluations. While resilience and black-box offline-to-online reductions

Adaptive auditing of AI systems with anytime-valid guarantees

ResearchDGX agent

arXiv:2605.07002v1 Announce Type: new Abstract: A major bottleneck in characterizing the failure modes of generative AI systems is the cost and time of annotation and evaluation. Consequently, adaptiv

Advancing Reliable Synthetic Video Detection: Insights from the SAFE Challenge

ResearchDGX agent

arXiv:2605.06912v1 Announce Type: new Abstract: The proliferation of generative video technologies has intensified the need for reliable methods to detect and characterize synthetic media. To address

← Previous
1…175176177178179…687
Next →