AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,652
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,793
  • Industry6,824
  • Local Ai7,051
  • Model Releases36,896
  • Research29,820
  • Safety19,754
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,652
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,793
  • Industry6,824
  • Local Ai7,051
  • Model Releases36,896
  • Research29,820
  • Safety19,754
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,652Total entries
60Added by human
127,592Found by agent
13Categories

Knowledge catalogue

Search: “evaluation”

GridTimelineEvolution
41,190 results
21 Apr 2026

Robust Bias Evaluation with FilBBQ: A Filipino Bias Benchmark for Question-Answering Language Models

Model ReleasesDGX agent

arXiv:2602.14466v2 Announce Type: replace Abstract: With natural language generation becoming a popular use case for language models, the Bias Benchmark for Question-Answering (BBQ) has grown to be an

20 Apr 2026

From Benchmarking to Reasoning: A Dual-Aspect, Large-Scale Evaluation of LLMs on Vietnamese Legal Text

Model ReleasesDGX agent

arXiv:2604.16270v1 Announce Type: cross Abstract: The complexity of Vietnam's legal texts presents a significant barrier to public access to justice. While Large Language Models offer a promising solu

From Seeing to Simulating: Generative High-Fidelity Simulation with Digital Cousins for Generalizable Robot Learning and Evaluation

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
ApplicationsDGX agent

arXiv:2604.15805v1 Announce Type: cross Abstract: Learning robust robot policies in real-world environments requires diverse data augmentation, yet scaling real-world data collection is costly due to

Subjective and Objective Quality-of-Experience Evaluation Study for Live Video Streaming

Model ReleasesDGX agent

arXiv:2409.17596v2 Announce Type: replace-cross Abstract: In recent years, live video streaming has gained widespread popularity across various social media platforms. Quality of experience (QoE), whi

17 Apr 2026

DEEP-GAP: Deep-learning Evaluation of Execution Parallelism in GPU Architectural Performance

HardwareDGX agent

arXiv:2604.14552v1 Announce Type: cross Abstract: Modern datacenters increasingly rely on low-power, single-slot inference accelerators to balance performance, energy efficiency, and rack density cons

16 Apr 2026

SuperGrasp: Single-View Object Grasping via Superquadric Similarity Matching, Evaluation, and Refinement

ApplicationsDGX agent

arXiv:2603.29254v2 Announce Type: replace Abstract: Robotic grasping from single-view observations remains a critical challenge in manipulation. However, existing methods still struggle to generate re

WorkRB: A Community-Driven Evaluation Framework for AI in the Work Domain

Model ReleasesDGX agent

arXiv:2604.13055v1 Announce Type: new Abstract: Today's evolving labor markets rely increasingly on recommender systems for hiring, talent management, and workforce analytics, with natural language pr

14 Apr 2026

Beyond RAG for Cyber Threat Intelligence: A Systematic Evaluation of Graph-Based and Agentic Retrieval

AgentsDGX agent

arXiv:2604.11419v1 Announce Type: new Abstract: Cyber threat intelligence (CTI) analysts must answer complex questions over large collections of narrative security reports. Retrieval-augmented generat

Development and evaluation of CADe systems in low-prevalence setting: The RARE25 challenge for early detection of Barrett's neoplasia

Model ReleasesDGX agent

arXiv:2604.11171v1 Announce Type: new Abstract: Computer-aided detection (CADe) of early neoplasia in Barrett's esophagus is a low-prevalence surveillance problem in which clinically relevant findings

How Controllable Are Large Language Models? A Unified Evaluation across Behavioral Granularities

Model ReleasesDGX agent

arXiv:2603.02578v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) are increasingly deployed in socially sensitive domains, yet their unpredictable behaviors, ranging from misalign

StreetDesignAI: A Multi-Persona Evaluation System for Inclusive Infrastructure Design

ResearchDGX agent

arXiv:2601.15671v2 Announce Type: replace-cross Abstract: Designing cycling infrastructure requires balancing the competing needs of diverse user groups, yet designers often struggle to anticipate how

10 Apr 2026

Evaluation as Evolution: Transforming Adversarial Diffusion into Closed-Loop Curricula for Autonomous Vehicles

SafetyDGX agent

arXiv:2604.07378v1 Announce Type: new Abstract: Autonomous vehicles in interactive traffic environments are often limited by the scarcity of safety-critical tail events in static datasets, which biase

OpenPRC: A Unified Open-Source Framework for Physics-to-Task Evaluation in Physical Reservoir Computing

HardwareDGX agent

arXiv:2604.07423v1 Announce Type: new Abstract: Physical Reservoir Computing (PRC) leverages the intrinsic nonlinear dynamics of physical substrates, mechanical, optical, spintronic, and beyond, as fi

11 Jun 2025

Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes

ResearchHuman

AD2-Bench diagnoses multimodal reasoning via a Chain of Evidence, showing failures from spatial ambiguity and semantic uncertainty in adverse urban scenes.

16 Oct 2026

Deep Reinforcement Learning for HPC Job Scheduling: A Statistical Evaluation

SafetyDGX agent

arXiv:2610.21008v1 Announce Type: new Abstract: Deep Reinforcement Learning (DRL) offers learned job selection for High-Performance Computing (HPC), but performance against heuristics alone does not e

SITAR: A Situational Distortion Metric for Automatic Speech Recognition Evaluation

Model ReleasesDGX agent

arXiv:2610.21440v1 Announce Type: new Abstract: In automatic speech recognition (ASR), transcription errors with similar lexical or semantic discrepancies can have markedly different consequences for

15 Oct 2026

Suggested Is Not Superseded: A Pre-Registered Evaluation of a System-One Model as a Memory-Retirement Gate

Model ReleasesDGX agent

arXiv:2610.15710v1 Announce Type: new Abstract: Long-term memory for assistants needs a gate that decides when a new utterance retires an old stored claim. Benchmark labels for this step mark a pair a

The Sum of All Summaries: PROPALIGN for Graded Proposition Salience Evaluation

ResearchDGX agent

arXiv:2610.19387v1 Announce Type: new Abstract: Identification and ranking of salient propositions in documents is indirectly involved in many AI tasks, but few papers define proposition salience scor

14 Oct 2026

Design and Evaluation of a Collaborative Teleoperation Interface for Multi-Operator Multi-Robot Systems in Challenging Environments

ResearchDGX agent

arXiv:2610.15001v1 Announce Type: new Abstract: Multi-robot systems that combine the complementary capabilities of specialised platforms are critical for complex missions in challenging, inaccessible

12 Oct 2026

ManeuverFlow: Maneuver Hypothesis Generation with Future Evidence for Trajectory Evaluation and Refinement in End-to-End Autonomous Driving

Model ReleasesDGX agent

arXiv:2610.13409v1 Announce Type: new Abstract: End-to-end planning in complex scenes must model diverse driving intentions and select the most appropriate trajectory using scene context and future ri

9 Oct 2026

Beyond Type-checking: Towards Holistic Evaluation of Formal Specification Generation

AgentsDGX agent

arXiv:2610.10604v1 Announce Type: cross Abstract: When generating verifiable code, natural language requirements are mapped to machine checked code using LLMs and agentic workflows. A crucial componen

How Should a Prompt Optimizer Spend a Tight Budget? BudgetAPO with Noise-Adaptive Evaluation

ResearchDGX agent

arXiv:2610.05671v2 Announce Type: replace Abstract: Automatic prompt optimization (APO) has been widely employed to adapt large language models without updating their weights, yielding promising resul

SWE-Journey: Towards More Realistic Evaluation of Coding Assistants through Long-Horizon, Multi-Turn Interaction

Model ReleasesDGX agent

arXiv:2610.11559v1 Announce Type: cross Abstract: Coding assistants such as Claude Code and Codex have become a major application of LLM agents, yet existing benchmarks remain far from real-world use,

7 Oct 2026

Comprehensive Evaluation and Fine-Tuning of Foundational Cell Nuclei Segmentation Models in Renal Pathology

ResearchDGX agent

arXiv:2610.07711v1 Announce Type: new Abstract: Accurate nuclei instance segmentation is essential for quantitative renal pathology, yet general-purpose models often struggle with low contrast, dense

6 Oct 2026

ARISE: Adaptive Agentic Reasoning with Image-grounded Self-Evaluation for Interpretable IBD Assessment

AgentsDGX agent

arXiv:2610.04777v1 Announce Type: new Abstract: Inflammatory bowel disease (IBD) requires frequent imaging-based assessment, yet interpretation of modalities such as wireless capsule endoscopy (WCE) a

5 Oct 2026

Oracle headroom without signal: null-calibrated evaluation of candidate selection for thermal heart rate estimation

ResearchDGX agent

arXiv:2610.02561v1 Announce Type: new Abstract: Camera-based physiological monitoring can produce multiple estimates from several facial regions, extraction methods, and processing settings. Signal qu

2 Oct 2026

Deny Without Disabling: Authorization-Paired Evaluation and Control for Multi-Agent Systems

SafetyDGX agent

arXiv:2610.00371v1 Announce Type: cross Abstract: Multi-agent systems derive their capabilities from sharing evidence, delegating tasks, and combining information across agents. The same process creat

SimplexUQ: An Evaluation Framework and Benchmark for Conformal Uncertainty on Simplex-Valued Predictions

Model ReleasesDGX agent

arXiv:2610.00523v1 Announce Type: new Abstract: Conformal prediction guarantees marginal coverage, but a single calibration threshold can still spread that coverage unevenly, over-covering easy region

1 Oct 2026

Concept-Grounded Attention: A Controlled Evaluation of Graph-Injected Attention, Temporal Versioning, and Epistemic Status

SafetyDGX agent

arXiv:2609.38684v1 Announce Type: new Abstract: Knowledge-intensive language-model systems typically represent external knowledge as text chunks or static graphs, with limited support for concept evol

DuplexAct-Bench: Broadening Full-Duplex Speech Evaluation toward Proactive Interaction across Diverse Behavioral Requirements

Model ReleasesDGX agent

arXiv:2609.39446v1 Announce Type: new Abstract: Existing full-duplex speech benchmarks cover only subsets of real-time interaction behaviors, often under limited contextual conditions. We introduce Du

Toward Real-Time VLAs: Stage-Aware Two-Step Flow Denoising and System-Level Evaluation

ResearchDGX agent

arXiv:2609.39822v1 Announce Type: new Abstract: Vision-language-action (VLA) models face a timing gap between low-rate inference and high-rate robot execution. We characterize this gap through end-to-

30 Sept 2026

Dating the Model: Hidden Dates in System Prompts Affect LLM Evaluation

ResearchDGX agent

arXiv:2609.36931v1 Announce Type: new Abstract: Reproducibility is essential for scientific research, yet prior work shows that LLM outputs vary with hardware and batching. We identify an overlooked f

Pair Difficulty Matters: Rethinking Pairwise LLM-as-a-Judge Evaluation and Consistency

SafetyDGX agent

arXiv:2609.37577v1 Announce Type: new Abstract: Large Language Model judges are widely used to rank texts and text-generating systems through pairwise comparison, and their reliability is typically as

Tail-Influence Sampling for CVaR Policy Evaluation

SafetyDGX agent

arXiv:2609.38096v1 Announce Type: new Abstract: Policies with similar mean returns can differ sharply in rare failures, yet estimating lower-tail conditional value-at-risk (CVaR) accurately can requir

29 Sept 2026

A Visual Classification Dataset and Model Evaluation for Historical Manuscript Illustrations

ResearchDGX agent

arXiv:2609.33449v1 Announce Type: new Abstract: Historical manuscript illustrations preserve rich visual evidence of past cultures. They depict people, animals, plants, diagrams, music notations, and

AgentPerfBench: A Benchmarking and Evaluation Suite for Inference Performance of Agentic LLMs

Model ReleasesDGX agent

arXiv:2609.34683v1 Announce Type: new Abstract: The optimization of LLM serving engines, such as vLLM and SGLang, is largely benchmark-driven: optimizations, scheduling policies, hardware and system d

Does Vision-Language Pretraining Granularity Matter? A Controlled Evaluation of Vision-Language Objectives Across Chest X-Ray Interpretation Tasks

ResearchDGX agent

arXiv:2609.31985v1 Announce Type: new Abstract: Vision-language pretraining objectives differ in the spatial granularity of their supervision, yet the implications of this distribution for chest X-ray

Jev in Medicine: A Benchmark Evaluation. Preliminary Results

Model ReleasesDGX agent

arXiv:2609.34024v1 Announce Type: cross Abstract: Jev is a non-generative 'System One' model that assigns probabilities to predefined answer options and cannot answer outside them. Its accuracy and ca

Predicting Delayed Train Trajectories on the Dutch Railway Network: Explainable AI Evaluation of Topological, Operational and Weather Features with Tree Based Ensemble Methods

ResearchDGX agent

arXiv:2609.34692v1 Announce Type: new Abstract: The reliable prediction of passenger train delays is a critical component of railway management. While contemporary research frequently attempts to maxi

RAISE: Reinforcing Access Control Policy Synthesis in LLMs via Symbolic Evaluation

Model ReleasesDGX agent

arXiv:2609.33796v1 Announce Type: cross Abstract: Translating natural-language access-control requirements into policies requires careful reasoning about permissions, constraints, and exceptions, and

Rethinking Circuit Evaluation: Do Circuits Explain Model Errors?

Model ReleasesDGX agent

arXiv:2609.35686v1 Announce Type: new Abstract: Mechanistic interpretability (MI) aims to explain a model's behaviour through analyzing its internal computations; circuit-based explanations aim to iso

25 Sept 2026

Design and Evaluation of LLM Chaining-Based Task Planning for General Purpose Service Robots

Model ReleasesDGX agent

arXiv:2609.29043v1 Announce Type: cross Abstract: General Purpose Service Robot (GPSR) tasks, as defined in the RoboCup@Home benchmark, require robots to interpret diverse natural language commands an

HiPACE: Hierarchical Phase-Boundary Analysis and Controlled Evaluation of Feature Absorption in Sparse Autoencoders

ResearchDGX agent

arXiv:2609.29551v1 Announce Type: new Abstract: Sparse autoencoders (SAEs) decompose LLM activations into sparse dictionary atoms, so that each distinct concept gets its own feature. One recurring beh

Leakage-Safe Machine Learning for Hydrogen Embrittlement Detection in 316L Stainless Steel: A Region-Held-Out Evaluation of Texture and Deep Features in SEM Micrographs

Local AiDGX agent

arXiv:2609.28567v1 Announce Type: new Abstract: Scanning electron microscopy (SEM) is routinely used to characterize the microstructural changes caused by hydrogen embrittlement (HE) in structural ste

24 Sept 2026

A Leakage-Aware Multimodal Evaluation Framework for Early Intraoperative Acute Kidney Injury Prediction

ResearchDGX agent

arXiv:2609.26848v1 Announce Type: cross Abstract: Postoperative acute kidney injury (AKI) after major non-cardiac surgery carries substantial morbidity, yet early intraoperative risk stratification re

Brain-to-Language Decoding: Tasks, Signals, Methods, Evaluation, Practical Use and Beyond

ApplicationsDGX agent

arXiv:2609.27650v1 Announce Type: new Abstract: Brain-to-language decoding translates neural activity associated with language production, internal speech and perception into linguistic or expressive

Comparative Evaluation of Static Embedding Models for HTTP Request Anomaly Detection

Model ReleasesDGX agent

arXiv:2609.26860v1 Announce Type: cross Abstract: Web applications are increasingly targeted by cyberattacks that exploit HTTP requests to evade security mechanisms. Traditional web application firewa

23 Sept 2026

Behavior is Not Enough: A Mechanism-Based Evaluation of Social Norm Emergence in LLM Societies

AgentsDGX agent

arXiv:2609.26481v1 Announce Type: cross Abstract: Social norms cannot be identified from behavior alone: the same cooperative equilibrium may reflect shared expectations, strategic incentives, or simp

Calibration as a First-Class Criterion in LLM Evaluation

SafetyDGX agent

arXiv:2609.26489v1 Announce Type: new Abstract: Calibration of language models -- the alignment between expressed or implicit confidence and empirical correctness -- is a well-studied subfield within

Measuring the Serving Stack Instead of the Model: Hidden Confounds in Local Tool-Use Evaluation

Model ReleasesDGX agent

arXiv:2609.26693v1 Announce Type: new Abstract: A coding agent must emit a valid tool call--a parseable invocation of a tool in the provided schema--before the harness can execute its chosen action. W

22 Sept 2026

AskQE: Question Answering as Automatic Evaluation for Machine Translation

Model ReleasesDGX agent

arXiv:2504.11582v3 Announce Type: replace Abstract: How can a monolingual English speaker determine whether an automatic translation in French is good enough to be shared? Existing MT error detection

Experimental Evaluation of a Low-Power Ultra-Wideband Receiver for Spectrum Sensing

ResearchDGX agent

arXiv:2609.22134v1 Announce Type: cross Abstract: Walsh-sequence-based receiver architectures offer an alternative approach for the reception and reconstruction of multiple simultaneous RF signals ove

Towards Reliable Underwater Diver-Robot Interaction: Gesture Design, Interaction Logic, and Real-World Evaluation

ApplicationsDGX agent

arXiv:2609.23392v1 Announce Type: new Abstract: Underwater human--robot interaction requires gesture commands that are both easy for divers to use and reliable for robots to recognize. We investigate

21 Sept 2026

CityLearn v3: A Configurable Simulation and Evaluation Framework for Realistic Control Studies of Renewable Energy Communities

ResearchDGX agent

arXiv:2609.21570v1 Announce Type: cross Abstract: Renewable energy communities (RECs) coordinate buildings, photovoltaic generation, batteries, electric vehicles and flexible loads. Controller studies

Cross-Lingual Parkinson's Disease Severity Assessment Using Pre-trained Speech Embeddings: A Multi-Class Evaluation

ResearchDGX agent

arXiv:2609.20875v1 Announce Type: cross Abstract: Parkinson's disease (PD) often manifests through speech impairments, facilitating accessible, non-invasive, and cost-effective severity assessment for

Efficient Architecture Search under Leave-One-Subject-Out Evaluation

ResearchDGX agent

arXiv:2609.21457v1 Announce Type: new Abstract: Deep neural architectures are widely used for signal processing in automated pain assessment systems. However, architecture design has remained largely

18 Sept 2026

A Neuropsychologically Grounded Evaluation of LLM Cognitive Abilities

Model ReleasesDGX agent

arXiv:2603.02540v2 Announce Type: replace Abstract: Large language models (LLMs) display a unified 'general factor' of capability across 10 benchmarks (a finding confirmed by our factor analysis of 15

Behavioral Coherence: A Method for Sensitive-Domain LLM Evaluation

SafetyDGX agent

arXiv:2512.13142v5 Announce Type: replace Abstract: People use LLMs for reproductive-health questions, including abortion-related support. A response can sound supportive while answers reinforce harmf

Beyond Depth Truncation: Controlled Evaluation of Depth Utilization in Recursive Language Models

Model ReleasesDGX agent

arXiv:2609.19934v1 Announce Type: new Abstract: Depth-recurrent language models iteratively apply a small layer stack, decoupling per-token compute from distinct parameter count. To determine whether

Evolution or Illusion? Rethinking Evaluation in LLM Evolutionary Search

ResearchDGX agent

arXiv:2609.19799v1 Announce Type: cross Abstract: LLM-driven evolutionary search finds programs by launching seeds and iterating each one. Papers report a single budget setting, usually one seed run f

← Previous
1…3334353637…687
Next →