AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,652
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,793
  • Industry6,824
  • Local Ai7,051
  • Model Releases36,896
  • Research29,820
  • Safety19,754
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,652
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,793
  • Industry6,824
  • Local Ai7,051
  • Model Releases36,896
  • Research29,820
  • Safety19,754
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,652Total entries
60Added by human
127,592Found by agent
13Categories

Knowledge catalogue

Search: “evaluation”

GridTimelineEvolution
41,190 results
12 Oct 2026

BT-Agent: Deploying Onboard Robot Agents with Behavior Trees and Multi-Fidelity Evaluation

Model ReleasesDGX agent

arXiv:2610.13862v1 Announce Type: new Abstract: Deploying language-model agents onboard mobile robots requires task reasoning and responsive execution within limited compute and memory. We propose BT-

Not Just an Evaluation: A Case Study of Discourse Particle Sensitivity in Language Models

Local AiDGX agent

arXiv:2610.13794v1 Announce Type: new Abstract: Discourse particles subtly shape the flow of discourse by reflecting conversational context and interlocutor attitudes, often leaving the truth-conditio

9 Oct 2026

Low-Cost Sensor Calibration for Indoor Air Quality Monitoring: A Dataset, Evaluation Scenarios, and a Lightweight Model

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
ResearchDGX agent

arXiv:2610.11236v1 Announce Type: new Abstract: Low-cost sensors enable scalable indoor air quality monitoring but require calibration because of nonlinear distortions, noise, and temporal drift. The

TRACE: Diagnosing Verifier Brittleness in Agentic Evaluation

Model ReleasesDGX agent

arXiv:2610.11678v1 Announce Type: new Abstract: Verifier scores now serve as both benchmark metrics and training rewards for large language model (LLM) agents, and a change in score is routinely read

8 Oct 2026

Embedded Evaluation of Task Admission Coalescing in Decentralized Multi-Robot Systems

Model ReleasesDGX agent

arXiv:2610.09187v1 Announce Type: new Abstract: Multi-robot task allocators in dynamic missions commonly admit newly released tasks immediately, potentially invoking allocation for each new arrival. W

PHRBench: A Behavioral Evaluation of Post-Hallucination Reasoning in LLMs

Model ReleasesDGX agent

arXiv:2610.10455v1 Announce Type: new Abstract: Hallucinated information can propagate through multi-stage LLM systems and become part of the context for subsequent reasoning. Existing studies of post

7 Oct 2026

Memory Depth and Reconstructed Context Width: A Controlled Evaluation of Hierarchical Retrieval

ApplicationsDGX agent

arXiv:2610.08300v1 Announce Type: new Abstract: Long-term conversational memory is becoming an integral component of modern LLM systems. Proposed architectures group records by topics and events, cons

6 Oct 2026

Component-Level Evaluation of Adaptive PINN Training for CFD-Oriented Crystal Growth Simulation

Model ReleasesDGX agent

arXiv:2610.05127v1 Announce Type: new Abstract: Physics-informed neural network (PINN) training minimizes a weighted combination of partial differential equation (PDE), boundary-condition, and initial

EXHIB: A Benchmark for Realistic and Diverse Evaluation of Function Similarity in the Wild

Model ReleasesDGX agent

arXiv:2604.01554v2 Announce Type: replace-cross Abstract: Binary Function Similarity Detection (BFSD) is a core problem in software security, supporting tasks such as vulnerability analysis, malware c

Probabilistic Pedestrian Forecasts from a Handheld Phone: World-Frame Heat Maps, Visual-Inertial Height Drift, and Evaluation without Ground Truth

Model ReleasesDGX agent

arXiv:2610.04736v1 Announce Type: new Abstract: A pedestrian with a phone could be shown where nearby people will be in the next few seconds, if the forecast stays on the ground while the phone moves,

5 Oct 2026

Evaluation of Sampling Strategies and Physics-Informed Kolmogorov--Arnold Networks in Unbounded Domains

Model ReleasesDGX agent

arXiv:2512.12074v2 Announce Type: replace Abstract: Physics-informed neural networks (PINNs) have emerged as an effective approach for solving partial differential equations (PDEs) by incorporating ph

Forecasting from Counterfactual Simulator Rollouts: A Sim2Real Evaluation

SafetyDGX agent

arXiv:2610.03662v1 Announce Type: new Abstract: Deploying a new decision policy creates a cold-start problem for prediction models whose targets depend on the policy's actions: historical observations

2 Oct 2026

Can LLMs Reason Over Long Horizons? An Empirical Evaluation of Context Strategies for Longitudinal Clinical Reasoning

ResearchDGX agent

arXiv:2610.00562v1 Announce Type: cross Abstract: Longitudinal clinical reasoning requires large language models (LLMs) to identify and integrate relevant evidence distributed across extended patient

False Floors: LLM Safety Routing Evaluations Break Under Distribution Shift

Model ReleasesDGX agent

arXiv:2610.01535v1 Announce Type: cross Abstract: Safety routers send each request to one of several models and are judged against the best single model. A major routing benchmark picks that comparato

No One Architecture Fits All: A Cross-Environment Evaluation of Hierarchical Red Team Agents

SafetyDGX agent

arXiv:2610.00557v1 Announce Type: cross Abstract: Autonomous red team agents increasingly stress-test AI-enabled cyber defenses by planning strategy and executing multistage attacks. Reinforcement lea

When Harnesses Lose the Signal: Causal Evaluation of Recovery in LLM Agents

SafetyDGX agent

arXiv:2610.00372v1 Announce Type: new Abstract: Large language model agents rely on external harnesses to pass information between the model and its environment and to recover from execution errors. Y

1 Oct 2026

ChartRevise: A Dataset and Evaluation Protocol for Exact Chart Editing via Code

ResearchDGX agent

arXiv:2609.38642v1 Announce Type: new Abstract: Chart editing requires cross-modal edit grounding, realizing a requested visual change in the code that draws it, with necessary related updates and wit

30 Sept 2026

Coherence-Aware Distributional Evaluation of Open-Ended Text Generation

Local AiDGX agent

arXiv:2609.34240v2 Announce Type: replace-cross Abstract: Existing open-ended generation metrics measure likelihood, lexical diversity, or distributional similarity in generic representation space, ye

Evaluation Choices Shape Biomedical ML Claims: A Pediatric Pneumonia Benchmark Case Study

Model ReleasesDGX agent

arXiv:2609.37848v1 Announce Type: new Abstract: Biomedical machine learning papers often compress model performance into one headline number. That number can look like a property of the model even whe

29 Sept 2026

API Secrets Should Never Become Tokens in the LLM's Vocabulary: A Threat Analysis of API Credential Handling in LLM Agent Systems and an Empirical Evaluation of a Vault-Mediated Execution Boundary

AgentsDGX agent

arXiv:2609.33371v1 Announce Type: cross Abstract: Tool-using large language model (LLM) agents turn credential hygiene from a storage problem into an execution-security problem. A key pasted into a pr

HeroFrame-Bench: Reference-Anchored Evaluation via Rubric--Ranking Co-Evolution for Movie Hero Frame Selection

SafetyDGX agent

arXiv:2609.32280v1 Announce Type: new Abstract: Hero frames are in-film stills used as source imagery for theatrical posters, streaming cover art, film database listings, and other promotional placeme

Large Language Models for Automated Cross-Domain Machine Learning Task Type Identification: A Benchmark Dataset and Evaluation

Model ReleasesDGX agent

arXiv:2609.35335v1 Announce Type: new Abstract: Machine learning task type identification is essential for constructing valid ML pipelines, yet in practice it is typically specified manually. We inves

Typed Decision Models: An Early Evidence Audit and Evaluation Checklist

Model ReleasesDGX agent

arXiv:2609.32160v1 Announce Type: cross Abstract: Typed decision models (TDMs) return probability distributions over caller-defined options without generating text. TypeSafe released Jev, a commercial

What Can a Leaderboard Certify? Compositional Controllability for Fair Evaluation and Training of Biomedical Literature-Review Agents

Model ReleasesDGX agent

arXiv:2609.32318v1 Announce Type: new Abstract: Leaderboards rank long-horizon agents by their final outputs. Yet a higher score alone does not establish whether two systems are comparable or which st

28 Sept 2026

Offline Policy Evaluation as a decision support tool for designing Adaptive Experiments

SafetyDGX agent

arXiv:2609.30273v1 Announce Type: new Abstract: We investigate how historical data from fixed randomized experiments (A/B tests) can be used to inform the deployment of adaptive experiments based on c

25 Sept 2026

Beneath the Scores: Rethinking Hallucination Evaluation for Video Understanding Models

AgentsDGX agent

arXiv:2609.28991v1 Announce Type: cross Abstract: Video understanding is increasingly performed by multi-stage LLM agents that separate temporal grounding, visual observation, and reasoning. Yet these

Can Labor Markets Function in the Age of AI? The Evaluation Bottleneck in Hiring

ResearchDGX agent

arXiv:2609.30058v1 Announce Type: cross Abstract: AI-assisted job-search tools have become increasingly popular by making it easier to find and apply to jobs. But by making it easier for applicants to

GPT-6-Astra Lights Up Embodied Navigation: Evaluation in Zero-Shot Vision-and-Language Navigation in Continuous Environments

Model ReleasesDGX agent

arXiv:2609.29861v1 Announce Type: new Abstract: We investigate whether GPT-6-Astra, a general-purpose foundation model, can navigate unfamiliar environments using its own perception, reasoning, and de

UltraBench 2: Towards Robust Evaluation of Vision Foundation Models on Ultrasound

Model ReleasesDGX agent

arXiv:2609.28610v1 Announce Type: new Abstract: Benchmarking is an increasingly critical part of research in machine learning and the domains where it is applied, including healthcare. Yet, despite th

24 Sept 2026

A Systematic Evaluation of Infrastructure-Based Radar System for Highway Traffic Monitoring

Model ReleasesDGX agent

arXiv:2609.27143v1 Announce Type: new Abstract: Infrastructure-based radar systems offer robust and long-range solutions for traffic monitoring, yet their detection and tracking performance under real

Multi-View Fusion for Encrypted C2 Detection: A Leakage-Controlled Measurement Study of Evaluation Pitfalls

ResearchDGX agent

arXiv:2609.27311v1 Announce Type: cross Abstract: Command-and-control (C2) traffic increasingly hides within TLS, so defenders now apply machine learning to traffic metadata. Many studies assume that

When Post-Processing Fairness Constraints Help and When They Harm: Evidence from Eight Cross-Domain Evaluations

Model ReleasesDGX agent

arXiv:2609.26955v1 Announce Type: new Abstract: Fairness audits in production ML typically occur once, at deployment, on a single domain. Both fail in practice: fairness can shift after retraining or

23 Sept 2026

CraftBench-UE: Deterministic Evaluation for Coding Agents in Unreal Engine

Model ReleasesDGX agent

arXiv:2609.23142v1 Announce Type: new Abstract: Building gameplay features in a game engine requires more than code, as code that compiles and runs does not necessarily implement the requested gamepla

ReasonLab: A Controlled and Auditable Evaluation of Prompting Techniques for Multiple-Choice QA

ResearchDGX agent

arXiv:2607.14109v2 Announce Type: replace Abstract: Probing the capabilities of Large Language Models (LLMs) and building robust solutions for Multiple-Choice Question Answering (MCQA) remain central

VLAQuantBench: Closed-Loop Evaluation of Post-Training Quantization for Vision-Language-Action Models

Model ReleasesDGX agent

arXiv:2609.25376v1 Announce Type: new Abstract: Post-training quantization reduces the memory requirements of vision-language-action (VLA) models, but precision selection must account for the interact

Zephyron: Integrated Design and Analytical Evaluation of a Solar-Assisted Mobile Manipulator for Multimodal Environmental Reconnaissance and Distributed Visual Inference

SafetyDGX agent

arXiv:2609.25709v1 Announce Type: new Abstract: Environmental reconnaissance needs mobile platforms that carry sensors, preserve measurement context, and return interpretable evidence under limited en

22 Sept 2026

Bridging Reconstruction and Generation: A Latent Distribution Perspective on Evaluation and Improvement

ResearchDGX agent

arXiv:2609.24088v1 Announce Type: new Abstract: In latent generative models, reconstruction quality is often assumed to correlate with generative performance. However, reconstruction FID (rFID) can ex

HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistants

ResearchDGX agent

arXiv:2509.08494v2 Announce Type: replace-cross Abstract: As humans delegate more tasks and decisions to artificial intelligence (AI), we risk losing control of our individual and collective futures.

Initial Evaluation of Potential Bias in Coverage of Humans in Wikidata

SafetyDGX agent

arXiv:2609.22375v1 Announce Type: cross Abstract: Introduction. Open collaborative knowledge graphs such as Wikidata increasingly ground agentic artificial intelligence, information retrieval, and lan

Is Imagination Derived from Hallucination? A Cross-Taxonomy Evaluation of Imagination and Hallucination in Large Language Models

Model ReleasesDGX agent

arXiv:2609.22152v1 Announce Type: new Abstract: Imagination performs as a high-level function of large language models (LLMs) which determines the potential of how an LLM creates unseen or creative co

Preserving What Matters: Semantic Scaffolds Beyond Saturation in Summarization Evaluation

ApplicationsDGX agent

arXiv:2609.22603v1 Announce Type: new Abstract: Summarization ships in countless production systems, making model selection a routine decision that depends on measuring summary quality. Existing metri

21 Sept 2026

CASCADE Against Jailbreaks: Combination Across Stages with Controlled Attack-Defense Evaluation

SafetyDGX agent

arXiv:2609.21793v1 Announce Type: cross Abstract: Defenses against jailbreak attacks on Large Language Models (LLMs) operate at different pipeline stages, such as input modification or output guard, b

CogGym: Towards Large-Scale Comparative Evaluation of Human and Machine Cognition

ResearchDGX agent

arXiv:2609.21259v1 Announce Type: new Abstract: Understanding and modeling human intelligence are parallel goals shared by artificial intelligence (AI) and cognitive science. As AI systems grow increa

18 Sept 2026

Not All Nodes Are Created Equal: Homophily-Aware Stratification for Stable GNN Evaluation

Model ReleasesDGX agent

arXiv:2609.19210v1 Announce Type: cross Abstract: Graph neural networks are widely used for transductive node classification, with accuracy typically measured on randomly drawn train/validation/test s

VakQA: A Benchmark and Evaluation Study for Telugu Spoken Factoid Question Answering

Model ReleasesDGX agent

arXiv:2609.19879v1 Announce Type: new Abstract: Question answering has advanced rapidly with large language models, but predominantly for high-resource languages, in both text and spoken settings. Spo

17 Sept 2026

Generic Characteristic-Zero Equivalence Between Derivative Bezout Inversion and Multipoint Evaluation

ResearchDGX agent

arXiv:2609.17578v1 Announce Type: cross Abstract: Let a_1,ldots,a_m be distinct elements of a field K, and let Z(X)=prod_{i=1}^m (X-a_i). We study the arithmetic complexity of computing the unique nor

Human-Centric Grasp State Assessment: Toward Transferring Subjective Evaluation to Robots

ResearchDGX agent

arXiv:2609.17540v1 Announce Type: new Abstract: We propose a framework that transfers tacit human subjective criteria to robotic systems for the appropriate grasping of deformable objects. Achieving s

16 Sept 2026

EviSI: An Evidence-Based Evaluation Agent for Simultaneous Interpreting

AgentsDGX agent

arXiv:2609.08171v2 Announce Type: replace Abstract: Low-latency simultaneous speech-to-speech translation must keep pace with ongoing speech while preserving key information. To meet these demands, sy

15 Sept 2026

A Personalized Dynamic Balance Evaluation Paradigm for Hip Exoskeleton-Assisted Walking under Unexpected Ground Perturbations

ResearchDGX agent

arXiv:2609.14765v1 Announce Type: cross Abstract: Hip exoskeletons may improve recovery from unexpected gait perturbations, yet personalizing assistance remains difficult because balance is multidimen

Automated Perceptually-Motivated Assessment of Photographic Consistency in Paired Clinical Photographs: Pipeline Development and Internal Evaluation

ResearchDGX agent

arXiv:2609.15144v1 Announce Type: new Abstract: Purpose: Paired pre- and post-operative photographs are the standard unit of evidence for plastic surgical outcomes, yet no objective metric verifies wh

Forward-Facing Near-Infrared Adds Little to Colour for Farm-Machinery Traversability: A Site-Disjoint Evaluation of Sensor-Dependent Spatial Leakage

AgentsDGX agent

arXiv:2609.13265v1 Announce Type: cross Abstract: Near-infrared (NIR) imaging does not consistently outperform standard color cameras for daytime agricultural traversability once spatial data leakage

Fusing Spectral Signatures and Activation Clustering for Backdoor Detection in Healthcare Imaging Models: Method, Implementation, and Evaluation

Model ReleasesDGX agent

arXiv:2609.14290v1 Announce Type: cross Abstract: Machine learning models are increasingly deployed in healthcare imaging pipelines for diagnostic support, and training-time attacks against them are a

11 Sept 2026

Evaluation of Vision-Language Models Across Diverse Coastal Environments

SafetyDGX agent

arXiv:2609.10855v1 Announce Type: new Abstract: Vision-language models (VLMs) enable robotic per- ception by associating visual observations with natural-language concepts. Yet their performance in co

10 Sept 2026

Adversarial Training for Tabular Credit Scoring: A Multi-Attack Robustness Evaluation in P2P Lending

Model ReleasesDGX agent

arXiv:2609.09945v1 Announce Type: new Abstract: Machine learning-based credit scoring is increasingly central to Peer-to-Peer (P2P) lending, yet its resilience to adversarial manipulation, where appli

Graph-Based Personalized Memory for LLM Agents: Representation, Evolution, Retrieval, and Evaluation

AgentsDGX agent

arXiv:2609.08599v1 Announce Type: new Abstract: Large Language Model (LLM) agents are evolving from single-session tools toward long-term personal assistants that must adapt to individual users across

9 Sept 2026

Rethinking the Evaluation of Efficiency Methods for Multi-Agent Systems

Model ReleasesDGX agent

arXiv:2609.05933v1 Announce Type: new Abstract: Efficiency is increasingly important for Large Language Model (LLM)-based multi-agent systems (MAS), as larger models and more agents introduce substant

7 Sept 2026

An Evaluation Framework for Generating Multi-View Images of a Person in a Scene

ResearchDGX agent

arXiv:2609.04603v1 Announce Type: new Abstract: Recent generative image-editing Diffusion Transformers (DiTs) demonstrate impressive semantic editing capabilities but still struggle with spatially con

Development and Evaluation of Ultrasound Image Learning Pipelines for MASLD Risk Stratification

ResearchDGX agent

arXiv:2609.04390v1 Announce Type: cross Abstract: Metabolic dysfunction-associated steatotic liver disease (MASLD) affects approximately 30% of the general population. Ultrasound-based imaging, includ

4 Sept 2026

Beyond Endpoint Scores: Time- and Capacity-Conditioned Evaluation of Continual Knowledge Updating

Model ReleasesDGX agent

arXiv:2609.03900v1 Announce Type: new Abstract: Continual knowledge-updating methods are often declared superior from one final checkpoint and one conventional adapter rank. We show that this can be i

Reducing Catastrophic Risk from AI with Systematic Monitoring and Evaluation of Rogue AI Progression

ResearchDGX agent

arXiv:2609.03189v1 Announce Type: cross Abstract: This article presents a structured framework of behavioral indicators that may signal progression toward potentially catastrophic threats from artific

← Previous
1…2829303132…687
Next →