AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “evaluation”

GridTimelineEvolution
41,190 results
24 Sept 2026

State-Grounded Conditioning: Wrapping User-Facing LLM Agents Where Direction Depends on Live State

Model ReleasesDGX agent

arXiv:2609.27606v1 Announce Type: new Abstract: We introduce State-Grounded Conditioning (SGC), a design principle for user-facing LLM agents that must condition on live user state (game state, sessio

VLM2GeoVec: Toward Universal Multimodal Embeddings for Remote Sensing

Model ReleasesDGX agent

arXiv:2512.11490v2 Announce Type: replace Abstract: Satellite imagery differs from natural images in viewpoint, resolution, scale variation, and the prevalence of small objects -- demanding both regio

What Changed? Drift Detection with Real, Virtual, and Incomparable Diagnosis

ResearchDGX agent
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

arXiv:2609.27865v1 Announce Type: cross Abstract: Sharing a deep encoder does not, by itself, fix the central confound of task-comparison scores. We show that cross-evaluated heads on a frozen shared

What Makes a Terminal-Bench Task Hard? Separating Genuine Hardness from Fake-Hardness on an Adjudicated Agentic Corpus

AgentsDGX agent

arXiv:2609.26826v1 Announce Type: cross Abstract: Frontier benchmarks need tasks that current models cannot solve. But a task that no model solves is not automatically a hard task. The same zero pass

When Visual Quality Misleads: Intent Recognition under Rendered Avatar Distortions

SafetyDGX agent

arXiv:2609.27560v1 Announce Type: cross Abstract: Avatar-streaming systems are commonly evaluated with image and video quality assessment (IQA/VQA) metrics, implicitly treating visual fidelity as a pr

23 Sept 2026

Benchmarking Robots for Everyday Environments: From Lab Experiments to Real-World Operations

SafetyDGX agent

arXiv:2609.26490v1 Announce Type: new Abstract: This study introduces an interdisciplinary framework for benchmarking robots deployed in public environments, addressing the gap between traditional lab

Beyond End-Task Success: How to Audit Visual Experience Retrieval in Robotics

SafetyDGX agent

arXiv:2609.26567v1 Announce Type: new Abstract: Robots that store past experiences must select which one to reuse in a new scene. Most systems select by visual similarity, and most evaluations report

Building Trustworthy Mental Health Benchmarks on Bluesky: A Validation-Aware Weak-Supervision Framework

Model ReleasesDGX agent

arXiv:2609.22696v1 Announce Type: new Abstract: Decentralized social media platforms create new opportunities and challenges for computational mental health research because data access, moderation, l

CableVLA: Simulation-Privileged Global-Local Representation Learning for Cable Routing

Model ReleasesDGX agent

arXiv:2609.25606v1 Announce Type: new Abstract: Cable routing requires coordinated control of global cable topology and changing local contacts. We present CableVLA, an end-to-end multimodal vision-la

Can We Predict Anomaly Detection Performance from Embedding-Space Geometry?

Local AiDGX agent

arXiv:2609.26460v1 Announce Type: new Abstract: Anomaly detection systems are often trained using normal data alone, while model selection and evaluation typically require labeled anomalies. We study

Concept Drift from a Causal Perspective

ApplicationsDGX agent

arXiv:2609.25340v1 Announce Type: new Abstract: Concept drift is a common phenomenon in real-world data streams, in which changes in the data-generating distribution can degrade predictive model perfo

Designing an Efficient Excavator Bucket for Lunar ISRU: A Comparative Study with Vision-Based Fill and Displacement Analysis

ResearchDGX agent

arXiv:2609.25724v1 Announce Type: new Abstract: This paper present a spiral-cavity wheel for lunar regolith excavation and a sensor-light evaluation stack that jointly estimates fill ratio (vision), s

Discrete vs. Continuous: A Comprehensive Study of Unified Audio Understanding in LALMs

Model ReleasesDGX agent

arXiv:2609.22851v2 Announce Type: cross Abstract: Large Audio Language Models (LALMs) utilize either continuous features or discrete tokens, yet the optimal representation paradigm for general audio u

Divergent strategies and convergent outcomes in autonomous materials discovery

AgentsDGX agent

arXiv:2609.23957v1 Announce Type: new Abstract: Scientific agents are mostly evaluated on whether they complete tasks or recover known results; we instead study variation across repeated open-ended ca

DreamStream: Towards Policy-Oriented Generative Simulation for End-to-End Driving

Model ReleasesDGX agent

arXiv:2609.26792v1 Announce Type: new Abstract: Faithfully evaluating end-to-end driving policies in simulation requires observations that are not merely photo-realistic, but preserve the scene featur

EDGEGEN: Improving Tool-Calling Agents Beyond Happy Paths with Synthetic Edge Case Generation

Model ReleasesDGX agent

arXiv:2609.24115v1 Announce Type: new Abstract: Tool-calling LLM agents are increasingly deployed in enterprise applications. However, effective evaluation and optimization require high-quality, diver

Fairly Compensated Distributed Information Retrieval and Augmentation for AI Agents

SafetyDGX agent

arXiv:2609.22601v1 Announce Type: cross Abstract: The increasing reliance of autonomous AI agents on external and distributed knowledge sources introduces a fundamental challenge for decentralized inf

FinFIRST: Benchmarking Search Agents for Financial Information Retrieval, Sourcing and Traceability

Model ReleasesDGX agent

arXiv:2609.25192v1 Announce Type: new Abstract: Financial search is a highly demanding task for LLM agents, requiring not only a correct final answer but also temporally valid information retrieval, a

FMMD: A multimodal multidisciplinary dataset of open peer reviews from F1000Research

SafetyDGX agent

arXiv:2602.14285v2 Announce Type: replace-cross Abstract: Automated scholarly paper review (ASPR) has entered the coexistence phase with traditional peer review, where artificial intelligence (AI) sys

Higher-Order Approximation of Exit Functionals in Sampling-Based Stochastic Model Predictive Control

SafetyDGX agent

arXiv:2609.25257v1 Announce Type: cross Abstract: Safety evaluation in sampling-based stochastic model predictive control often requires numerical estimation of exit functionals. The approximation of

How SWE-Serve Exposes the Gap Between Local Tests and Live Serving

Local AiDGX agent

SWE‑Serve evaluates AI coding agents on 53 inference‑engineering tasks derived from SGLang pull requests across six functional domains. Among 19 tasks that launch a live server, patches that pass loca

In-Context Guidance: Learning Inter-Task Synergies via Numerical Foundational Models for Few-Shot Multitask Optimization

TutorialsDGX agent

arXiv:2609.25836v1 Announce Type: new Abstract: Multi-task optimization (MTO) addresses a set of optimization tasks simultaneously, often suffering from inaccurate inter-task relationship estimation u

Interpretable AI plus Handheld, Portable Retinal Photographs: A Low-Cost Glaucoma Screening Solution for West Africa

ResearchDGX agent

arXiv:2609.25697v1 Announce Type: new Abstract: Purpose: To develop and evaluate an interpretable artificial intelligence (AI) framework for glaucoma screening from low-cost portable, handheld retinal

MCPGen: Benchmarking LLMs on Executable MCPWorkflow Development

Model ReleasesDGX agent

arXiv:2609.23925v1 Announce Type: cross Abstract: We study whether LLMs can produce executable workflow artifacts that remain consistent across graph structure, tool implementation, schema bindings, a

MOLA LiDAR-Inertial Odometry (MOLA-LIO) on the COMFORT Localization Benchmark

Model ReleasesDGX agent

arXiv:2609.25813v1 Announce Type: new Abstract: This short report documents our entry to the COMFORT Localization Benchmark (IROS 2026), evaluated on the GrandTour dataset recorded with the Boxi paylo

One Domain, Many Tongues: Composing Domain and Language LoRAs for Cross-Lingual Remote-Sensing MLLMs without Paired Data

ResearchDGX agent

arXiv:2609.26097v1 Announce Type: new Abstract: Remote-sensing (RS) multimodal large language models (MLLMs) are trained and evaluated only in English, while text-only instruction data covers over 100

PINNForge: Execution-Grounded Evolutionary Design of Physics-Informed Neural Networks for PDE Solving via Large Language Models

ResearchDGX agent

arXiv:2609.23023v1 Announce Type: new Abstract: Physics-informed neural networks (PINNs) require coordinated choices over network representation, sampling, loss construction, and optimization, while e

Predictive Uncertainty for Neural CAE Surrogates

ResearchDGX agent

arXiv:2609.25430v1 Announce Type: new Abstract: Neural surrogates can substantially accelerate computer-aided engineering (CAE) workflows, but their use in design requires uncertainty estimates that r

Same Quantity, Different Answer: Numerical Representation Invariance in Language Models

Model ReleasesDGX agent

arXiv:2609.25009v1 Announce Type: new Abstract: Numerically equivalent word problems should yield the same canonical answer whether a quantity is written as a decimal, fraction, percentage, number wor

SelfOp: An Optimization Algorithm for Self-Improving Security Agents

Model ReleasesDGX agent

arXiv:2609.22792v1 Announce Type: cross Abstract: LLM agents are increasingly used for security tasks: vulnerability discovery, exploit reproduction, and patch generation. Improving them at the model

Social Influence and the Allocation of Scientific Attention in AI Populations

AgentsDGX agent

arXiv:2609.22408v1 Announce Type: new Abstract: AI systems are becoming participants in the evaluation and use of scientific research. They encounter citation counts, download statistics and lists of

The Price of Safety: Benign-Case Utility and Token Overhead of Memory-Poisoning Defenses in LLM Agents

SafetyDGX agent

arXiv:2609.22818v1 Announce Type: cross Abstract: Memory-poisoning defenses for LLM agents are typically evaluated by their ability to prevent attacks. However, the traffic they process is rarely adve

Truth for Believable AI: Expressed Doubt, Provenance, and Belief Revision as an Engineerable Stance

Model ReleasesDGX agent

arXiv:2609.26035v1 Announce Type: new Abstract: Conversational agents often express answers in a uniformly confident register. We test whether expressed uncertainty, provenance-aware assertion, and ex

You Should Be Properly Scoring Your Odometry

ApplicationsDGX agent

arXiv:2609.25900v1 Announce Type: new Abstract: When we evaluate the performance of our odometry, it is common practice to score the estimated track against a ground truth. Unfortunately, scoring uses

22 Sept 2026

A Hybrid Quantum Neural Network to Analyse Big Experimental Powder X-ray Diffraction Data

ApplicationsDGX agent

arXiv:2609.22376v1 Announce Type: cross Abstract: Quantitative analysis of experimental powder X-ray diffraction data remains challenging when evaluating complex multiphase materials and noisy measure

A Patient World Model for Early Forecasting of Digital Health Campaign Outcomes: Capabilities and Limits

ResearchDGX agent

arXiv:2609.23333v1 Announce Type: new Abstract: Digital direct-to-consumer (DTC) health campaigns are usually measured after the fact. In-flight forecasting commonly relies on a separate classifier fo

A Red-Team Study of Anthropic Fable 5 & Opus 4.8 Models

SafetyDGX agent

arXiv:2606.18193v2 Announce Type: replace-cross Abstract: We evaluate the adversarial robustness of three frontier large language models (LLMs) developed by Anthropic, Opus 4.8, Fable 5 and its succes

A Temporal Knowledge Graph for Music Festival Lineup Forecasting

ApplicationsDGX agent

arXiv:2609.24467v1 Announce Type: new Abstract: Music festival lineups emerge from complex relationships among artists, genres, releases, labels, and past performances, making the prediction of future

ActiveArena: Benchmarking and Understanding Active Perception in Robotic Manipulation

Model ReleasesDGX agent

arXiv:2609.24124v1 Announce Type: new Abstract: Active perception and manipulation are crucial for robots to interact with complex scenes. Existing benchmarks struggle to evaluate how robots effective

AI-inferred expressed well-being and collective-action discourse in climate-change campaigns on X

ResearchDGX agent

arXiv:2609.22096v1 Announce Type: new Abstract: Climate campaigns are often evaluated through attention and mobilization, but less is known about the well-being language that accompanies them. Whether

Anatomy of a Closed-Loop Collapse: A Causal Case Study of a Compressed VLA Policy

SafetyDGX agent

arXiv:2609.23048v1 Announce Type: cross Abstract: Compressed manipulation policies can pass offline evaluation while failing in closed-loop execution; this dissociation is established in prior work an

Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT

ResearchDGX agent

arXiv:2609.22291v1 Announce Type: new Abstract: This paper presents a comprehensive experimental evaluation and detailed analysis of state-of-the-art multi-object tracking algorithms, with an emphasis

DFD-Lab: A Modular Audio-Visual Deepfake Detection Pipeline

ResearchDGX agent

arXiv:2609.23830v1 Announce Type: new Abstract: Comparing audio-visual deepfake detectors requires coordinating dataset adaptation, temporal input representation, model interfaces and experimental con

ETH-TraceBench: A Large-Scale Event-Stream Benchmark for Ethereum DeFi under Temporal, Protocol, and Contract Shift

Model ReleasesDGX agent

arXiv:2609.23659v1 Announce Type: new Abstract: Ethereum decentralized finance (DeFi) provides a public, time-stamped record of transaction-level event streams, but the same public symbols can create

Federated Multilingual Speech-LLMs: Architecture and Aggregation Strategy Benchmarking

Model ReleasesDGX agent

arXiv:2609.23825v1 Announce Type: new Abstract: We present a comprehensive benchmark of Federated Learning (FL) for multilingual Automatic Speech Recognition (ASR), evaluating four Speech-LLM architec

FRAMES: Failure Recovery And Monitoring of Embodied Skills for Humanoid Loco-Manipulation

AgentsDGX agent

arXiv:2609.22538v1 Announce Type: new Abstract: Large language model (LLM) planners can decompose natural-language instructions and select reusable robot skills, but choosing the correct skill does no

Graph Learning for Cross-Subject, Cross-Population EEG Emotion Decoding and Model-Derived Spatial-Spectral Neural Signatures

ResearchDGX agent

arXiv:2609.22103v1 Announce Type: cross Abstract: Electroencephalography (EEG) provides a noninvasive means of capturing emotion-related neural dynamics, yet reliable EEG emotion decoding lacks models

Infectious Bovine Pinkeye Detection Using Computer Vision and Imbalance-Aware Learning

ResearchDGX agent

arXiv:2609.23714v1 Announce Type: new Abstract: Infectious bovine pinkeye is a contagious ocular disease that adversely affects cattle health, welfare, and agricultural productivity. Conventional diag

Large language models in medical time series analysis

ApplicationsDGX agent

arXiv:2609.22262v1 Announce Type: cross Abstract: Medical time series (MedTS), including electrocardiograms (ECG), electroencephalograms (EEG), photoplethysmography (PPG), and vital-sign recordings, a

M3GA-Wild: A Large-Scale Dataset and Benchmark for Multi-Modal Multi-session Ground-to-Aerial Place Recognition in Forests

Model ReleasesDGX agent

arXiv:2609.23003v1 Announce Type: new Abstract: We present M3GA-Wild, the first benchmark for multi-modal, multi-session ground-to-aerial place recognition in forests. M3GA-Wild unifies and extends ex

MIS-Bench: Benchmarking Multimodal LLMs for Psychotherapeutic Interpersonal Skills Assessment

Model ReleasesDGX agent

arXiv:2609.22778v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are increasingly used as evaluators, yet their reliability in professional assessment tasks that require expert

Moonworks Lunara: Modeling Artistic Intelligence

Model ReleasesDGX agent

arXiv:2609.22272v1 Announce Type: new Abstract: We formulate Artistic Intelligence as exploration driven world realization, leaving space for creative possibility while preserving the semantic, artist

ORDER: A Fictitious-World Benchmark for Domain-Adaptive Embodied AI

Model ReleasesDGX agent

arXiv:2609.22285v1 Announce Type: new Abstract: Adapting language models to new domains via continual pre-training raises a basic evaluation problem: if the training corpus overlaps with what the mode

ORION-CMR: On-scanner Reporting with Integrated Foundation Model for End-to-End Cardiac MRI Analysis and Interpretation

Local AiDGX agent

arXiv:2609.23950v1 Announce Type: cross Abstract: Cardiovascular magnetic resonance (CMR) provides comprehensive cardiac assessment but remains underutilized because of the complexity of acquisition,

Perplexity Cost Understates What Activation Quantisation Breaks

SafetyDGX agent

arXiv:2609.23125v1 Announce Type: new Abstract: Activation quantisation is usually evaluated with an aggregate metric, perplexity, averaged over every token a model predicts. We ask whether that avera

PII-TRACE: A Benchmark for Context-Aware PII Detection in Multi-Turn LLM Conversations

Model ReleasesDGX agent

arXiv:2609.22200v1 Announce Type: new Abstract: LLM assistants and agentic systems log long multi-turn conversations. AI providers often scan these conversations for Personally Identifiable Informatio

Privacy Personalization Trade offs in LLMs: The Impact of Stylometric Signal Reduction on User-Specific Text Generation

Model ReleasesDGX agent

arXiv:2609.22112v1 Announce Type: new Abstract: Large language models (LLMs) have demonstrated the ability to generate user-specific text with high stylistic fidelity. However, the personal data that

R-GEAN: Regimen-Guided Edit Action Network for Within-Admission Medication Change Prediction

Model ReleasesDGX agent

arXiv:2609.22959v1 Announce Type: cross Abstract: The medications prescribed to a patient often change during a hospital admission as clinicians start, stop, or continue therapies. We study whether mo

SCRAMPPI: Contingency-Constrained Planning using Hamilton-Jacobi Reachability

AgentsDGX agent

arXiv:2603.26995v2 Announce Type: replace Abstract: Autonomous robots commonly aim to achieve a nominal objective while minimizing a cost. Without contingency preparation, this can leave them vulnerab

Semi-automated reconstruction of indoor geometry from 360-degree video for CFD-based airflow analysis in classrooms

Model ReleasesDGX agent

arXiv:2609.23425v1 Announce Type: new Abstract: Computational Fluid Dynamics (CFD) is widely used to evaluate ventilation and contaminant transport in occupied buildings, but deployment at scale is li

← Previous
1…141142143144145…687
Next →