AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “evaluation”

GridTimelineEvolution
41,190 results
1 Oct 2026

DyRAD: Radar Novel View Synthesis for Dynamic Driving Scenes

Model ReleasesDGX agent

arXiv:2609.39841v1 Announce Type: new Abstract: Reconstructing dynamic driving scenes from recorded sensor data supports closed-loop evaluation of autonomous driving systems by synthesizing observatio

ECHO-G: Embodied Co-speech Humanoid mOtion Generation

Model ReleasesDGX agent

arXiv:2609.39575v1 Announce Type: cross Abstract: Generating full-body co-speech motion for humanoid robots requires coordinating speech prosody, linguistic content, and embodiment-specific motion. To

EHR-RobustGym: Benchmarking and Training Agents for Robust Clinical Reasoning

ResearchDGX agent

arXiv:2609.39371v1 Announce Type: new Abstract: In hospital workflows, electronic health records (EHRs) are often noisy, and may not contain the evidence needed to confirm events or measurements refer

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

Eigenism: Ethics for a Human-AI Future

SafetyDGX agent

arXiv:2606.12420v2 Announce Type: replace-cross Abstract: Our concepts of survival and self-interest were built for single, continuous biological lives. These ideas break down when applied to artifici

Feature-Aware Token Attack for Compression-Triggered Stealthy Failures in Large Vision-Language Models

ResearchDGX agent

arXiv:2609.39134v1 Announce Type: new Abstract: Visual-token compression improves the efficiency of large vision-language models, but can expose failures that full-token evaluation misses. We study ad

Fiatlux: A Long-Horizon Benchmark for Humanoid Ladder Climbing and Light-Bulb Replacement

Model ReleasesDGX agent

arXiv:2609.38216v1 Announce Type: new Abstract: Existing benchmarks evaluate tabletop manipulation, flat-floor household activity, or humanoid locomotion and manipulation as separate task groups; none

Framing the Narrative: Ideological Mimicry in Large Language Models

ResearchDGX agent

arXiv:2609.38256v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used to answer questions about politically contentious issues, yet evaluations typically treat a model's s

From Solo to Social Learning: Characterizing Recursive Social Improvement in LLMs

AgentsDGX agent

arXiv:2609.38516v1 Announce Type: cross Abstract: Large language models (LLMs) can now improve themselves by revising the instructions they follow, and LLM agents are increasingly orchestrated to work

GeoGAT: Bidirectional Temporal Sampling Meets Hierarchical Graph Attention for Global Video Geo-localization

Model ReleasesDGX agent

arXiv:2609.39128v1 Announce Type: new Abstract: Global video geo-localization aims to infer the geographic location of a video worldwide, evaluating performance across four geographic hierarchies: cit

Hierarchical Reasoning Model

Model ReleasesDGX agent

arXiv:2506.21734v4 Announce Type: replace Abstract: Reasoning, the process of devising and executing complex goal-oriented action sequences, remains a critical challenge in AI. Current large language

LeanPolish: Verified Supervision for Lean Proof Compression

Model ReleasesDGX agent

arXiv:2609.38384v1 Announce Type: new Abstract: Verified proof edits offer a natural source of supervision for improving language-model-generated Lean proofs. Yet verification establishes that an edit

MedRECT: A Bilingual Medical Reasoning Benchmark for Error Correction in Clinical Texts

Model ReleasesDGX agent

arXiv:2511.00421v2 Announce Type: replace-cross Abstract: Large language models (LLMs) show promise in medical applications, but their ability to detect and correct errors in clinical texts remains un

MetaSteer: Context-Conditioned, nonlinear Steering via Attention-Projection Adaptation

Local AiDGX agent

arXiv:2609.38718v1 Announce Type: new Abstract: Steering large language models typically relies on linear, context-independent interventions in activation space, an assumption that recent work has cha

NAQD Env: A benchmark for selective withdrawal in language agents

Model ReleasesDGX agent

arXiv:2609.38460v1 Announce Type: new Abstract: Language agents must revise planned actions when evidence changes, permission is revoked, or a stop instruction arrives. A useful response is selective:

OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific Software

Model ReleasesDGX agent

arXiv:2609.39903v1 Announce Type: new Abstract: Scientific software presents a demanding test for computer-using agents based on visual language models (VLMs): completing a research workflow requires

Prequential E-Values for Selected-GP Near-Optimality Certificates

ResearchDGX agent

arXiv:2609.39123v1 Announce Type: new Abstract: When optimizing an expensive black-box function sequentially, as in hyperparameter optimization, we may want to stop once the best evaluated value is ce

RealWorldShop: Benchmarking and Improving Conversational Shopping Agents in Real-World E-commerce

Model ReleasesDGX agent

arXiv:2609.38974v1 Announce Type: new Abstract: Large language models are reshaping ecommerce from static recommenders into interactive shopping assistants, yet real-world shopping requires session-le

Same Loss, Different Gradients

ResearchDGX agent

arXiv:2609.38786v1 Announce Type: new Abstract: Differentiable learning typically assumes that the scalar objective evaluated in the forward pass and the gradient supplied to the optimizer in the back

SCALE: Synthetic Calibration via Agreement Labeling in Embedding Space

ResearchDGX agent

arXiv:2609.38705v1 Announce Type: new Abstract: Foundation models for computational pathology are usually evaluated using AUC and accuracy, while calibration is often left untested. This matters becau

Self-Spec Verifiable Code Generation

Model ReleasesDGX agent

arXiv:2609.39568v1 Announce Type: cross Abstract: Large language models (LLMs) may generate unreliable code on corner cases missed by testing, while formal verification can provide machine-checkable g

Stress-Testing LLM Lie Detectors: Role-Play Failures and Spurious Correlations

SafetyDGX agent

arXiv:2609.39807v1 Announce Type: cross Abstract: Lie detection probes aim to predict from a language model's internal states whether its output is truthful or dishonest. However, role-play complicate

The Invisible Language Tax: Token Premiums of French and Regional Languages in 2026 LLM Tokenizers, and a French-Optimized Prototype

Model ReleasesDGX agent

arXiv:2609.39001v1 Announce Type: cross Abstract: LLM services are billed per token and context windows are measured in tokens, yet the number of tokens needed for the same content varies across langu

WARP: A Unified Benchmark for Invisible Image Watermarking -- Robustness and Protection Against Attacks

Model ReleasesDGX agent

arXiv:2609.40031v1 Announce Type: cross Abstract: Digital image watermarking is increasingly critical in media contexts, as emerging regulations and industry practices require marking AI-generated con

30 Sept 2026

AdvancedMathBench: A Benchmark Suite for Advanced Mathematical Proof Generation and Verification

Model ReleasesDGX agent

arXiv:2607.11849v2 Announce Type: replace Abstract: Large language models (LLMs) have achieved remarkable performance on high-school and competition-level mathematics, yet their capabilities on advanc

AgentBug-Smith: Automatically Reproducing Real-World Harness Bugs in Agentic Systems

Model ReleasesDGX agent

arXiv:2609.37864v1 Announce Type: cross Abstract: Agent harness bugs exhibit unique characteristics and remain challenging for state-of-the-art software agents to repair. Progress in this area is furt

Auditable Long-Term Memory: A Deterministic Retrieval Chain Measured at 479/475 of 500 on LongMemEval-S

Model ReleasesDGX agent

arXiv:2609.38021v1 Announce Type: cross Abstract: We evaluate an auditable long-term memory system on LongMemEval-S. Its retrieval chain uses hybrid candidate retrieval, cross-encoder reranking, cover

Benchmarking Automatic Speech Recognition Tools for Iberian Languages

Model ReleasesDGX agent

arXiv:2609.36920v1 Announce Type: new Abstract: Comprehensive evaluations of automatic speech recognition (ASR) for Iberian languages remain limited, and low-resource languages, biases, and efficiency

Beyond Rule-Based Mutation Testing: Test-Aware Mutant Generation Using Large Language Models

Model ReleasesDGX agent

arXiv:2609.35841v1 Announce Type: cross Abstract: Mutation testing evaluates test-suite adequacy by injecting synthetic faults into program code. However, traditional rule-based tools often generate l

Concept Direction Reliability Across Languages with Different Tokenizer Fertility

ResearchDGX agent

arXiv:2609.36194v1 Announce Type: new Abstract: Extracted sentiment directions can vary across samples even when downstream sentiment classification remains accurate. To evaluate direction reproducibi

Distill Locally, Schedule Globally: Flow Maps for Few-Step Text-to-Speech

Local AiDGX agent

arXiv:2609.36324v1 Announce Type: cross Abstract: Flow-matching text-to-speech (TTS) models achieve high synthesis quality but require many neural function evaluations (NFEs) to integrate their genera

From Dead Code and Static Requirements to Working Engines: Software Revival with Coding Agents

Model ReleasesDGX agent

arXiv:2609.36161v1 Announce Type: cross Abstract: Can coding agents restore software that no longer runs while preserving its underlying methods, and reconstruct industrial software engines from open

InterBias-SV: Compound Conditions in Speaker Verification

Model ReleasesDGX agent

arXiv:2609.36500v1 Announce Type: cross Abstract: Speaker verification systems encounter combinations of noise, channel distortion, and changes in speech. Evaluating each condition separately does not

Jaxolotl: A Unified High-Performance Benchmark Suite for LTL-Based Multi-Task RL

Model ReleasesDGX agent

arXiv:2609.38065v1 Announce Type: cross Abstract: Training agents to follow arbitrary instructions is an important goal of multi-task reinforcement learning (RL). Linear temporal logic (LTL) provides

Learning as Deepfakes Evolve: RF-Prompt for Continual Audio Deepfake Detection

ResearchDGX agent

arXiv:2609.37586v1 Announce Type: cross Abstract: Continual audio deepfake detection requires learning newly emerging deepfake methods while retaining discrimination of previously encountered speech.

Learning Nonlinear Finite Element Solution Operators using Multilayer Perceptrons and Energy Minimization

ResearchDGX agent

arXiv:2412.04596v3 Announce Type: replace Abstract: We develop and evaluate a method for learning solution operators to nonlinear problems governed by partial differential equations (PDEs). The approa

LLM unbranding: Erasing Commercial Identity while Preserving Generic Utility

Model ReleasesDGX agent

arXiv:2609.37127v1 Announce Type: new Abstract: Establishing unbranding as a critical practice to prevent visual logos from acquiring negative connotations is standard in image generation. Large Langu

Lost in Conversation or Lost in Translation? Diagnosing Multi-Turn Degradation in RAG

ResearchDGX agent

arXiv:2609.36700v1 Announce Type: cross Abstract: When conversing with large language models (LLMs), users often begin with a simple question and build towards a multi-hop question through follow-up t

Multichannel Audio Quality Assessment: Extending Pretrained Perceptual Models to Spatial Audio

ResearchDGX agent

arXiv:2609.37116v1 Announce Type: cross Abstract: Accurate perceptual quality assessment is essential for evaluating and optimizing spatial audio, where perceived quality depends on both signal fideli

NIDAR: NIR-Guided Intrinsic Decomposition for Scalable Scene-Agnostic LiDAR Intensity Reconstruction

ResearchDGX agent

arXiv:2609.36878v1 Announce Type: new Abstract: LiDAR return intensity provides complementary surface-response cues for robotic perception and state estimation, yet many simulation pipelines omit it o

Retrieval Sensitivity to Identity Signals in Queries

SafetyDGX agent

arXiv:2609.36534v1 Announce Type: new Abstract: Dense retrievers decide which documents reach users and the language models that use them, yet they are typically evaluated with neutral queries. We ask

RoboChrono: A Real Robot Benchmark for Streaming Task Understanding

Model ReleasesDGX agent

arXiv:2609.36605v1 Announce Type: new Abstract: Understanding ongoing robot manipulation requires models to interpret visual observations in relation to interaction history and task progress. We intro

SQUARE: Structured Quantum Representation Adapters as Compact Quadratic Feature Maps for Frozen Language Models

Model ReleasesDGX agent

arXiv:2609.37134v1 Announce Type: cross Abstract: Frozen language models (LMs) are increasingly used as fixed feature extractors for downstream reranking, scoring, and preference modeling, raising a p

Think Before You Score: Thinking Reward Model for Visual Generation

SafetyDGX agent

arXiv:2609.37372v1 Announce Type: new Abstract: Visual reward models are essential for evaluating and improving visual generation models, yet existing approaches typically map task conditions and cand

UpliftMem: Learning Set-Level Uplift for Agent Memory Retrieval

AgentsDGX agent

arXiv:2609.36805v1 Announce Type: new Abstract: Large language model (LLM) agents reuse external memory to guide new tasks, but effective retrieval requires learning which memory sets improve executio

VeriWeave Govern: Evidence-Gated Deterministic Runtime Governance for Enterprise AI Agents

Model ReleasesDGX agent

arXiv:2609.37457v1 Announce Type: new Abstract: Enterprise artificial-intelligence agents increasingly call tools, modify infrastructure, and process protected data, creating a need to separate action

WitnessGym: Benchmarking Coding Agents on the Construction of Bug Witnesses

Model ReleasesDGX agent

arXiv:2609.36635v1 Announce Type: cross Abstract: Bug validation asks a coding agent to produce an executable witness for a reported bug. The witness combines a concrete input with a testing harness a

WorldLine: Action-Driven Visual Simulation for Robotic Manipulation

SafetyDGX agent

arXiv:2609.38059v1 Announce Type: cross Abstract: Real-world robot learning is constrained by the cost of collecting experience and evaluating candidate behaviors. Video generation models offer a scal

You Cannot Recover What Was Never Measured: Quantifying the Information Ceiling of Ultra-Low-Field MRI Super-Resolution

Model ReleasesDGX agent

arXiv:2609.36837v1 Announce Type: new Abstract: Generative super-resolution models can turn portable 64 mT MRI into images that look like 3T scans, and the field evaluates them with PSNR, SSIM, and pi

29 Sept 2026

AnesTRACE: Benchmarking Intraoperative Anesthesia from Multimodal Perception to Multi-step Decision-Making

SafetyDGX agent

arXiv:2609.32740v1 Announce Type: new Abstract: Intraoperative anesthesia requires systems to interpret evolving multimodal evidence, recommend timely management, and revise decisions as patient state

Are We Making Progress in Multimodal Domain Generalization? A Comprehensive Benchmark Study

Model ReleasesDGX agent

arXiv:2605.06643v2 Announce Type: replace Abstract: Despite the growing popularity of Multimodal Domain Generalization (MMDG) for enhancing model robustness, it remains unclear whether reported perfor

Concept Score Relearning: A Unified Cross-Architecture Attack on Concept Erasure

Model ReleasesDGX agent

arXiv:2609.33445v1 Announce Type: new Abstract: Concept erasure aims to suppress undesirable knowledge in text-to-image generative models. However, existing robustness evaluations typically rely on re

ConflictVLA-Bench: Benchmarking Behavioral Responses of Vision-Language-Action Models to Premise Conflicts

Model ReleasesDGX agent

arXiv:2609.31792v1 Announce Type: cross Abstract: While Vision-Language-Action (VLA) models perform strongly on manipulation tasks, their responses to invalid task premises remain underexplored. Exist

Contamination, Prior, or Evidence? Decomposing and Training Evidence Use in Whole-Slide Vision-Language Models

Model ReleasesDGX agent

arXiv:2609.32185v1 Announce Type: new Abstract: Pathology vision-language models (VLMs) are conventionally evaluated by accuracy, but accuracy alone does not measure evidence use: it may conflate data

Convex Optimization Is Free When Accuracy Is Expensive

SafetyDGX agent

arXiv:2609.35418v1 Announce Type: cross Abstract: This paper studies convex optimization when the gradient cannot be evaluated exactly, but only approximated by a hierarchy of algorithms whose compute

Deep Weighted Bellman Residual Minimization for Q^* Estimation

SafetyDGX agent

arXiv:2609.34593v1 Announce Type: new Abstract: Off-policy evaluation is a foundational component of offline reinforcement learning, aiming to assess and optimize policy performance using pre-collecte

Disentangle and Drop: Robust Universal Removal of Image Watermarks via Reconstructive Grayscale Residual Decomposition

ResearchDGX agent

arXiv:2609.31693v1 Announce Type: new Abstract: Invisible image watermarks are commonly evaluated against benign postprocessing operations such as compression, resizing, blur, and color changes. These

DS-VLA: A Dendritic-inspired Vision-Language-Action Model for Robust Action Control

ResearchDGX agent

arXiv:2609.32253v1 Announce Type: new Abstract: Vision-language-action (VLA) models have achieved strong performance in language-conditioned manipulation, yet success under nominal evaluation does not

EEGAgentBench: Benchmarking LLM Agents on Short- and Long-Horizon EEG Analysis

Model ReleasesDGX agent

arXiv:2609.31632v1 Announce Type: new Abstract: Electroencephalography (EEG) analysis is evolving from short-segment classification toward long-horizon interpretation that demands iterative evidence a

EngIntervene: Benchmarking Multimodal Engineering State Understanding and Design Intervention Reasoning

Model ReleasesDGX agent

arXiv:2609.33261v1 Announce Type: new Abstract: Multimodal engineering benchmarks largely evaluate static understanding, such as recognizing components, interpreting diagrams, or answering technical q

EyeVQA: Benchmarking Ophthalmic Vision-Language Models from Recognition to Spatial Grounding

Model ReleasesDGX agent

arXiv:2609.32352v1 Announce Type: new Abstract: Vision-language models (VLMs) have shown increasing potential for medical image understanding, yet their capabilities in ophthalmic imaging remain insuf

← Previous
1…105106107108109…687
Next →