AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “evaluation”

GridTimelineEvolution
41,190 results
9 Sept 2026

SAFIRE: Safety-Critical Benchmark for Fine-grained Fire and Smoke Understanding in Multimodal LLMs

Model ReleasesDGX agent

arXiv:2609.07823v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) show strong progress on vision-language tasks, yet their reliability in safety-critical settings remains undere

Sparse Incident-Cluster Learning for 12-hour Port Flood Pre-warning in Digital-Twin Analytics

ApplicationsDGX agent

arXiv:2609.06109v1 Announce Type: new Abstract: Port flood digital twins require analytics that warn operators before disruption, but official warning incidents are often few and adjacent observations

Sustained Performance and Energy Accounting for Nonlinear Forecasting Across Classical and Simulated Quantum Models

Model Releases
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
DGX agent

arXiv:2510.25183v2 Announce Type: replace-cross Abstract: Energy-efficient AI should be evaluated across the full application pipeline, not only by lowest error or shortest training time. We study thi

Tempora-Fusion: Time-Lock Puzzle with Efficient Verifiable Homomorphic Linear Combination

Model ReleasesDGX agent

arXiv:2406.15070v3 Announce Type: replace-cross Abstract: We present Tempora-Fusion, the first homomorphic TLP scheme with efficient public verification of both individual puzzle solutions and homomor

7 Sept 2026

A Deep Generative Model for Synthesizing Labeled Wireless Signals

Model ReleasesDGX agent

arXiv:2609.05396v1 Announce Type: new Abstract: Wireless signals with position-related labels are pivotal for both performance evaluation and model training in the realm of wireless sensing. However,

A Sim-to-Real Study of Surface-Code Decoder Benchmarking

HardwareDGX agent

arXiv:2609.04557v1 Announce Type: cross Abstract: Quantum error-correction decoders are typically benchmarked against synthetic circuit-level noise, under the assumption that a decoder's ranking under

Disentangling Attention in Deep Operator Learning: A Controlled Study of Data-Driven and Physics-Informed Architectures

Model ReleasesDGX agent

arXiv:2609.04407v1 Announce Type: new Abstract: Deep neural operators learn mappings between input functions and complete PDE solution fields, enabling forward evaluations of new problem instances ord

EVOHARNESSBENCH: Can Your Agents Keep Pace with an Evolving Harness?

Model ReleasesDGX agent

arXiv:2609.04280v1 Announce Type: cross Abstract: Modern LLM-based agents operate through a harness of tools, reusable skills, and specialist agents that shapes what they observe and what they can do.

Knowing What Not to Answer: Selective Non-Compliance in Vision-Language Models

Model ReleasesDGX agent

arXiv:2609.04720v1 Announce Type: cross Abstract: Vision-language models (VLMs) are expected to respond helpfully to appropriate requests while withholding compliance with requests that are incorrect,

Knowing When Not to Answer: Pseudo-Ensembles for Abstention in Music Audio-Language Models

ResearchDGX agent

arXiv:2609.04362v1 Announce Type: cross Abstract: Music audio-language models are evaluated almost entirely by accuracy on multiple-choice questions. This protocol forces the model to commit to an opt

Measuring AI Accountability Through Argumentation Analysis: Can Model Reasoning Withstand Scrutiny?

SafetyDGX agent

arXiv:2609.05088v1 Announce Type: new Abstract: AI oversight methods rely on ground truth for validation, but what constitutes appropriate AI behavior is contested. This leaves evaluation of moral rea

Measuring the Novelty of Biomedical Papers Using the Latent Distances between Knowledge Units

SafetyDGX agent

arXiv:2609.05175v1 Announce Type: cross Abstract: Measuring the novelty of scientific papers is a central concern in research evaluation and scientometrics. From a recombination perspective, prior stu

PetQA: Benchmarking Veterinary Knowledge and Clinical Reasoning

Model ReleasesDGX agent

arXiv:2609.04598v1 Announce Type: cross Abstract: We introduce PetQA, a Korean long-form question-answering (QA) benchmark for evaluating veterinary knowledge and clinical reasoning in large language

SciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understanding

Model ReleasesDGX agent

arXiv:2609.05141v1 Announce Type: new Abstract: Scientific papers require models to reason jointly over text, equations, figures, tables, code, and datasets while preserving the provenance of supporti

Single-Query Black-Box Calibration Auditing via Logit Bias

Model ReleasesDGX agent

arXiv:2609.05125v1 Announce Type: new Abstract: Evaluating the calibration of Large Language Models (LLMs) is critical for their safe deployment as zero-shot classifiers. Yet, commercial API providers

TreeFI: Value-Aware Statistical Fault Injection for Deep Neural Networks

ResearchDGX agent

arXiv:2609.04912v1 Announce Type: cross Abstract: Reliability evaluation of deep neural networks under hardware faults commonly relies on fault injection, but exhaustive campaigns are intractable for

Wireless Foundation Models: State-of-the-Art and Open Challenges

ApplicationsDGX agent

arXiv:2609.04707v1 Announce Type: cross Abstract: Wireless foundation models (WFMs) have emerged as a promising approach for learning reusable representations from large-scale wireless data and adapti

4 Sept 2026

A comparative study on the accuracy & repeatability of mobile robotic platforms for the delivery of precision NDE measurement

SafetyDGX agent

arXiv:2609.03794v1 Announce Type: new Abstract: Mobile robotic platforms offer a flexible alternative to fixed manipulators for non-destructive evaluation (NDE) of large aerospace structures, but thei

Beyond BLEU: A Case for Redefining Sign Language Translation Benchmarks

ResearchDGX agent

arXiv:2609.03734v1 Announce Type: cross Abstract: BLEU-4 is the standard metric for evaluating sign language translation (SLT), but spoken-language metrics may not adequately reflect sign language pro

Dual-Form ASR: Semantics-Aware Inverse Text Normalization for Chinese Speech Recognition

ResearchDGX agent

arXiv:2609.02901v1 Announce Type: new Abstract: Modern automatic speech recognition (ASR) scenarios require both spoken-form transcripts for faithful transcription and readable written-form transcript

Environment Evolution for Terminal Agents

Model ReleasesDGX agent

arXiv:2609.04128v1 Announce Type: new Abstract: Scaling interactive and verifiable environments is critical for training terminal agents. As frontier models become more capable, environments synthesiz

FailBench: How Reliable are VLMs at Judging Robot Task Success?

Model ReleasesDGX agent

arXiv:2609.03611v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) are increasingly used to evaluate robot manipulation outcomes, but existing benchmarks offer limited evidence of cross-d

Improving Clinical Target Volume Segmentation Accuracy using Anatomical Priors and Active Learning for the AGITG TOPGEAR Clinical Trial

ResearchDGX agent

arXiv:2609.03186v1 Announce Type: cross Abstract: Training deep learning-based medical image segmentation models is challenging with limited curated datasets. For AGITG TOPGEAR, a gastric cancer trial

Interface-Induced Trajectory Censoring

Model ReleasesDGX agent

arXiv:2609.03966v1 Announce Type: new Abstract: Agent evaluations report a tool-call rate read off the serving stack. That number can be zero while the model is emitting well-formed calls: the interfa

LLM4CKD: Large Language Models for Early Stage Chronic Kidney Disease Screening

ApplicationsDGX agent

arXiv:2609.04013v1 Announce Type: new Abstract: Early screening of chronic kidney disease (CKD) is critical for timely intervention, yet most machine learning (ML) and deep learning (DL) approaches re

LongCounsel-8: A Benchmark Suite for Longitudinal Depression Tracking from Multi-Session Counseling Dialogues

Model ReleasesDGX agent

arXiv:2609.03507v1 Announce Type: cross Abstract: Tracking depression from multi-session counseling dialogues requires estimating both current symptom severity and how it changes across sessions. Yet

Not All LLM Workloads Are Equal: Benchmarking TPU Performance on Classification vs. Generation

Model ReleasesDGX agent

Moving Large Language Models (LLMs) from experimental prototypes into enterprise production exposes a critical truth: your infrastructure dictates both your performance ceilings and your unit economic

ProAct: Harnessing Streaming Motion Generation and Agentic Reasoning for Real-Time Embodied Social Interaction

Model ReleasesDGX agent

arXiv:2602.14048v2 Announce Type: replace-cross Abstract: Real-time embodied social interaction places two equally demanding requirements on an agent: continuously generating fluent multimodal interac

ScoreMix: Synthetic Data Generation by Score Composition in Diffusion Models Improves Recognition

SafetyDGX agent

arXiv:2506.10226v3 Announce Type: replace-cross Abstract: Synthetic data generation is increasingly used in machine learning for training and data augmentation. Yet, current strategies often rely on e

SHELF: A Synthetic Harness for Multi-Task Bibliographic Benchmarking

Model ReleasesDGX agent

arXiv:2609.03047v1 Announce Type: cross Abstract: Libraries and archives manage large collections with limited staff and computing budgets, yet common benchmarks do not systematically test their bibli

Tree species mapping in Denmark: A comparison of spectral-temporal features with geospatial foundation model embeddings

Model ReleasesDGX agent

arXiv:2609.03480v1 Announce Type: cross Abstract: We map tree species across Denmark using National Forest Inventory plots and EO data, while evaluating the potential of foundation models for large-sc

User Perceptions vs. Proxy LLM Judges: Privacy and Helpfulness in LLM Responses to Privacy-Sensitive Scenarios

SafetyDGX agent

arXiv:2510.20721v4 Announce Type: replace-cross Abstract: Large language models (LLMs) are rapidly being adopted for tasks like drafting emails, summarizing meetings, and answering health questions. I

When Users Don't Ask: Benchmarking Context-Driven Memory Retrieval in Conversational Agents

Model ReleasesDGX agent

arXiv:2609.03467v1 Announce Type: cross Abstract: Large language models (LLMs) are increas- ingly deployed as long-horizon conversational agents, motivating growing interest in mem- ory systems. Howev

3 Sept 2026

A Computational Comparison of Fourier Spectral Differentiation and Spatial Automatic Differentiation in Periodic Physics-Informed Neural Networks

HardwareDGX agent

arXiv:2609.02110v1 Announce Type: new Abstract: Physics-informed neural networks (PINNs) commonly evaluate the spatial derivatives appearing in partial differential equation residuals using automatic

Auditory Illusion Benchmark for Large Audio Language Models

Model ReleasesDGX agent

arXiv:2609.02277v1 Announce Type: cross Abstract: Perceptual illusions have long served as crucial probes into human cognition, revealing biases and limitations of perception. In the auditory domain,

Belief-Calibrated Optimization: An Explicit World Model for Agentic Optimization

Model ReleasesDGX agent

arXiv:2609.01861v1 Announce Type: new Abstract: The performance of an LLM agent depends on the scaffold around a frozen model. A common way to improve that scaffold is to use a coding agent as an opti

Benchmarking Language Models for Statistical Problem Formulation

Model ReleasesDGX agent

arXiv:2609.01982v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as assistants for statistical and data science work, yet existing evaluations largely assume the anal

DiscoSign: Discourse-Aware Text to Sign Language Gloss Translation

ResearchDGX agent

arXiv:2609.02796v1 Announce Type: new Abstract: Sign language processing systems have traditionally operated at the sentence level, ignoring critical discourse phenomena fundamental to sign language c

Disease Burden over Skin Tone: Decomposing the Dermatology-AI Generalization Gap

ResearchDGX agent

arXiv:2609.02111v1 Announce Type: cross Abstract: Dermatology artificial intelligence (AI) models are predominantly trained on light-skinned, cancer-focused image collections, yet they are increasingl

DocHop: Benchmarking Out-of-domain Multi-hop Reasoning in Information-Dense Documents

Model ReleasesDGX agent

arXiv:2609.02059v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have achieved strong performance on structured visual understanding tasks such as chart and document question a

Does Playing it Safe Count as Faithfulness? Reassessing LVLM Hallucination Mitigation Methods

Model ReleasesDGX agent

arXiv:2609.01888v1 Announce Type: new Abstract: Recent inference-time hallucination mitigation methods for large vision-language models (LVLMs) report strong gains on hallucination benchmarks. However

Evidential Deep Learning for Multi-Modal Anti-UAV Detection

ResearchDGX agent

arXiv:2609.01742v1 Announce Type: new Abstract: Anti-UAV systems increasingly fuse multiple sensors, yet their detection heads provide no per-modality reliability signal. This study evaluates whether

From Tokens to Semantics: Leveraging Complementary Signals for Hallucination Detection in Black-Box LLMs

ResearchDGX agent

arXiv:2609.02679v1 Announce Type: cross Abstract: When LLMs support public-facing or high-stakes workflows, missed fabrications can harm users and institutions, while false alarms consume limited huma

LLM-as-a-Judge Is Not an Oracle: Why Self-Improving Agents Need Deterministic Guardrails

SafetyDGX agent

arXiv:2609.02246v1 Announce Type: new Abstract: Self-improving agent pipelines have a problem at their center. An optimizer rewrites prompts to score higher, and the score comes from a judge that is i

LLM Watermarking as Big Data Provenance: A Deployment-Oriented Systematization

Model ReleasesDGX agent

arXiv:2607.10103v2 Announce Type: replace-cross Abstract: As large language models (LLMs) become widely deployed, their outputs can be copied, transformed, and redistributed at scale without reliable

Loom: Weaving Diagnostic Strands into Free-Text Consensus via Embedding-Space Reweighting

Model ReleasesDGX agent

arXiv:2609.02649v1 Announce Type: new Abstract: Aggregating noisy, conflicting textual hypotheses into a reliable consensus is a fundamental challenge when deploying NLP systems in real-world industri

MESSY STREETS: A Benchmark for Geocoding Real-World Addresses

Model ReleasesDGX agent

arXiv:2609.01612v1 Announce Type: cross Abstract: We introduce MESSY STREETS, a benchmark for evaluating geocoders on verbatim web addresses, with existence verification and controlled measurement of

MultiGhostBench: A Multilingual Benchmark for Long-Form LLM-Generated Text Attribution under Distribution Shifts

Model ReleasesDGX agent

arXiv:2609.02379v1 Announce Type: cross Abstract: While existing work on LLM authorship attribution (AA) has made progress, available benchmarks remain limited, often focusing on English, controlled s

Post-Training Language Models for Gold-Medal Performance in Coding Competitions

Model ReleasesDGX agent

arXiv:2609.02849v1 Announce Type: cross Abstract: Competitive programming has become a key test of large language model reasoning, with international competitions such as IOI and ICPC representing its

RecEvolve: A Knowledge-Driven Autonomous Agent System for Recommender Systems

AgentsDGX agent

arXiv:2609.01622v1 Announce Type: cross Abstract: The rise of agentic AI has catalyzed a shift toward self-iterating systems, opening new frontiers for the autonomous optimization of production recomm

SelfLift: Accelerating Few-Step Diffusion via Self-Recovering Resolution Transition

Local AiDGX agent

arXiv:2609.02036v1 Announce Type: new Abstract: Few-step diffusion models substantially compress temporal computation, making the spatial cost of each model evaluation an increasingly dominant source

Stepwise Think-Critique: Interleaved Reasoning and Self-Critique in a Single LLM

ResearchDGX agent

arXiv:2512.15662v4 Announce Type: replace Abstract: Human beings solve complex problems through critical thinking, where reasoning and evaluation are intertwined to converge toward correct solutions.

TalkFa: A Unified Benchmark for Farsi Dialogue Generation and Understanding

Model ReleasesDGX agent

arXiv:2609.01810v1 Announce Type: new Abstract: Farsi, spoken by more than 120 million people, lacks a comprehensive benchmark for dialogue generation and understanding. We introduce TALKFA, a unified

VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulation

Model ReleasesDGX agent

arXiv:2609.02462v1 Announce Type: new Abstract: End-to-end autonomous driving in urban environments requires robust decision-making under partial observability and complex multi-agent interactions. Se

WinoQueer-NL: Assessing Bias in Dutch Language Models toward LGBTQ+ Identities

Model ReleasesDGX agent

arXiv:2609.02651v1 Announce Type: new Abstract: While English language models have been widely examined for anti-queer bias, Dutch models remain understudied. To address this gap, we developed a cultu

WMLLM: Self-Evolving Optimization Agents via Predict-Then-Act World Modeling

Model ReleasesDGX agent

arXiv:2609.01608v1 Announce Type: cross Abstract: Black-box optimization problems remain challenging because of large, weakly structured, and high-dimensional search spaces. Existing methods often suf

2 Sept 2026

Automated Tree Knowledge Graph Construction using Ontology Expansion and Retrieval from Vietnamese History Textbooks

Model ReleasesDGX agent

arXiv:2609.00763v1 Announce Type: new Abstract: Hierarchical Knowledge graph (KG)-based retrieval augmented generation (RAG) has emerged as a powerful approach for supporting large language models wit

Calibration is the Bottleneck: An Action-Class Diagnostic of Multi-Turn Tool-Calling

Local AiDGX agent

arXiv:2609.00949v1 Announce Type: cross Abstract: Multi-turn tool calling is a core evaluation scenario for large language model (LLM) agents. On public tool-calling benchmarks, open-weight models now

Can LLMs Design Video Coding Tools? A Case Study on Planar Mode

Model ReleasesDGX agent

arXiv:2609.01535v1 Announce Type: cross Abstract: This paper explores whether large language models (LLMs) can design video coding tools, a highly challenging task due to the intricate algorithmic cou

Controllable Image Captioning with Prompt-Conditioned Scene Rewards

Model ReleasesDGX agent

arXiv:2609.00709v1 Announce Type: cross Abstract: Large Vision-Language Models produce fluent image descriptions but offer limited semantic control: users cannot reliably specify whether captions shou

← Previous
1…110111112113114…687
Next →