AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “evaluation”

GridTimelineEvolution
41,190 results
1 Sept 2026

APIFlow-Bench: Measuring Whether Agents Survive Long, Dependent API Workflows

Model ReleasesDGX agent

arXiv:2608.29128v1 Announce Type: new Abstract: Tool-using agents are commonly evaluated by a single bit: whether an end-to-end workflow completed. This metric fails to distinguish failures that matte

Audit Me If You Can: Query-Efficient Active Fairness Auditing of Black-Box LLMs

SafetyDGX agent

arXiv:2601.03087v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) exhibit systematic biases across demographic groups. Auditing is proposed as an accountability tool for black-box

Benchmarking Peptide-Protein Affinity Prediction Across Peptide and Target Shifts

ResearchDGX agent

arXiv:2608.30175v1 Announce Type: new Abstract: Peptide-protein affinity models are often evaluated with a single data split, obscuring whether they interpolate among measurements for observed targets

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

Benevolent Bias in Multi-Turn Human-Agent Dialogue

SafetyDGX agent

arXiv:2608.29206v1 Announce Type: new Abstract: Bias in human-agent interaction can manifest not only through hostile language but also as benevolent bias, whereby unequal treatment hides behind a war

BIRD-History: A Benchmark for History-Driven Text-to-SQL with Fine-Grained Knowledge Annotations

Model ReleasesDGX agent

arXiv:2608.29345v1 Announce Type: new Abstract: While recent Large Language Model (LLM)-based text-to-SQL systems achieve impressive performance on standard benchmarks, they struggle when user queries

Building an Adaptive Agentic Cybersecurity System with NVIDIA Nemotron

Model ReleasesDGX agent

NVIDIA and CrowdStrike evaluated an “agentic” cyber‑defense platform that fuses NVIDIA’s Nemotron open‑model family with Falcon telemetry for a continuous offense‑defense closed loop running at machin

Chain-of-Thought Faithfulness of Reasoning Models Varies with Where and How Preference Cues Are Delivered

Model ReleasesDGX agent

arXiv:2608.29464v1 Announce Type: cross Abstract: Chain-of-thought (CoT) monitoring assumes that reasoning traces faithfully record the information that shapes a model's answer. Existing faithfulness

Comprehensive Assessment and Analysis for NSFW Content Erasure in Text-to-Image Diffusion Models

SafetyDGX agent

arXiv:2502.12527v2 Announce Type: replace Abstract: Text-to-image diffusion models have gained widespread application across various domains, demonstrating remarkable creative potential. However, the

Configurable Semantic Chunking for Biomedical Information Extraction in Retrieval-Augmented Generation

ResearchDGX agent

arXiv:2608.31139v1 Announce Type: new Abstract: BioMedRAG introduced retrieval-augmented generation with a learned chunk scorer for biomedical information extraction. However, it relies on fixed-size

Correctness Forensics for Batch Speculative Decoding: Diagnosing the Ragged Tensor Problem

SafetyDGX agent

arXiv:2510.22876v4 Announce Type: replace-cross Abstract: Inference optimizations are routinely evaluated by throughput alone, without verifying output correctness. We conduct a forensic analysis of b

Creation begins with understanding: LLMs as strategy designers for privacy-preserving tabular data synthesis

Local AiDGX agent

arXiv:2608.29674v1 Announce Type: new Abstract: Sharing tabular data in high-stakes domains is constrained by privacy regulations. Synthetic data offer a promising alternative, but deep generative mod

Detecting and Guiding LLM-Generated Korean Poetry with Interpretable Form-level Features

Model ReleasesDGX agent

arXiv:2608.28986v1 Announce Type: new Abstract: LLMs often struggle with modern Korean poetry, producing outputs that resemble 'line-broken prose.' We address two coupled tasks: detecting whether a Ko

Development of an Autonomous AI Coding Agent using Monte Carlo Tree Search (MCTS) and Gemini LLM Frameworks

Model ReleasesDGX agent

arXiv:2608.29096v1 Announce Type: cross Abstract: The ongoing changes in software engineering requirements have created a substantial need for automated tools which can create secure source code from

DiffSAC: Diffusion-guided Sampling for Consensus-based Robust Estimation

TutorialsDGX agent

arXiv:2608.30603v1 Announce Type: cross Abstract: Robust estimation is a core computer vision task frequently tackled using sample consensus. However, traditional methods suffer from inefficient sampl

Do MLLMs Really Understand Low-Resource Khmer Documents? A Pilot Study on Khmer Document VQA

Model ReleasesDGX agent

arXiv:2608.28635v1 Announce Type: cross Abstract: Recent multimodal large language models (MLLMs) have advanced document understanding, visual question answering, and text extraction. However, their r

EvoBrowseComp: Benchmarking Search Agents on Evolving Knowledge

Model ReleasesDGX agent

arXiv:2606.13120v2 Announce Type: replace Abstract: Search Agents -- large language models augmented with search tools -- have intensified the need for future-proof evaluation benchmarks. Existing ben

EvoSkill Injection: Red-Teaming Autonomous Skill Generation and Evolution in Self-Evolving Agents

Model ReleasesDGX agent

arXiv:2608.30429v1 Announce Type: new Abstract: LLM-based agent systems increasingly adopt skill-based architectures to reduce repetitive reasoning costs and improve stable, efficient task execution.

Explainable Artificial Intelligence (XAI) in Computational Pathology: Definitions, Taxonomy, and Recommendations

SafetyDGX agent

arXiv:2608.28820v1 Announce Type: new Abstract: Computational pathology (CompPath) is transforming medicine by leveraging artificial intelligence (AI) algorithms to support diagnosis, prognosis, and t

Feature-Spectral Fragility in Segmentation: Dataset Dependence, Architecture-Specific Localization, and Spectral Correlates

ResearchDGX agent

arXiv:2608.29167v1 Announce Type: new Abstract: Robustness of segmentation models is commonly assessed through input-domain perturbations, while dependence on frequency content within learned feature

HEAR Who Said What: Unlocking Speaker-Attributed Reasoning via Counterfactual Voice Grounding

Model ReleasesDGX agent

arXiv:2608.29120v1 Announce Type: cross Abstract: Speech Language Models (SLMs) are increasingly deployed in multi-speaker environments, yet their ability to attribute speech to the correct speaker an

Hearing the Order: Investigating Position Bias in Large Audio-Language Models

SafetyDGX agent

arXiv:2510.00628v3 Announce Type: replace-cross Abstract: Large audio-language models (LALMs) are often used in tasks that involve reasoning over ordered options. An open question is whether their pre

HeTGB: A Comprehensive Benchmark for Heterophilic Text-Attributed Graphs

Model ReleasesDGX agent

arXiv:2503.04822v2 Announce Type: replace-cross Abstract: Graph neural networks (GNNs) have demonstrated success in modeling relational data primarily under the assumption of homophily. However, many

How Prolific Sellers Self-Present: Dissecting the Communication Patterns of 1.6 Million Reverb Listings

ResearchDGX agent

arXiv:2608.29952v1 Announce Type: new Abstract: The current paper draws on self-presentation theory and warranting theory to evaluate how the language patterns in an online marketplace reflect seller

Investigating Social Bias Changes in Quantized Language Models

Model ReleasesDGX agent

arXiv:2602.06181v2 Announce Type: replace Abstract: Post-training quantization reduces the memory needed to run large language models but alters their social biases in ways that aggregate metrics fail

Learning from Many Voices: Literary MT Using Multi-Reference Human and Synthetic Data

ResearchDGX agent

arXiv:2412.18707v3 Announce Type: replace Abstract: Multiple valid translations of a single literary work naturally exist. We investigate strategies for leveraging these multi-reference datasets to im

Learning to Follow In-Context Watermark Instructions via Self-Distillation

Model ReleasesDGX agent

arXiv:2608.29030v1 Announce Type: new Abstract: In-context watermarking (ICW) prepends an instruction to a query asking the model to embed a statistically detectable signal in its response. It thus eq

LLM Judges as Raters: A Pre-Registered Audit of Severity, Halo, Reliability, and Version Instability in LLM Essay Scoring on Public Corpora

Model ReleasesDGX agent

arXiv:2608.29517v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as essay graders in learning analytics, evaluated almost exclusively with agreement statistics. Educa

Look It Up: Analysing Internal Web Search Capabilities of Modern LLMs

ResearchDGX agent

arXiv:2511.18931v2 Announce Type: replace-cross Abstract: Modern large language models increasingly integrate internal web-based retrieval to provide real-time answers, yet it remains unclear how effe

Looking Again: Measuring Sycophancy in the Reasoning Chains of Multimodal Models Under Pressure

Model ReleasesDGX agent

arXiv:2608.28623v1 Announce Type: cross Abstract: Large multimodal reasoning models (LMRMs) are getting increasingly capable, primarily through generating explicit chain-of-thought reasoning before an

Machine Learning-Enhanced Tabu Search for Tactical Wireless Network Design

Model ReleasesDGX agent

arXiv:2608.28627v1 Announce Type: new Abstract: Designing high-performance tactical wireless networks under realistic operational constraints gives rise to challenging combinatorial optimization probl

MagicSim: A Unified Infrastructure for Executable Embodied Interaction

Model ReleasesDGX agent

arXiv:2606.17511v2 Announce Type: replace-cross Abstract: Robot learning and embodied agents now require simulation to serve as a shared execution substrate linking control, skills, and planning, not

MM-BrowseComp: A Comprehensive Benchmark for Multimodal Browsing Agents

Model ReleasesDGX agent

arXiv:2508.13186v2 Announce Type: replace-cross Abstract: AI agents with advanced reasoning and tool-use capabilities have demonstrated impressive performance in web browsing for deep search. However,

MMLongEmbed: Benchmarking Multimodal Embedding Models in Long-Context Scenarios

Model ReleasesDGX agent

arXiv:2606.14747v2 Announce Type: replace-cross Abstract: Recent advancements have significantly expanded the theoretical context windows of Multimodal Embedding Models (MEMs). However, larger context

MMPCBench: Benchmarking Multimodal Large Language Models on Proactive Critique of Flawed Inputs

SafetyDGX agent

arXiv:2608.29286v1 Announce Type: new Abstract: As Multimodal Large Language Models (MLLMs) evolve into sophisticated interactive assistants, their reliability depends not only on following instructio

Not All Fallbacks Are Failures: Understanding and Recovering from Fallbacks in Mobile Voice Assistants

ApplicationsDGX agent

arXiv:2608.30738v1 Announce Type: new Abstract: Robust understanding of user input is a core requirement for voice assistants deployed in real-world environments. In practice, these systems encounter

Not Safe for All: Auditing the Dialect Penalty in Text-to-Image Safety Pipelines

SafetyDGX agent

arXiv:2608.29589v1 Announce Type: new Abstract: Text-to-image (T2I) safety guardrails fail to generalize equitably to non-standard dialects. Evaluating 23,080 paired prompts across five English dialec

On the Recoverability of Private Information Unlearning in Large Language Models

ResearchDGX agent

arXiv:2608.29943v1 Announce Type: cross Abstract: Large language models (LLMs) can memorize sensitive information, raising serious privacy concerns. Machine unlearning offers a potential solution to r

Predicting Future Organ Dysfunction in ICU Patients Using Temporal Convolutional Networks on MIMIC-IV Data

SafetyDGX agent

arXiv:2608.29301v1 Announce Type: new Abstract: Predicting future organ dysfunction in Intensive Care Unit (ICU) patients is critical for early clinical intervention, yet existing machine learning app

RealOOB: A Definition-Consistent Real-World Oriented Occlusion Boundary Benchmark

Model ReleasesDGX agent

arXiv:2608.30820v1 Announce Type: new Abstract: Occlusion boundaries (OBs) are pixel-level image boundaries corresponding to surface visibility discontinuities caused by occlusion. Through precise bou

Recognition-Refusal Misalignment in LLMs: Why Models Answer Structurally Unanswerable Questions

SafetyDGX agent

arXiv:2608.29109v1 Announce Type: new Abstract: Large language models often answer structurally unanswerable questions, such as computing cot(-540{eg}) or evaluating (1).startswith('1'), instead of ab

ShardMemo: Scope-Before-Routing for Agentic Memory Retrieval

AgentsDGX agent

arXiv:2601.21545v2 Announce Type: replace Abstract: Agentic systems accumulate persistent memory across sessions, tools, and tasks, and a later request must retrieve from it under two distinct constra

SimGuide: Typed Multi-Context User Representations for Preference-Conditioned Agent Planning

Model ReleasesDGX agent

arXiv:2608.24888v2 Announce Type: replace Abstract: Agents that act on a user's behalf must plan differently for different users, and increasingly do so from some structured representation of user con

SpatialTrust: A Benchmark for Environmental Risk Recognition in Secure Authentication

Model ReleasesDGX agent

arXiv:2608.29489v1 Announce Type: cross Abstract: Visual environmental risk recognition plays an important role in secure authentication, where a user's surroundings may reveal sensitive information o

State of Health Estimation using Convolutional and Bidirectional LSTM Neural Networks tuned by Bayesian Optimization

ResearchDGX agent

arXiv:2608.30593v1 Announce Type: new Abstract: In this research, a novel framework is proposed for the SOH estimation, which employs a hybrid deep learning architecture of a concatenation of a Convol

Subtraction-Based Tumor Segmentation and Lesion-Centered pCR Prediction for the MAMA-MIA Challenge

SafetyDGX agent

arXiv:2608.29162v1 Announce Type: cross Abstract: We describe the submission of team FME to the MAMA-MIA Challenge, which evaluated primary tumor segmentation and prediction of pathological complete r

The Race between Agentic AI Capabilities and Data Quality Control in Online Surveys

AgentsDGX agent

arXiv:2608.28597v1 Announce Type: new Abstract: Online surveys are a foundational data collection instrument in a variety of fields, with attention checks serving as critical guardians of response qua

Universal Transformers for Circuit Computations: Perfect Length Generalization in Tiny Transformers

AgentsDGX agent

arXiv:2608.31067v1 Announce Type: new Abstract: Learning generalizable algorithmic computations remains a challenge for neural networks, as reflected in persistent failures on compositional and length

VibeJam: A User Study Platform for Web Development with Agents

Model ReleasesDGX agent

arXiv:2608.29889v1 Announce Type: new Abstract: Programming with AI is increasingly agentic, users prompt LLMs to directly edit their code and review the changes, with adoption growing especially for

VisER: Visual Evidence and Reliance for Object Hallucination Detection in LVLMs

ResearchDGX agent

arXiv:2608.30480v1 Announce Type: new Abstract: Object hallucination remains a persistent reliability issue in large vision-language models, where generated object mentions may sound plausible but lac

WeAgent-MMSearch: Native Text-Vision Interaction for Multimodal Search Agents

Model ReleasesDGX agent

arXiv:2608.28062v2 Announce Type: replace Abstract: Multimodal search agents extend parametric knowledge with newly emerging and long-tail evidence from the open web. Yet many existing agentic search

Whose Assessment of Distress? Community Perspectives and LLM Alignment on Well-Being Posts

Model ReleasesDGX agent

arXiv:2608.29446v1 Announce Type: new Abstract: Judgments about psychological distress are socially situated: what counts as concerning hinges on community norms around emotional expression, vulnerabi

31 Aug 2026

A Controlled Audit of Architectural Complexity in Uncertainty-Aware Multi-Organ Ultrasound Classification

SafetyDGX agent

arXiv:2608.28063v1 Announce Type: new Abstract: Multi-organ ultrasound classifiers increasingly combine attention, mixture-of-experts routing, uncertainty gating, and evidential deep learning (EDL) ob

Acquire, Repair, Preserve: A Diagnosis-Guided Post-Training Recipe for Small-Model Dialogue Game Agents

Local AiDGX agent

arXiv:2608.28458v1 Announce Type: new Abstract: Interactive dialogue games test a capability that static benchmarks largely leave implicit: a model must carry state across turns, interpret feedback, a

AWS recognized as a Leader in The Forrester Wave: AI Infrastructure Solutions, Q4 2025

IndustryDGX agent

We're excited to share that AWS has been recognized as a Leader in The Forrester Wave: AI Infrastructure Solutions, Q4 2025. In this evaluation of 13 providers, AWS received the highest score in the S

Below the Noise Floor: Bimodal Seed Collapse and Distinct Failure Modes in Small-Model Knowledge Distillation

Model ReleasesDGX agent

arXiv:2608.27729v1 Announce Type: new Abstract: Function routing -- selecting the correct API call from a fixed catalog given a natural-language request -- is a deployment problem where small students

Conditional Visual Evidence Utility: State-Dependent Rank Reversals in Frozen Vision-Language Encoders

ResearchDGX agent

arXiv:2608.28316v1 Announce Type: new Abstract: Static importance scores compress visual evidence into a single ranking, but the value of remaining evidence can change after one cue has been observed.

Efficient Online Continual Foundation Model Fine-Tuning for Predictive Process Monitoring

ApplicationsDGX agent

arXiv:2608.28237v1 Announce Type: new Abstract: Predictive Process Monitoring (PPM) models are increasingly deployed in dynamic environments where concept drift causes the underlying process distribut

Entity-Memory Graph Retrieval Improves Evidence Coverage in Long-Conversation Question Answering

Model ReleasesDGX agent

arXiv:2608.27925v1 Announce Type: new Abstract: Entity-Memory graph retrieval keeps dialogue turns as verbatim Memory nodes, links repeated mentions through shared Entities, and connects adjacent Memo

FedEHR-Agents: Federated Agentic Optimization for Automated EHR Modeling

Model ReleasesDGX agent

arXiv:2608.27856v1 Announce Type: new Abstract: Recent advances in large language models are enabling autonomous clinical agents to perform increasingly complex electronic health record (EHR) modeling

How Proper Scoring Rules Shape LLM Forecasting

SafetyDGX agent

arXiv:2608.28482v1 Announce Type: new Abstract: This paper evaluates how reward function choice shapes the performance and behavior of LLM forecasters. We compare five proper scoring rules as training

← Previous
1…149150151152153…687
Next →