Search: “evaluation”

arXiv:2608.20661v1 Announce Type: new Abstract: Enterprise adoption of large language models in finance is constrained less by fluency than by trust: in Financial Planning and Analysis (FP&A) and othe

applicationsarxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

BackDFL: A Unified Benchmark For Backdoor Attacks and Defenses In Decentralized Federated Learning

DGX agent

arXiv:2608.21137v1 Announce Type: new Abstract: Decentralized Federated Learning (DFL) promises trust-free collaborative learning by replacing the centralized parameter server with peer-to-peer model

model-releasesarxiv-cs-lg

24 Aug 2026

Belief Without Behavior: Measuring the Translation of Theory of Mind into Coordinated Social Action in Vision-Language Models

arXiv:2608.20975v1 Announce Type: new Abstract: Effective social interaction requires agents to translate mental state inferences into coordinated behavioral signals across verbal and nonverbal channe

Benchmarking noisy label detection methods

model-releasesarxiv-cs-lg

arXiv:2510.16211v2 Announce Type: replace Abstract: Label noise is a common problem in real-world datasets, affecting both model training and validation. Clean data are essential for achieving strong

Beyond End-to-End Success: Diagnosing Failures in Long-Horizon Security LLM Agents

arXiv:2608.20563v1 Announce Type: cross Abstract: Long-horizon security LLM agents must carry information and decisions across many dependent interactions, where later actions often depend on services

Local Ai

Calibrating Criterion Revision in LLM Agents: Failure Modes and a Trace-Anchored Protocol

arXiv:2608.20729v1 Announce Type: new Abstract: Language-model agents can improve after failure or carry text across episodes without revising what counts as success. We study the narrower attribution

local-aiarxiv-cs-ai

Can We Trust AI Agents? A Case Study of an LLM-Based Multi-Agent System for Ethical AI

arXiv:2411.08881v3 Announce Type: replace-cross Abstract: AI-based systems, including Large Language Models (LLMs), impact millions by supporting diverse tasks but face issues like misinformation, bia

safetyarxiv-cs-ai

Tutorials

CDRL: Certification-Driven Reinforcement Learning for Neutrino Flavor Model Discovery

arXiv:2608.20686v1 Announce Type: new Abstract: Many scientific discovery problems require searching combinatorial hypothesis spaces under complex domain constraints. Reinforcement learning (RL) offer

tutorialsarxiv-cs-ai

DirEAG: Dirichlet Evidence Aggregation for Calibrating Verbalized Confidence in Mathematical Reasoning

arXiv:2608.20717v1 Announce Type: new Abstract: Reliable confidence estimation is essential for using large language models in mathematical reasoning, but black-box verbalized confidence is difficult

Dorsal Hand Images for Immersive (XR) and Privacy-preserving Age Assurance and Child Safety

arXiv:2608.21009v1 Announce Type: new Abstract: Ensuring that Extended Reality (XR) environments are age-appropriate is an important regulatory and safety challenge. However, current age assurance ope

safetyarxiv-cs-cv

GeoExplain: Multimodal Reasoning based on Hierarchy of Visual Information in Street View

arXiv:2506.16633v3 Announce Type: replace-cross Abstract: Multimodal reasoning is a process of understanding, integrating and inferring information across different data modalities. It has recently at

Identify, Locate, Link: End-to-End Key-Value Extraction from Document Images

model-releasesarxiv-cs-cl

arXiv:2608.20868v1 Announce Type: cross Abstract: Document processing pipelines traditionally cascade optical character recognition (OCR) engines with downstream models for structured information extr

ImmigrationReason: A Structured Dataset of U.S. Immigration Appeals for Legal Reasoning Research

model-releasesarxiv-cs-cl

arXiv:2608.20391v1 Announce Type: new Abstract: Most legal NLP resources draw from federal case law and focus on coarse classification, leaving administrative adjudication, where the vast majority of

Inhibitory Attention for Clinical Long-Context Reasoning: Characterizing and Mitigating Lost-in-the-Middle Effects in EHR Processing

arXiv:2608.20348v1 Announce Type: cross Abstract: Electronic health records now routinely exceed 100,000 tokens per patient. Yet large language models exhibit the lost-in-the-middle (LitM) effect: inf

Investigating Target Class Influence on Neural Network Compressibility for Energy-Autonomous Avian Monitoring

arXiv:2602.17751v2 Announce Type: replace-cross Abstract: Biodiversity loss poses a significant threat to humanity, making wildlife monitoring essential for assessing ecosystem health. Avian species a

Jokes Aside: Measuring the Semantic Distance of Double Meanings

arXiv:2608.21087v1 Announce Type: new Abstract: Large language models have significantly enriched the toolkit for computational humor research, particularly in the automated generation of jokes and pu

researcharxiv-cs-cl

Knowledge-Graph-Gated Defactualization for Style-Controllable and Fact-Preserving Generation in Agentic Conversational AI

arXiv:2608.20393v1 Announce Type: cross Abstract: Agentic large language models (LLMs) deployed in fact-sensitive applications such as customer support must simultaneously preserve factual correctness

KoViDoRe: Korean Visual Document Retrieval

model-releasesarxiv-cs-cv

arXiv:2608.20840v1 Announce Type: cross Abstract: Recent advances in multimodal retrieval have improved the ability to retrieve information from visually rich documents such as PDFs and reports. Howev

Learning Prostate Anatomy at Test Time for Cancer Detection in Micro-Ultrasound

arXiv:2608.20557v1 Announce Type: new Abstract: Domain shift across clinical centers using different imaging hardware or acquisition protocols remains a fundamental barrier to deploying deep learning

researcharxiv-cs-cv

Logic-VLA: A Temporal Logic Conditioned Vision-Language-Action Model

arXiv:2608.20556v1 Announce Type: new Abstract: Vision-language-action (VLA) models can follow natural-language (NL) task instructions, but such instructions may not precisely specify safety-critical

safetyarxiv-cs-ro

Making Deployments Safe at Meta: Health Checks for Continuous Change-Safety

arXiv:2608.20513v1 Announce Type: cross Abstract: Continuous deployment to large scale production systems creates a tension between release velocity and reliability. Every change is a potential reliab

safetyarxiv-cs-ai

Multi-Modal Traffic Sign Detection with Semantic Attributes for Autonomous Driving

arXiv:2608.20874v1 Announce Type: new Abstract: Reliable traffic sign detection is a prerequisite for the global deployment of autonomous driving systems, where regulatory compliance and road safety d

safetyarxiv-cs-cv

Mutual information and sensitivity analysis for feature selection in customer targeting: a comparative study

arXiv:2608.20447v1 Announce Type: new Abstract: Feature selection is a highly relevant task in a data-driven knowledge discovery project. Several techniques have been developed aiming at finding the f

researcharxiv-cs-lg

Tutorials

OccluRank: Controllable Occlusion-Aware Layout-to-Image Generation by Adding Just an Ordinal Rank

arXiv:2608.20932v1 Announce Type: new Abstract: Layout-to-image generation enables explicit spatial control through bounding-box layouts, yet bounding boxes specify only instance locations and cannot

tutorialsarxiv-cs-cv

Online design of dynamic networks

arXiv:2410.08875v3 Announce Type: replace Abstract: Designing a network (e.g., a telecommunication or transport network) is mainly done offline, in a planning phase, prior to the operation of the netw

Applications

Perseus: Interactive Time Series Segmentation with Sparse Supervision via Stateful Memory

arXiv:2510.09930v2 Announce Type: replace-cross Abstract: Real-world systems, ranging from industrial manufacturing to wearable healthcare, generate multivariate time series with hierarchical states r

applicationsarxiv-cs-ai

RDANet: Relative Degradation Aware Network for Infrared Small Target Detection

arXiv:2608.20870v1 Announce Type: new Abstract: Infrared small target detection is still challenging in remote sensing imagery, because the targets are extremely small, exhibit weak local contrast, an

researcharxiv-cs-cv

RiskTraf: Risk-Extrapolated Residual Learning for Multi-Variate Traffic Flow Prediction

arXiv:2608.20656v1 Announce Type: cross Abstract: Traffic sensors commonly record flow, speed, and occupancy, but standard traffic flow forecasting benchmarks and models rarely exploit all three raw m

Robust Discovery of Coarse-Grained Continuum Equations from Microscopic Dynamics

arXiv:2608.20404v1 Announce Type: cross Abstract: The discovery of governing partial differential equations (PDEs) directly from spatiotemporal data has emerged as a powerful tool for understanding th

researcharxiv-cs-lg

Robust Validation to Geometric Perturbations for Autonomous Pose Estimation

arXiv:2608.21066v1 Announce Type: new Abstract: Deploying autonomous systems in safety-critical domains demands guaranteed robustness against physically plausible geometric perturbations rather than a

safetyarxiv-cs-cv

RODE: A Radial-Orthogonal Decoupled Engine for Optimization

model-releasesarxiv-cs-lg

arXiv:2608.21024v1 Announce Type: new Abstract: Modern neural network training increasingly uses matrix-aware optimizers, yet their conditioned matrix step is typically added directly to the weight, j

Scalable Distributed Simulation-Based Testing for Automated Driving Systems

arXiv:2608.20904v1 Announce Type: new Abstract: Virtual scenario-based testing is a key enabler for validating automated driving systems (ADS) and intelligent transport systems (ITS). However, executi

safetyarxiv-cs-ro

Scaling Unsupervised Word Alignment to Documents via Structural Constraints

arXiv:2608.21023v1 Announce Type: new Abstract: Word alignment has traditionally been studied between sentences, but many cross-lingual tasks increasingly require correspondences across full documents

safetyarxiv-cs-cl

SCOPE: A Generative Approach for LLM Prompt Compression

arXiv:2508.15813v2 Announce Type: replace-cross Abstract: A big issue in modern LLM applications is they tend to feed long context to LLM, which results in high inference cost and latency, and may exc

SDAD: Spec-Driven Agentic Development for the AI-Native SDLC

arXiv:2608.20341v1 Announce Type: new Abstract: Frontier coding agents backed by large language models with context windows from hundreds of thousands to millions of tokens are restructuring the Softw

SEISMO: Explanation-Aware, Trajectory-Conditioned LLM Agents for Sample-Efficient Molecular Optimisation

arXiv:2602.00663v3 Announce Type: replace Abstract: Optimizing molecules to achieve desired properties is a central bottleneck across the chemical sciences, particularly in the pharmaceutical industry

Specification Portability Across LLM Development Agents: Cross-Agent Compatibility in Specification-Driven Software Migration

arXiv:2608.21208v1 Announce Type: cross Abstract: This paper investigates cross-agent specification portability using Oracle-to-PostgreSQL migration as a controlled software transformation task. The s

STCO: Conditional Neural Operators for Time-Dependent PDEs

arXiv:2608.20477v1 Announce Type: new Abstract: Neural operators have emerged as efficient surrogates for time-dependent physical systems governed by partial differential equations (PDEs), but their f

Structure for Reading, Prose for Writing: Asymmetric Structural Conditioning in Multi-Agent Document Authoring

arXiv:2608.20786v1 Announce Type: new Abstract: Multi-agent pipelines that author formal documents must both read a requester's forms and write against them. We report a deployed tender-response syste

Terminal Agents: A Survey of AI Agents in Command-Line Environments

arXiv:2608.20485v1 Announce Type: new Abstract: Large language model agents increasingly act through terminals, yet existing surveys disperse terminal-mediated behavior across software engineering, to

Towards Traffic Modelling of Multi-Agent Systems: The Role of Coordination Topology

arXiv:2608.20494v1 Announce Type: cross Abstract: Multi-agent LLM systems are an emerging networked workload whose rapid deployment raises questions about the traffic patterns they generate. Compared

Tree-of-Concerns: Hierarchical Multi-Agent Debate for Unstated-Limitation Extraction in Scientific Critique

model-releasesarxiv-cs-cl

arXiv:2608.20777v1 Announce Type: new Abstract: As scientific literature grows and papers increasingly under-report limitations, multi-agent LLMs offer a promising approach to systematically uncover t

UpgradeBench: A Decision-Centric Benchmark for Upgrading Fine-Tuned LLM Specialists

arXiv:2608.20918v1 Announce Type: new Abstract: Organizations maintain task-specific adapters for open-weight language models, and each new base-model release forces a migration decision: retain exist

Using Human-LLM Disagreement to Improve Checklist-Based Quality Appraisal

arXiv:2608.20385v1 Announce Type: new Abstract: Systematic reviews rely on quality appraisal of included studies, a process that is time-consuming and sensitive to ambiguity in checklist criteria. Alt

researcharxiv-cs-cl

Hardware

Valid Inference with Synthetic Data via Task Exchangeability

arXiv:2606.13629v2 Announce Type: replace-cross Abstract: There is a proliferation of work arguing for the use of synthetic data in scientific research. For example, social scientists are arguing for

hardwarearxiv-cs-ai

What Color Is the Text? A Benchmark for Hallucination Induced by Image-Embedded Prompt

model-releasesarxiv-cs-cv

arXiv:2511.13400v3 Announce Type: replace Abstract: We introduce Embedded Stroop, a controlled diagnostic paradigm for measuring image-embedded prompt interference in Multimodal Large Language Models

When Failures Propagate: Causal Failure Attribution in Agentic Retrieval-Augmented Generation

arXiv:2608.20627v1 Announce Type: cross Abstract: Agentic retrieval-augmented generation (RAG) interleaves retrieval, reasoning, and answer generation across multiple hops. A retrieval error at hop 1

Applications

A comparison between ceiling-mounted FMCW, IR-UWB and Wi-Fi radar for in-bedroom human activity monitoring and sleep interruption detection