Search: “evaluation”

arXiv:2606.02494v1 Announce Type: cross Abstract: Agentic systems entering production typically operate as partially integrated assemblies where structural defects, not task-level errors, dominate the

agentsarxiv-cs-ai

Multimodal Approaches for Visually-Rich Document Type Classification: A Comparative Analysis

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2606.02162v1 Announce Type: cross Abstract: Document type classification in visually rich documents remains challenging, as relevant information is distributed across textual, visual, and layout

model-releasesarxiv-cs-ai

2 Jun 2026

Navigating the Reality Gap: On-Device Continual Adaptation of ASR for Clinical Telephony

model-releasesarxiv-cs-cl

arXiv:2512.16401v5 Announce Type: replace Abstract: Automatic Speech Recognition (ASR) can significantly reduce documentation burden in clinical workflows, but standard models degrade sharply in real-

Not What, But How: A Communicative Audit of LLM Response Framing

arXiv:2606.02493v1 Announce Type: new Abstract: Large language models (LLMs) are being increasingly used to answer subjective, information-seeking questions, where users are sensitive to how responses

researcharxiv-cs-cl

On Wednesdays, We Ask Questions: Optimizing 'Active Listening' in Automated Legal Triage and Referral

arXiv:2606.00272v1 Announce Type: new Abstract: The FETCH classifier generates follow-up questions to help refine the best match for the applicant's legal problem, using a low-cost ensemble of LLMs. I

Ontology-Guided Reasoning for Affordance-Based Explanations of Robot Navigation

model-releasesarxiv-cs-ro

arXiv:2606.00117v1 Announce Type: new Abstract: This paper proposes ontology-guided reasoning for affordance-based explanations of robot navigation. In human environments, it is not sufficient for a r

Optimizing Diversity and Quality through Base-Aligned Model Collaboration

arXiv:2511.05650v2 Announce Type: replace-cross Abstract: Alignment has greatly improved large language models (LLMs)' output quality at the cost of diversity, yielding highly similar outputs across g

PerBite: A Curated Diagnostic Workflow for Bite-Aware Food Volume Estimation

arXiv:2606.02021v1 Announce Type: new Abstract: Can a visually plausible food mesh be trusted to estimate the volume of consumed food? method investigates this question using selected paired before- a

Perspective on Bias in Biomedical AI: Preventing Downstream Healthcare Disparities

arXiv:2604.14514v2 Announce Type: replace Abstract: Healthcare disparities persist across socioeconomic boundaries, often attributed to unequal access to screening, diagnostics, and therapeutics. Howe

Physics-Aware Linearized ADMM and Its Unrolling

arXiv:2606.01652v1 Announce Type: cross Abstract: Recently, partial differential equations (PDEs) have been used to directly model the measurement process in signal processing, although their evaluati

Plausibility Is Not Prediction: Contrastive Evidence for LLM-Based Cellular Perturbation Reasoning

arXiv:2606.01042v1 Announce Type: cross Abstract: Perturbation experiments are central to understanding cellular mechanisms, but remain costly and sparse, motivating prediction of gene expression resp

Position Paper: Post-Solve Robustness in Decision Engines: Feasible Regions and Smoothness Under Perturbations

arXiv:2606.00002v1 Announce Type: new Abstract: Mixed-Integer Linear Programming (MILP) decision engines routinely output nominally optimal plans for high-stakes industrial systems. Yet deployment rar

Pre-Deployment Robustness Stress Testing for CT Segmentation Systems Using Clinically Motivated Multi-Corruption Augmentation

arXiv:2606.00491v1 Announce Type: cross Abstract: Deep learning-based CT segmentation systems often achieve high accuracy on clean benchmark images, but their performance may degrade under heterogeneo

Preconditioned One-Step Generative Modeling for Bayesian Inverse Problems in Function Spaces

arXiv:2603.14798v2 Announce Type: replace-cross Abstract: We propose a machine-learning algorithm for Bayesian inverse problems in the function-space regime. Based on one-step generative transport, th

researcharxiv-cs-lg

Profiling Privacy Preservation Against Gradient Inversion Attacks in Tabular Federated Learning

model-releasesarxiv-cs-lg

arXiv:2606.00986v1 Announce Type: new Abstract: Federated learning (FL) enables multiple data holders to train machine learning models collaboratively without centralizing raw data, making it useful i

Quality Audio Prototyping: a prototype system for unified sound retrieval and procedural generation

model-releasesarxiv-cs-lg

arXiv:2606.00629v1 Announce Type: cross Abstract: Sound design workflows frequently oscillate between time-consuming library searches and the complexity of procedural synthesis, with practitioners typ

Real-Time Physics Simulation with Dynamic Mesh-Gaussian Reconstructions

arXiv:2606.00444v1 Announce Type: new Abstract: Integrating dynamic 3D reconstructions into physics simulation requires fixed mesh topology for efficient collision detection, but state-of-the-art meth

ReasonBENCH: Benchmarking the (In)Stability of LLM Reasoning

arXiv:2512.07795v2 Announce Type: replace Abstract: Benchmark scores for LLM reasoning systems are reported as single numbers, yet the same model, strategy, and task can produce meaningfully different

Reasoning4Sciences: Bridging Reasoning Language Models to All Scientific Branches

arXiv:2606.01145v1 Announce Type: new Abstract: While Reasoning Language Models (RLMs) are rapidly emerging as powerful tools for scientific research, their impact is primarily concentrated in 'hard s

Rethinking Scientific Modeling: Toward Physically Consistent and Simulation-Executable Programmatic Generation

arXiv:2602.07083v2 Announce Type: replace-cross Abstract: Structural modeling is a fundamental component of computational engineering science, in which even minor physical inconsistencies or specifica

RoboBenchMart: Benchmarking Robots in Retail Environment

arXiv:2511.10276v2 Announce Type: replace-cross Abstract: Most existing robotic manipulation benchmarks focus on tabletop or household scenarios. While these setups have driven impressive progress, it

SafeGen-Bench: Benchmarking Safety in Image-Conditioned Text-to-Video Generation

model-releasesarxiv-cs-cv

arXiv:2606.01481v1 Announce Type: new Abstract: With the rapid advancements in text-to-image diffusion models, generative video models (T2V models) like Sora can now produce short synthetic videos fro

SafeVLA-Bench: A Benchmark for the Success-Safety Gap in Vision-Language-Action Models

model-releasesarxiv-cs-ro

arXiv:2606.00773v1 Announce Type: new Abstract: Vision-language-action (VLA) benchmarks measure whether a policy completes a requested manipulation task, but binary success can hide safety-relevant tr

Agents

SciAgentGym: Benchmarking Multi-Step Scientific Tool-use in LLM Agents

arXiv:2602.12984v2 Announce Type: replace Abstract: Scientific reasoning inherently demands integrating sophisticated toolkits to navigate domain-specific knowledge. Yet, current benchmarks largely ov

agentsarxiv-cs-cl

Sensitivity as a Double-Edged Sword: A Trade-off Between Discriminability and Adversarial Robustness

arXiv:2606.01746v1 Announce Type: new Abstract: Modern neural networks are highly susceptible to adversarial perturbations. In this work, we identify that part of this vulnerability stems from the sen

Short-form Text Rewriting with Phi Silica

arXiv:2606.00462v1 Announce Type: cross Abstract: Short-form text rewriting is a constrained variant of paraphrasing in which limited context and high semantic density leave little room for variation.

Silent Failures in Federated Personalization of Foundation Models

arXiv:2606.00947v1 Announce Type: cross Abstract: Foundation models are increasingly personalized on decentralized private data through federated learning and are now deployed at scale under growing r

Silent Failures in Physical AI: A Literature Review of Runtime Action Authorization for Autonomous Systems

arXiv:2606.00090v1 Announce Type: cross Abstract: Physical AI systems increasingly map multimodal observations, language instructions, and learned world representations into physically consequential a

Single-Channel Tissue Segmentation via Cross-Modal Distillation from Foundation Models

model-releasesarxiv-cs-cv

arXiv:2606.00928v1 Announce Type: new Abstract: Multiplexed fluorescence microscopy improves tissue segmentation by providing complementary channels including nuclear (DAPI) and membrane (E-cadherin),

Agents

'Skill issues'': data-centric optimization of lakehouse agents

arXiv:2606.01185v1 Announce Type: new Abstract: Coding agents are becoming users of data infrastructure, but their success depends not only on model quality: it also depends on the skills and environm

agentsarxiv-cs-ai

SkillHarm: Lifecycle-Aware Skill-Based Attacks via Automated Construction

model-releasesarxiv-cs-cl

arXiv:2606.02540v1 Announce Type: new Abstract: Agent skills occupy a privileged position in the agent workflow, as agents are expected to implicitly follow and execute them, rendering third-party ski

SMH-Bench: Benchmarking LLM Agents for Environment-Grounded Reasoning and Action in Smart Homes

arXiv:2606.01912v1 Announce Type: new Abstract: Smart homes are evolving toward complex state-dependent living environments, requiring Large Language Models (LLMs) to reason over user intent, preferen

StemBind: When MLLMs Get Lost Between Rules and Instances in Abstract Visual Reasoning

arXiv:2606.00148v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) often know the rule but pick the wrong answer: on abstract visual reasoning (AVR) tasks, a model can describe

Subliminal Learning is a LoRA Artifact

arXiv:2606.00831v1 Announce Type: new Abstract: Subliminal learning is a phenomenon where language models can transmit behavioral traits to other models through seemingly innocuous data (Cloud et al.,

TabPrep: Closing the Feature Engineering Gap in Tabular Benchmarks

model-releasesarxiv-cs-lg

arXiv:2606.02384v1 Announce Type: new Abstract: Progress in tabular machine learning has largely focused on increasingly sophisticated model architectures. At the same time, feature engineering remain

TextFake: Benchmarking AI-Generated Image Detection on Text-Rich Images

model-releasesarxiv-cs-cv

arXiv:2606.01050v1 Announce Type: new Abstract: Recent AI-generated image (AIGI) detectors perform well on natural-image benchmarks, but their behavior on text-rich forgeries, such as fabricated scree

The Alignment Curse: Modality Alignment Supercharges Audio Attacks via Text Transfer

arXiv:2602.02557v2 Announce Type: replace-cross Abstract: Recent advances in end-to-end trained omni-models have substantially improved audio capabilities by strengthening text-audio modality alignmen

The Social Cost of Intelligence: Emergence, Propagation, and Amplification of Stereotypical Bias in Multi-Agent Systems

arXiv:2510.10943v2 Announce Type: replace-cross Abstract: Bias in large language models (LLMs) remains a persistent challenge, often leading to stereotyping and unfair treatment across social groups.

safetyarxiv-cs-cl

THRD: A Training-Free Multi-Turn Defense Framework for Jailbreak Attacks on Large Language Models

arXiv:2606.01738v1 Announce Type: cross Abstract: Multi-turn jailbreak attacks pose a growing threat to LLMs by exploiting conversational dynamics such as gradual escalation and cross-turn coordinatio

Token Predictors Are Not Planners: Building Physically Grounded Causal Reasoners

arXiv:2606.01810v1 Announce Type: new Abstract: Current benchmarks for embodied vision-language planning often favor linguistic next-token prediction over physically grounded next-state reasoning. Thi

Toward Responsible and Epistemically Grounded Multilingual LLMs for Computational Social Science and Humanities

arXiv:2606.00596v1 Announce Type: new Abstract: Large language models have rapidly evolved in multilingual competence and reasoning capacity, enabling their integration into Social Sciences and Humani

safetyarxiv-cs-cl

Tutorials

Toward Robust In-Context Learning: Leveraging Out-of-distribution Proxies for Target Inaccessible Demonstration Retrieval

arXiv:2606.00014v1 Announce Type: cross Abstract: Although studies have demonstrated that Large Language Models (LLMs) can perform well on Out-of-Distribution (OOD) tasks, their advantage tends to dim

tutorialsarxiv-cs-ai

Uncertainty-Aware Graph Neural Reconstruction of Urban Temperature Fields from Sparse Sensors under Deployment Constraints

arXiv:2606.02038v1 Announce Type: cross Abstract: Reconstructing spatially continuous daily temperature fields from sparse observations is important for urban climate monitoring and heat-risk analysis

researcharxiv-cs-lg

Unveiling the Limits of Large Language Models in Inferring Pragmatic Meaning from Non-Verbal Responses

arXiv:2606.01845v1 Announce Type: cross Abstract: Although large language models (LLMs) have shown considerable progress in pragmatic language understanding, prior research has focused mainly on their

v-HUB: A Benchmark for Video Humor Understanding from Vision and Sound

arXiv:2509.25773v3 Announce Type: replace-cross Abstract: AI models capable of comprehending humor hold real-world promise -- for example, enhancing engagement in human-machine interactions. To gauge

Value-Free Policy Optimization via Reward Partitioning

arXiv:2506.13702v4 Announce Type: replace-cross Abstract: Single-trajectory preference optimization methods learn from datasets of ((prompt, response, reward)) tuples, offering a practical alternative

VESTA: Visual Exploration with Statistical Tool Agents

arXiv:2606.00384v1 Announce Type: new Abstract: Fitting quantitative models to data is a central step in scientific workflows, yet it remains one of the least automated. Recent agent-based systems lev

Vision Language Models Cannot Reason About Physical Transformation

arXiv:2603.07109v2 Announce Type: replace Abstract: Understanding physical transformations is fundamental for reasoning in dynamic environments. While Vision Language Models (VLMs) show promise in emb