Search: “evaluation”

Walking the Embedding Space: Datastore Extraction from Multimodal RAG

arXiv:2610.01871v1 Announce Type: cross Abstract: Multimodal Retrieval-Augmented Generation (MRAG) has emerged as a reliable and cost-effective technique of grounding the generative capabilities of Mu

applicationsarxiv-cs-ai

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

When Reasoning Helps Action: Monitoring and Steering Chain-of-Thought in Vision-Language-Action Policies

DGX agent

arXiv:2610.00601v1 Announce Type: cross Abstract: Reasoning-enabled VLA policies expose chain-of-thought (CoT) traces that appear to explain and guide their actions, creating a potential interface for

safetyarxiv-cs-ai

2 Oct 2026

When the Judge Acts: Auditing VLM-Guided Image Selection on Culturally Situated Prompts

arXiv:2610.01243v1 Announce Type: cross Abstract: Vision-language models (VLMs) increasingly act as judges that pick the best of several generated images, so their choices decide what users see. Such

White Men Without Degrees Receive the Lowest Ratings from Large Language Models

arXiv:2610.00185v1 Announce Type: cross Abstract: White men without an undergraduate degree receive the lowest average ratings among eight gender-race-education groups in controlled large-language-mod

applicationsarxiv-cs-ai

WIPSNet: Deep Learning for Paediatric Wheeze Detection from Overnight Impedance Pneumography

arXiv:2610.00398v1 Announce Type: new Abstract: Overnight impedance pneumography (IP) is used to monitor paediatric respiratory health. Its current clinical readout, the Expiratory Variability Index (

researcharxiv-cs-lg

WOMBAT: Whitebox Oracle for Molecular Benchmarking and Attribution Testing

model-releasesarxiv-cs-lg

arXiv:2610.00713v1 Announce Type: new Abstract: When a graph neural network (GNN) explainer produces an unexpected attribution on a molecule, the attribution alone cannot reveal whether the explainer

3D Software Synthesis Driven by Constraint-Expressive Intermediate Representation

arXiv:2507.18625v3 Announce Type: replace-cross Abstract: Graphical user interface (UI) software has undergone a fundamental transformation from traditional two-dimensional (2D) desktop/web/mobile int

applicationsarxiv-cs-ai

A look at two opposing perspectives on AI agent sandboxing: infosec says labs need better containment while AI alignment says sandboxes cannot contain agents (Matthew Green/A Few Thoughts on Cryptographic Engineering)

Matthew Green / A Few Thoughts on Cryptographic Engineering: A look at two opposing perspectives on AI agent sandboxing: infosec says labs need better containment while AI alignment says sandboxes can

safetytechmeme

A Rank Graduation metric for Algorithmic fairness

arXiv:2609.39025v1 Announce Type: new Abstract: Fairness assessment in algorithmic decisions that affect individuals, such as credit scoring, often relies on parity measures calculated at the aggregat

safetyarxiv-cs-lg

ActionGuard: Tool Call Authorization under Poisoned Skills

arXiv:2609.39450v1 Announce Type: cross Abstract: LLM-based agents extend their capabilities through third-party skills that provide task-specific instructions, scripts, and tool-use procedures. Howev

safetyarxiv-cs-ai

Agents

AI Agents are Vulnerable to Radicalization

arXiv:2609.38296v1 Announce Type: new Abstract: Large language models (LLMs) can influence people's beliefs, yet little is known about whether and how they can manipulate each other. To investigate th

agentsarxiv-cs-ai

AIM: Agentic Idea Management for Automated Research

arXiv:2609.38445v1 Announce Type: new Abstract: Frontier LLMs are increasingly used to automate scientific research through iterative search. We distinguish idea-driven search from solution-driven sea

An Uncertainty-Guided Digital Twin Framework for Online Adaptive Proton Therapy in Head and Neck Cancer: A Feasibility Study

arXiv:2609.39010v1 Announce Type: cross Abstract: Objective: Head and neck (HN) proton therapy spans six to seven weeks of anatomical change, while offline replanning takes about a week. We present an

AneumoBench: A Source-Linked Benchmark for Synthetic-Geometry Transfer in Aneurysm CFD

arXiv:2505.14717v2 Announce Type: replace-cross Abstract: Scientific machine learning uses simulation data to train surrogate models for fast physical-field prediction across geometries. Local shape e

Argument Structure Prediction in Online Conversations: A Comparative Study of Modeling Paradigms and Task Architectures

model-releasesarxiv-cs-cl

arXiv:2609.39225v1 Announce Type: new Abstract: Argument structure prediction (ASP) constructs complete argument structures from discourse by identifying argumentative units and their relations. While

Atomic and Holistic LLM Judges for Reference-Grounded Support Labels: A Prompt-Controlled Comparison

model-releasesarxiv-cs-cl

arXiv:2603.28005v2 Announce Type: replace Abstract: When an LLM judge only has to assign a three-way support label to a candidate answer given a reference, does asking it to decompose the answer into

BARRAC: Adaptation of an English Aspect-based Sentiment Analysis Approach for Classification Tasks in Arabic Dialects

arXiv:2609.38820v1 Announce Type: cross Abstract: With the rapid growth of Arabic NLP, several models, datasets and benchmarks have been reported. This paper asks whether approaches developed for majo

safetyarxiv-cs-ai

Benchmarking EMlog Calibration for Autonomous Surface Vehicles

arXiv:2609.39203v1 Announce Type: new Abstract: Accurate velocity measurement is a fundamental requirement for autonomous surface and underwater vehicles. Commonly, velocity is provided by a Doppler v

safetyarxiv-cs-ro

Beyond Oracle Communication: Benchmarking Interactive Intent Alignment Under Miscommunication and Evolving User Intent

arXiv:2609.38604v1 Announce Type: cross Abstract: Modern LLM agents increasingly tackle complex tasks through interactive, long-horizon exchanges with users, while existing benchmarks generally assume

Beyond Simulation: Retain-and-Repair Neural Operators for Real-World Adaptation

arXiv:2609.39387v1 Announce Type: new Abstract: Neural operators increasingly benefit from pretraining on numerical simulations, yet adapting them for real-world prediction remains challenging. We int

applicationsarxiv-cs-lg

BMASH: Ball-Motion-Aware Soccer Header Spotting

arXiv:2609.39300v1 Announce Type: new Abstract: Recent advances in computer vision have made broadcast sports videos increasingly useful for event analysis, performance assessment, and player-safety a

safetyarxiv-cs-cv

CADeT: Causal-Aware Deformation Transmission for Indirect Robotic Manipulation of Soft Tissue

arXiv:2609.38483v1 Announce Type: new Abstract: Indirect manipulation of deep-seated deformable anatomy inaccessible to the robot is challenging in robot-assisted minimally invasive surgery (RAMIS) be

researcharxiv-cs-ro

California AG Rob Bonta issues an investigative subpoena to OpenAI, as part of a broader inquiry into cybersecurity incidents and risks related to its AI models (Jaspreet Singh/Reuters)

Jaspreet Singh / Reuters: California AG Rob Bonta issues an investigative subpoena to OpenAI, as part of a broader inquiry into cybersecurity incidents and risks related to its AI models — California

applicationstechmeme

ChunkTrust: Adapting Execution Horizons for Robot Policies with Action-Expert Evidence

arXiv:2609.39754v1 Announce Type: new Abstract: Robot foundation policies predict action chunks, but how many actions to execute before replanning depends on the current task phase. We introduce Chunk

safetyarxiv-cs-ro

CLIPPER Beyond Shortlisting: Auditable Decision Support for Changing Municipal Micromobility Policies

arXiv:2609.39054v1 Announce Type: new Abstract: In municipal planning workshops, planners and other stakeholders compare shared-micromobility parking policies by varying no-parking zones, retained sit

safetyarxiv-cs-ro

Agents

Coding Agents for Coding Theory

arXiv:2609.39081v1 Announce Type: cross Abstract: We spent five weeks using an LLM coding agent on open problems in coding theory: finding large sets of four-letter words, such as DNA barcodes, that s

agentsarxiv-cs-ai

Concept Subspaces Compute Beyond the Logit Lens: A Weights-Only Test for Locating Representations Upstream of Readout

arXiv:2609.39263v1 Announce Type: new Abstract: A concept subspace's effect on model behavior does not establish how it relates to the output readout. We introduce a two-sided geometric diagnostic tha

researcharxiv-cs-cl

Cybersecurity in Edge Computing: A Trust-Aware Federated Hybrid Intrusion Detection Framework

model-releasesarxiv-cs-lg

arXiv:2609.39584v1 Announce Type: cross Abstract: Edge computing has emerged as a critical computing paradigm in modern distributed systems by migrating data processing closer to end users and Interne

Data-Driven Priors for Uncertainty-Aware Risk Prediction of Clinical Deterioration using Multimodal Data

arXiv:2603.08459v2 Announce Type: replace Abstract: Safe predictions are a crucial requirement for integrating predictive models into clinical decision support systems. One approach to improving trust

applicationsarxiv-cs-lg

Debias It Yourself: Teaching LLMs Cognitive Bias Mitigation Interventions

arXiv:2609.40124v1 Announce Type: new Abstract: Bias has long been studied in social psychology and cognitive science, where decades of research have produced a body of validated interventions that re

safetyarxiv-cs-cl

Decision-Oriented Recommendation Reranking: An Empirical Study of Jev

model-releasesarxiv-cs-cl

arXiv:2609.40241v1 Announce Type: cross Abstract: Large language models (LLMs) have shown promise for recommendation reranking, but their use introduces an important tradeoff between recommendation qu

DeCoPrune: Efficient KV-Cache Pruning for Autoregressive Video Diffusion via Denoising Consistency

model-releasesarxiv-cs-cv

arXiv:2609.39096v1 Announce Type: new Abstract: Autoregressive video diffusion supports streaming generation and interactive control, but its KV cache grows with the generated history. Existing compre

Does a Shared Temperature Imply a Shared Angular Scale in Probabilistic Contrastive Learning?

arXiv:2609.38784v1 Announce Type: new Abstract: In probabilistic contrastive learning, a shared temperature is commonly interpreted as a shared similarity scale, but this interpretation does not hold

researcharxiv-cs-lg

Draft: A Parametric Tool for Robot Design Exploration

arXiv:2609.38405v1 Announce Type: new Abstract: Robot performance is often limited by the cost of iterating on morphology and control together, since every computer-aided design (CAD) change has to be

applicationsarxiv-cs-ro

EgoTools: Towards Tool-Centric Reasoning in Real-World Egocentric Videos

model-releasesarxiv-cs-cv

arXiv:2609.39378v1 Announce Type: new Abstract: Real-world embodied tasks, from everyday activities to professional procedures, require agents to act under physical constraints while tracking evolving

EHR2Trace: Auditable EHR Data Infrastructure for Patient World Models and Clinical Agents

arXiv:2609.38193v1 Announce Type: cross Abstract: Patient world models and clinical agents aim to predict changes in patients' health and support clinical work. Developing these systems requires relia

EmAvatar: Multimodal Empathetic Response Generation via Conflict Resolution and Expressive Guidance

model-releasesarxiv-cs-cv

arXiv:2609.38182v1 Announce Type: cross Abstract: Avatar-based multimodal empathetic response generation has emerged as a pivotal capability in human-centric systems, aiming to recognize user emotions

Fast Regularized Policy Mirror Descent with One-Step TD Updates

arXiv:2609.39837v1 Announce Type: new Abstract: Policy mirror descent (PMD) enjoys fast convergence in regularized Markov decision processes (MDPs), but existing guarantees often rely on exact or incr

safetyarxiv-cs-lg

Fine-Tuning NVIDIA Nemotron for Saudi Arabic Dialects, with a Path to Other Languages

model-releasesnvidia-developer

NVIDIA Nemotron 3.5 ASR was fine‑tuned on 133.7 h of Saudi Najdi and Hijazi speech using weighted replay with FLEURS data, duration bucketing, and selective encoder unfreezing; this reduced the target

FORTE: Forecasting Occupancy for Spatiotemporal Risk-Aware Planning in Dynamic Environments

arXiv:2609.39305v1 Announce Type: new Abstract: Safe navigation in dynamic environments requires anticipating future environmental states to account for spatiotemporal risks, specifically when and whe

researcharxiv-cs-ro

From cacophony to hierarchy: a principled framework for assessing AI consciousness

arXiv:2609.35618v2 Announce Type: replace Abstract: The question of AI consciousness is one of the most urgent pre-emptive problems in philosophy and computer science, yet progress is hampered by a ca

From Compound Figures to Medical Multi-image Reasoning: Scaling Multimodal Large Language Models with Biomedical Literature

arXiv:2511.22232v2 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) are increasingly capable in medical imaging, yet most focus on single-image settings. Clinical interp

From DNA Design to DNA Slimming: Auditable Agentic Discovery of a Deletion-Only Designer

model-releasesarxiv-cs-lg

arXiv:2609.40143v1 Announce Type: new Abstract: Compact regulatory DNA can free up space in vector payloads, reduce synthesis and assay burden, and expose which sequence features drive predicted activ

Fyan: A Human--AI Harness with Semantic Auditing for Document-Level Formalization

arXiv:2609.39228v1 Announce Type: new Abstract: We present FYAN, a human--AI harness for document-level mathematical formalization. Rather than treating theorems in isolation, FYAN coordinates an end-

GestAdapt: Workspace-Conditioned Co-Speech Gesture Generation for Humanoid Robots

arXiv:2609.38400v1 Announce Type: cross Abstract: Co-speech gestures for robots must adapt not only to speech and embodiment, but also to the workspace available for performing the motion. Since the s

Graph Residual Conjugate Diffusion: SNR-Equalized Heat Flow for Graph Signals

arXiv:2609.39658v1 Announce Type: new Abstract: Diffusion models generate data by reversing a forward corruption process that typically approaches a simple Gaussian prior. Recent work has extended thi

researcharxiv-cs-lg

GRPO Training Dynamics for Small Language Models

arXiv:2609.39321v1 Announce Type: cross Abstract: Group Relative Policy Optimization (GRPO) has emerged as a memory-efficient reinforcement fine-tuning (RFT) technique for reasoning-intensive tasks. H

Agents

Hiding in Plain Sight: Decoupling Pretext from Actuation for Skill Poisoning in LLM Agents

arXiv:2609.39352v1 Announce Type: cross Abstract: LLM agents increasingly rely on reusable Skills for complex, multi-step tasks, creating a critical supply-chain attack surface where poisoned Skill co

agentsarxiv-cs-ai