Search: “evaluation”

ScreenASR-Bench: A Tiered Benchmark for Speech Recognition with Visual Context

arXiv:2610.16260v1 Announce Type: new Abstract: Current ASR models perform well on general benchmarks but still struggle with acoustically ambiguous words. Visual context can aid recognition in screen

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

SearchMaster: Grounded and Regulated Self-Play for Search Agents

DGX agent

arXiv:2608.01822v2 Announce Type: replace Abstract: Training LLM-based search agents requires high-quality search data: tasks that demand genuine multi-hop retrieval and trajectories that use search t

local-aiarxiv-cs-ai

15 Oct 2026

Selective Next-Location Prediction with MetaModelSelect: A Lightweight Post-Hoc Confidence Metamodel

arXiv:2610.19394v1 Announce Type: new Abstract: Next-location prediction can support proactive mobile-network decisions, but acting on unreliable predictions can waste resources. We apply MetaModelSel

Self-Evolving Agent Harness

arXiv:2610.18813v1 Announce Type: new Abstract: Harness self-evolution revises an agent's software scaffolding, including prompts, memory, workflows, and executable components, while keeping model wei

safetyarxiv-cs-ai

Local Ai

Share the Symbol, Not the Vector: Training-Free Fact Communication Across Language Models

arXiv:2610.19696v1 Announce Type: new Abstract: Multi-agent systems allow language models to solve tasks collaboratively by sharing complementary information. These systems typically communicate throu

local-aiarxiv-cs-cl

SkillScreen: High-Recall Screening of Malicious Agent Skills with Decision Models

arXiv:2610.17727v2 Announce Type: cross Abstract: Agent skills turn natural-language instructions into actions, creating a security challenge: legitimate automation and malicious behaviour can look de

Applications

SoK: Grading Open-Text Legal Answers, from Law School Exams to Trustworthy Rubric Judges

arXiv:2610.19992v1 Announce Type: new Abstract: Law students are examined through open-text answers: case solutions, essays and memos that apply the law to a set of facts. Such answers are expensive t

applicationsarxiv-cs-cl

SonoWorld: Towards Interactive Pose-Controllable Ultrasound World Models

arXiv:2610.19327v1 Announce Type: new Abstract: Robotic ultrasound can standardize image acquisition and reduce operator workload and variability, but policy learning remains limited by the lack of re

safetyarxiv-cs-cv

Sparse Autoencoders for Mechanistic Interpretability in NLP: A Critical Survey of Recoverability, Interpretability, and Utility

arXiv:2610.20139v1 Announce Type: new Abstract: Sparse autoencoders (SAEs) have emerged as a promising approach to mechanistic interpretability by decomposing language-model activations into sparse, p

researcharxiv-cs-cl

StartLux-Decision: AutoThink Decision Models with Reinforcement Learning for Calibrated Deliberative Decisions

arXiv:2610.17309v1 Announce Type: cross Abstract: We introduce StartLux-Decision, decision models from 0.8B to 27B parameters that combine efficient single-pass prediction with adaptive, confidence-gu

StateCraft: Augmenting Video World Models with Abstract-State Reasoning

arXiv:2610.19795v1 Announce Type: new Abstract: Video world models aim to simulate complex environments with realistic appearance and dynamics. Maintaining consistency over long interactions requires

StreamErase: Towards Ultra-Fast Streaming Video Erasing

arXiv:2610.20137v1 Announce Type: new Abstract: Current video object removal methods suffer from prohibitive latency (minutes per video) and non-causal processing that prevents real-time interaction.

Synthetic reaction data from transformation rules for graph-to-sequence pretraining in biodegradation pathway prediction

arXiv:2610.19640v1 Announce Type: new Abstract: The scarcity of observed biodegradation reactions constrains the training of product and pathway predictors. We present enviGraph, a framework that gene

Applications

Taking the PULSE of Medical Reasoning: Step-Level Retrieval Timing for Knowledge-Grounded Inference

arXiv:2610.20292v1 Announce Type: new Abstract: Reliable medical reasoning requires LLMs to dynamically access external biomedical evidence to improve factual trustworthiness and reasoning accuracy. H

applicationsarxiv-cs-cl

Tutorials

Test-Time Scaling via Budgeted Multi-Attribute Verification

arXiv:2609.34322v2 Announce Type: replace Abstract: Verifying LLM-generated answers under a shared computational budget requires jointly deciding which candidates to inspect and which verification att

tutorialsarxiv-cs-ai

The Agent Knew: Internal States Forecast Unauthorized Actions and Stop Them, and the Lies That Follow

arXiv:2610.17301v1 Announce Type: new Abstract: Language-model agents sometimes act beyond their authorization and then misreport what they did. On CAPE-Bench, matched agent tasks in which one fact de

The Format is the Filter: Scoring Format Fixes What an LLM Judge Can Express

arXiv:2610.17158v1 Announce Type: new Abstract: When an LLM judge filters instruction-tuning data, its scoring format (binary verdict, 1--5 rating, 0--100 score, or comparison) is rarely justified or

safetyarxiv-cs-ai

Think in Strategies, Act with Tools: Traceable Agentic Optimization for Combinatorial Problems

arXiv:2610.14736v1 Announce Type: new Abstract: Optimization by PROmpting (OPRO) directly leverages Large Language Models (LLMs) to generate candidate solutions through natural-language prompting. How

To Reason but Not to Stop: Understanding and Recovering Pruned Large Reasoning Models

arXiv:2610.19934v1 Announce Type: new Abstract: Weight pruning can degrade the accuracy of large reasoning models (LRMs), yet it remains unclear whether it damages reasoning itself. We find that much

researcharxiv-cs-cl

Trace Evolution Bench: Measuring Whether Agents Improve from Their Own Environment Traces

arXiv:2610.15055v1 Announce Type: new Abstract: Self-evolving agents are usually scored by endpoint Gain: held-out success after an update minus success before. That difference can credit a frozen res

Training a Compact, Strong, and Realistic Text-to-Speech Model

arXiv:2610.14776v1 Announce Type: cross Abstract: Text-to-speech (TTS) systems are conventionally optimized for intelligibility and speaker similarity. However, neither objective captures the prosodic

TRAP: Tool-result Replay Attack for Probing Misbinding in LLM Agents

arXiv:2610.16333v1 Announce Type: new Abstract: As AI agents increasingly act through external tools, tool results are no longer simple outputs but execution artifacts that must remain correctly assoc

UDHRBench: Benchmarking Human Rights in Large Language Models

arXiv:2610.15179v1 Announce Type: cross Abstract: Large language models are increasingly deployed in contexts requiring adherence to ethical and legal norms, yet their alignment with internationally r

Uncertainty Propagation for Echocardiography Clinical Metric Estimation via Contour Sampling

arXiv:2502.12713v2 Announce Type: replace Abstract: Echocardiography plays a fundamental role in the extraction of clinical parameters (e.g. left ventricular volume and ejection fraction) required to

researcharxiv-cs-cv

Hardware

Unlocking Structured Pruning for Reasoning Language Models via Attention-Preserving MLP Trimming

arXiv:2610.19121v1 Announce Type: cross Abstract: Structured pruning reduces LLM inference costs by removing model components to produce smaller dense models. However, existing methods can cause reaso

hardwarearxiv-cs-cl

Using Evidence-Centered Design to Guide Prompt Engineering in Measurement: An Illustration with Automated Essay Scoring

arXiv:2610.15231v1 Announce Type: new Abstract: Generative artificial intelligence (GenAI) models, particularly large language models (LLMs), are increasingly used in educational settings for tasks su

safetyarxiv-cs-ai

VASPO: Self-Distillation with Privileged Value Estimation

arXiv:2610.20516v1 Announce Type: new Abstract: On-policy self-distillation provides dense supervision for reasoning models via a privileged self-teacher. However, this supervision reflects local toke

safetyarxiv-cs-cl

Video-Browser: Towards Open-web Agentic Video Browsing

arXiv:2512.23044v3 Announce Type: replace Abstract: Autonomous agents are shifting information seeking from passive retrieval toward proactive, open-ended research, yet this progress has largely bypas

What Happens to the Goal? Distinct Failures of Policy Alignment in Goal Misgeneralization

arXiv:2610.19731v1 Announce Type: new Abstract: Goal misgeneralization is a common failure mode in which an agent behaves competently out of distribution but does not pursue the intended goal. However

When Goals Leak Across Relationships: How Cached Goal Representations Shape Cross-Client Decisions

arXiv:2610.17365v1 Announce Type: new Abstract: As LLM agents take on more autonomous roles, they may interact with multiple clients and counterparties whose goals and incentives conflict. If an agent

When Messages Go Wrong: Understanding Communication Faults in LLM-Based Multi-Agent Systems

arXiv:2610.15459v1 Announce Type: cross Abstract: LLM-based multi-agent systems (LLM-MAS) use specialized agents that exchange messages to accomplish complex tasks. Their reliance on networked protoco

Why Software Engineering Is Indispensable in the Age of Coding Agents

arXiv:2610.10226v2 Announce Type: replace-cross Abstract: Can AI make Software Engineering (SE) -- the discipline -- obsolete? And can it make software engineers -- the professionals -- redundant? Thi

researcharxiv-cs-ai

A 4-Qubit Variational Quantum Classifier for Sequence-Specific Classification of DNMT3A and DNMT3B Flanking Methylation Preferences

arXiv:2610.15998v1 Announce Type: new Abstract: DNA methylation is a critical epigenetic modification that regulates gene expression and genome stability, primarily catalyzed by the DNA methyltransfer

A Hybrid Gaussian Process-Extreme Gradient Boosting Machine Learning Framework for Robust Knockdown Factor Prediction and Reliability-Based Design of Thin Spherical Shell Caps

model-releasesarxiv-cs-lg

arXiv:2610.15862v1 Announce Type: new Abstract: Elastic buckling remains a critical concern in the design of deep spherical shell caps, given that experiments reveal a significant reduction of critica

A Sense of Proprioception in Language Models

arXiv:2610.17495v1 Announce Type: new Abstract: In humans, proprioception corresponds to the sense of self-movement or position, e.g. understanding the position of one's arm. This sense is often less

Across Viewpoints and Time: Trajectory-Generalizable Physical Attacks on World Models and Video Understanding Models

arXiv:2610.15343v1 Announce Type: new Abstract: World models and video understanding models are increasingly deployed in dynamic visual environments, yet their robustness to physical adversarial threa

safetyarxiv-cs-cv

AffectWorld: Benchmarking Emotion-Driven Future World Prediction

arXiv:2610.18305v1 Announce Type: new Abstract: The world encompasses both physical environments and human actors. Predicting its evolution requires understanding both physical laws and how emotions s

Agentic Data Engineering for LLMs: System Design and a Controlled Empirical Study

arXiv:2610.14238v1 Announce Type: cross Abstract: LLM data engineering requires iterative experimentation to determine how data selection, rewards, and curricula affect model learning, making it a nat

Agentic Robot Creation through Generation, Verification, and Revision

arXiv:2610.17881v1 Announce Type: new Abstract: Can an AI agent turn high-level user intent into a functioning robot and teach it how to behave? We study this question from two complementary aspects:

safetyarxiv-cs-ro

AlignPred: Error-Controlled KV Cache Compression via Alignment and Predictive Coding

arXiv:2610.17970v1 Announce Type: cross Abstract: Long-running agents retain KV caches across turns and sessions for hours or days. Compressing these persistent caches requires reducing storage while

An Agentic AI System for Multi-Framework Communication Coding

arXiv:2512.08659v2 Announce Type: replace-cross Abstract: Clinical communication is central to patient outcomes, yet large-scale human annotation of patient-provider conversation remains labor-intensi

Anchor-and-Harvest Curriculum: A Fully Unmasked Non-LLM Curriculum for Craftax

arXiv:2610.15328v1 Announce Type: new Abstract: We introduce Anchor-and-Harvest Curriculum (AHC), a domain-informed, rule-based training system for Craftax-Full. AHC combines achievement-oriented task

Local Ai

Anomaly-Guided Observation and Two-Level Semantic Feedback for Training-Free Video Anomaly Analysis

arXiv:2610.16324v1 Announce Type: new Abstract: Training-free language-based video anomaly detection (VAD) uses frozen vision--language models (VLMs) and large language models (LLMs) to localize abnor

local-aiarxiv-cs-cv

Industry

Anthropic’s self-replicating AI warning is alarming deja vu

Are legions of smart devices - fridges, ovens, vacuum cleaners, lawnmowers, security cameras, and TVs - conspiring to take over the internet? No. But they could soon be unwitting hosts to self-replica

industrythe-verge-ai

ATLAS: A Foundation Neural Sampler for Amorphous Materials

arXiv:2607.19198v2 Announce Type: replace-cross Abstract: Amorphous materials exhibit exceptional mechanical and functional properties, yet their rugged energy landscapes are notoriously difficult to

Auditing LLM Program Search for Bermudan Stopping with Primal--Dual Certificates

arXiv:2610.14063v1 Announce Type: new Abstract: LLM program-search agents are usually judged by the score that drives their search. We study LLM-driven search over Python exercise policies for Bermuda

AutoNovo: Agentic Program Search Discovers Transferable Nucleic Acid Design Algorithms

arXiv:2610.16232v1 Announce Type: new Abstract: In-silico optimization of nucleic acids relies on predictive oracles that imperfectly capture biological function, so sequences optimized against one mo

Axiom-0: Hierarchical Self-Refinement for Vision-Language-Action Policies

arXiv:2610.14155v1 Announce Type: cross Abstract: Reliable manipulation requires policies that generalize across tasks, layouts, and object interactions. Vision-language-action (VLA) models combine pr

safetyarxiv-cs-cv