Search: “evaluation”

Humans vs. Machines: A Comparison With AI Agents in Software Reverse Engineering

arXiv:2610.14960v1 Announce Type: cross Abstract: Can an autonomous AI agent reverse engineer a binary as well as a skilled human analyst? Do they adopt the same strategy, and can agents scale to real

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

HyrCap: Hybrid Rank-Calibration of Action Proposals for Temporal Event Understanding

DGX agent

arXiv:2610.19526v1 Announce Type: new Abstract: Temporal action detection in long untrimmed videos suffers from inaccurate localization and low-quality proposals, especially with sparse annotations an

local-aiarxiv-cs-cv

15 Oct 2026

IMU-Bench: Benchmarking Wrist IMU Representations Across Kinematic, Semantic and Clinical Tasks

model-releasesarxiv-cs-ro

arXiv:2610.19481v1 Announce Type: new Abstract: Wrist-worn inertial measurement units (IMUs) provide a common sensing modality for tasks ranging from activity and gesture recognition to pose estimatio

InfiniSplat v2: Analyzing and Improving Feed-Forward 3DGS from Any Views

arXiv:2610.20341v1 Announce Type: new Abstract: Feed-forward Gaussian reconstruction builds 3D scenes directly from input images for novel view rendering, but learning Gaussian attributes from predict

Instruction-Conditioned Motion Control for Robotic Arms: Language-to-Code Decomposition and Reinforcement Learning

model-releasesarxiv-cs-ro

arXiv:2610.19617v1 Announce Type: new Abstract: Instruction-Conditioned Motion Control (ICMC) separates parameter specification, instruction generation, and code synthesis for language-driven robot co

INTACT: Inducing Latent Reasoning on a Frozen Backbone

arXiv:2610.19568v1 Announce Type: new Abstract: Latent reasoning replaces natural-language chains of thought with compact continuous 'soft-token' representations, reducing the number of intermediate t

Interlock: From Local Correctness to Task Completion in Long-Horizon Agents

arXiv:2610.19686v1 Announce Type: new Abstract: Large language model agents increasingly undertake long-horizon tasks in complex environments characterized by fragmented evidence, partially completed

agentsarxiv-cs-cl

JAL-Turn: Joint Acoustic-Linguistic Modeling for Real-Time and Robust Turn-Taking Detection in Full-Duplex Spoken Dialogue Systems

arXiv:2603.26515v2 Announce Type: replace-cross Abstract: Efficient and robust turn-taking detection remains a significant challenge in industrial-grade voice AI agents. Existing systems often rely on

applicationsarxiv-cs-ai

Learning From a Steady Hand: A Weakly Supervised Agent for Robot Assistance under Microscopy

arXiv:2601.20776v2 Announce Type: replace Abstract: This paper rethinks steady-hand robotic manipulation by using a weakly supervised framework that fuses calibration-aware perception with admittance

agentsarxiv-cs-ro

Learning Graph Energies for Finite-Time Generation

arXiv:2610.19946v1 Announce Type: new Abstract: Energy-based models can represent distributions over discrete structures such as molecular graphs, but an energy that is accurate at equilibrium need no

researcharxiv-cs-lg

Learning to GUIDE the Group: Self-Learning LLM Facilitation Across Multi-Party Tasks

arXiv:2610.16231v1 Announce Type: new Abstract: As large language models are increasingly adopted as multi-party communication facilitators, there is a growing demand for agents capable of balancing d

safetyarxiv-cs-ai

Learning What to Keep: Transfer-Aware Personal Skill Learning from User Feedback

arXiv:2610.19380v1 Announce Type: new Abstract: User feedback enables LLMs to refine reusable personalized skills, but often mixes persistent preferences with request-specific corrections. Indiscrimin

Learning Who Benefits Most: Multi-Treatment Causal Ranking for Population Health Stratification

arXiv:2610.19782v1 Announce Type: new Abstract: Population health stratification frameworks, such as the Italian DM77, organize patients by clinical need and care pathways but offer limited guidance o

applicationsarxiv-cs-lg

LIBERO-Industry: Benchmarking Robotic Manipulation under Industrial Process Constraints

arXiv:2610.16782v1 Announce Type: new Abstract: Industrial manipulation in flexible manufacturing, e.g., high-mix, low-volume (HMLV) electronics assembly, requires robot policies to adapt to changing

Lightweight but Linguistically Fair? Quantisation Robustness across Bavarian, German, and English

arXiv:2610.18343v1 Announce Type: cross Abstract: Post-training quantisation reduces the memory cost of large language models, but it remains unclear whether compression preserves language skills of r

Limits of Statistical Assurance for Embodied and Agentic AI under Adaptive Adversaries

arXiv:2610.18948v1 Announce Type: cross Abstract: Finite safety assessments cannot exclude an adversary that preserves unattacked behavior until certification and activates afterward. We characterize

safetyarxiv-cs-lg

Look Before You Restore: Learning to Predict Before Acting for Agentic Image Restoration

arXiv:2610.20384v1 Announce Type: new Abstract: Agents for mixed-degradation image restoration typically learn what a tool does to an image only after running it: failed calls waste computation and ha

agentsarxiv-cs-cv

Loose Lips: Understanding Privacy Leakage in Agentic Dialogue

arXiv:2610.14071v1 Announce Type: cross Abstract: As LLM agents are increasingly deployed in high-stakes enterprise settings, understanding how they handle sensitive information in agentic dialogue ha

Lost in Translation: Why Lower Bias Scores Don't Mean Fairer Models

arXiv:2610.20479v1 Announce Type: new Abstract: Bias audits of multilingual language models usually compare a model's average stereotype score in English with its average in another language and read

safetyarxiv-cs-cl

LURE: a Phase-Labelled Synthetic Corpus of Online-Grooming Exchanges

arXiv:2610.15908v1 Announce Type: new Abstract: Phase-annotated conversational data is essential for studying the progression of online grooming of minors and for developing early warning tools. Howev

MakSafe: A Spatiotemporal Semantic Framework for Formal Specification and Compliance Checking of Road Vehicle Safety Rules

arXiv:2610.19735v1 Announce Type: new Abstract: Scenario-based validation is essential for automated road vehicles but cannot cover the full variability of openworld traffic. We present MakSafe, a for

Meta’s Muse Spark Open now available in Amazon SageMaker JumpStart

Muse Spark Open, Meta's coding-optimized open-weight model, is now available in Amazon SageMaker JumpStart. Deploy it to a SageMaker AI endpoint in your own AWS account using SageMaker Studio or the S

applicationsaws-ml-blog

MMLA-RSI: Recursive Self-Improvement through RTT and RTMA

arXiv:2610.20294v1 Announce Type: new Abstract: An agent can improve its behavior within an unresolved problem by changing how it acts and which experience it retains. We propose MMLA-RSI, a recursive

safetyarxiv-cs-cl

MonoMIP: Multi-Height Inverse Perspective Mapping for Monocular 3D Object Detection

arXiv:2610.19071v1 Announce Type: new Abstract: Monocular 3D object detection methods increasingly rely on depth-guided transformers, but they operate entirely in the perspective image plane where spa

Noisy-Label Calibration with Multiple Unreliable Labels

arXiv:2610.19543v1 Announce Type: cross Abstract: In medical annotation and crowdsourcing, multiple annotators assign labels to each example, but these labels may be incorrect. Treating such noisy lab

safetyarxiv-cs-lg

One-Sided Verification Under Limited Expert Review

arXiv:2610.18089v1 Announce Type: new Abstract: AI has become increasingly helpful in scientific discovery, yet human expert review remains essential for those problems without reliable automated eval

applicationsarxiv-cs-ai

One-Step Prediction Fidelity Is a Poor Proxy for Planning Performance in JEPA World Models

arXiv:2610.19375v1 Announce Type: new Abstract: Latent world models are routinely selected, checkpointed and ablated on one-step prediction loss, on the assumption that a model which predicts the next

researcharxiv-cs-lg

Output Discipline Sets the Floor: A Falsification-Guided, Model-Agnostic Agent Protocol for Auditable Hypothesis-Driven Decision Making

arXiv:2610.18298v1 Announce Type: new Abstract: What binds large language models on auditable, hypothesis-driven decision tasks, where every candidate can be checked against the evidence? On the publi

Phantom Merge: When Your Large Language Model Agents Pick One but Tell You About Another

arXiv:2610.16141v1 Announce Type: new Abstract: LLM agents increasingly operate over multiple entities, where reliable response generation requires not only retrieving relevant evidence but also prese

agentsarxiv-cs-ai

PhysCodeGym: Benchmarking Coding Agents for Physically Verifiable 4D Reconstruction

arXiv:2610.17288v1 Announce Type: new Abstract: Building physical simulations from video requires coding agents to translate observations into executable models and refine them through tool use. We in

Physical Time as a Missing Dimension of Robot Policy Memory Dynamics

arXiv:2610.20524v1 Announce Type: new Abstract: Existing robot policy memories typically evolve with observation sequences, implicitly treating each update as the same amount of physical time. Yet ide

safetyarxiv-cs-ro

Plan or Retrieve First? A Scale Study of Tool Discovery Architectures

researchapple-ml-research

Tool-augmented LLM agents discover relevant APIs from large registries before planning execution, yet finite context windows prohibit injecting all tool definitions into a single prompt. The dominant

ProgAgent: Learning Tool Orchestration through Programmatic Training

arXiv:2610.14774v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly expected to orchestrate diverse tools over long-horizon tasks. Existing agents typically use Direct Tool C

agentsarxiv-cs-ai

Radioactive Feedback: Tracing Models Trained by Label-Only LLM Supervision

arXiv:2610.15685v1 Announce Type: new Abstract: Conventional distillation transfers capability through teacher-generated demonstrations. LLM-as-a-Judge knowledge distillation offers a distinct and inc

RadixFlow: Filling Execution Bubbles in Prefix-Cached Hybrid LLM Serving

arXiv:2610.18143v1 Announce Type: new Abstract: Prefix reuse improves LLM inference by sharing the KV cache of common prompt prefixes. This helps only if the scheduler can execute a matched branch in

RAN-JEPA: An Action-Conditioned World Model for Energy-efficient Mobile Network Control

arXiv:2610.17584v1 Announce Type: new Abstract: Operational mobile networks are rich in observations but poor in interventions: they continuously generate large volumes of passive telemetry, while con

RCCM: Diagnosing Gains and Harms in Reasoning-Prompt Transfer

arXiv:2610.19872v1 Announce Type: new Abstract: A reasoning prompt can improve one deployment and degrade another. RCCM (Reasoning-Control Capability Mismatch) examines these reversals by pairing answ

Receding-Horizon Next-Best-View Planning for Highly Occluded Target Perception

arXiv:2610.19082v1 Announce Type: new Abstract: Robotic systems that must acquire information about a specific target often face severe occlusion from sur- rounding structures or from the target itsel

researcharxiv-cs-ro

ReCreate: Reasoning and Creating Domain Agents Driven by Experience

arXiv:2601.11100v3 Announce Type: replace Abstract: Large Language Model (LLM) agents are reshaping the industrial landscape. However, most practical agents still rely on human-designed scaffolds, mak

agentsarxiv-cs-ai

Local Ai

Remember, Revisit, Revise: Scaffold Memory for Long-Horizon 3D Geometry

arXiv:2610.19674v1 Announce Type: new Abstract: Geometry foundation models estimate camera poses and 3D scene structure from video sequences, but maintaining consistent reconstructions over long horiz

local-aiarxiv-cs-cv

REPRO: Reflective Evolutionary Prompt Optimizer for Automated LLM Red-Teaming

arXiv:2610.15513v1 Announce Type: cross Abstract: Safety-aligned large language models (LLMs) remain vulnerable to adversarial prompts that bypass their safety training. Existing automated red-teaming

ReproBAIT: Can coding agents build their own biological AI tools?

arXiv:2610.19810v1 Announce Type: cross Abstract: Large language models are increasingly competent at leveraging scientific knowledge and existing computational tools to execute complex workflows. At

agentsarxiv-cs-lg

Riding the Fixed-Point Curve: Image Classification in the Continuous Thought Machine

arXiv:2610.19220v1 Announce Type: cross Abstract: The Continuous Thought Machine (CTM) is a recurrent network that attends to inputs and makes predictions based on the synchronization between its neur

Robust Real-Time Monocular Human Pose Estimation with Insole-Based Sensor Fusion

arXiv:2610.19494v1 Announce Type: new Abstract: Real-time monocular human pose estimation is an important sensing component for human-centered intelligent systems. While recent camera-based methods ha

RUBATO: Decoupled Clocks Allow Full-Duplex Models to Think as Fast as They Can

arXiv:2610.14299v1 Announce Type: cross Abstract: Recent Speech Full-Duplex (FDX) models are capable of engaging in naturalistic conversation by listening and speaking at the same time. Building on th

Safety for Whom? Benchmarking Understanding Beyond Refusal in Egocentric Multimodal Assistants

arXiv:2610.17728v1 Announce Type: new Abstract: Egocentric multimodal assistants see through the user's eyes and guide what the user does next, so their outputs directly shape physical actions, includ

Same Claim, Different Interpretations: How LLM Agents Resolve Ambiguity in Scientific Claims

arXiv:2610.20457v1 Announce Type: new Abstract: Co-scientists and agentic scientific claim verifiers are increasingly used to assess claims across the sciences. Natural-language scientific claims, wri

Scalable Robust MCTS with Anytime Deterministic Optimality Guarantees

arXiv:2610.15461v1 Announce Type: new Abstract: MDP planners often rely on nominal transition models that may differ from the true dynamics. Robust MDP planning accounts for this uncertainty through a

safetyarxiv-cs-ai