Search: “benchmark”

arXiv:2609.23058v1 Announce Type: new Abstract: Current agent runtimes that plan before acting generally execute a step once it becomes ready. We present LazyAgent, a unified execution framework for a

agentsarxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

MachEmbodied-U0: Unified Understanding and Generation Model for Embodied Intelligence

DGX agent

arXiv:2609.25627v1 Announce Type: new Abstract: General-purpose robot control requires models to understand task intent, identify where to interact, capture how the scene evolves, and generate precise

model-releasesarxiv-cs-ro

23 Sept 2026

MATE: Policy-Aware Security Auditing for Mobile Agents via Synthesis-Driven Trajectory Learning

model-releasesarxiv-cs-ai

arXiv:2609.22724v1 Announce Type: cross Abstract: Mobile agents powered by foundation models now automate complex, multi-step workflows on real devices, but their trajectories can violate app-specific

Metric-Bench: Exploring In-context Spatial Metric Reasoning in VLMs for Indoor Scenes

arXiv:2609.25841v1 Announce Type: new Abstract: Metric reasoning is a critical and challenging task for Vision Language Models (VLMs), playing a pivotal role in embodied AI tasks such as robotic manip

Safety

Recursive self-improvement of AI research agents

arXiv:2609.26457v1 Announce Type: cross Abstract: AI agents are beginning to automate research and development across the AI stack, from improving training efficiency to optimizing inference. A natura

safetyarxiv-cs-lg

SambaGraph: Action-Reaction Spatio-Temporal Graphs for Soccer Tactical Response Modeling

arXiv:2609.25569v1 Announce Type: new Abstract: Soccer tactics are interactive: an attacking action changes the opponent's defensive problem, and the observed response depends on the multi-agent match

Same Chart, Different Story: Bias in Vision-Language Chart Interpretation

arXiv:2609.26210v1 Announce Type: new Abstract: Vision-language models (VLMs) are increasingly used to interpret charts and generate natural-language explanations for socially consequential data. Howe

Semantic Candidate-Job Matching: A Comparative Evaluation of Dense Embedding Models in Hybrid Retrieval

model-releasesarxiv-cs-ai

arXiv:2609.23307v1 Announce Type: cross Abstract: This paper presents a comparative evaluation of dense embedding models for semantic candidate-job matching in high-volume staffing workflows. Incoming

TriWorldBench: A Tri-View Consistency Perspective on Embodied World Models

model-releasesarxiv-cs-ro

arXiv:2609.26314v1 Announce Type: new Abstract: Embodied world models predict the outcomes of robot actions to support learning and planning. For robots equipped with head and wrist cameras, this requ

Truth for Believable AI: Expressed Doubt, Provenance, and Belief Revision as an Engineerable Stance

arXiv:2609.26035v1 Announce Type: new Abstract: Conversational agents often express answers in a uniformly confident register. We test whether expressed uncertainty, provenance-aware assertion, and ex

Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Models

arXiv:2609.25773v1 Announce Type: new Abstract: HopChain has shown on still images that multi-hop data synthesis improves vision-language reasoning, because long chain-of-thought reasoning exposes err

What Does 99% Accuracy Measure? A Reproducible Audit of Shortcut Learning in a Widely Used Fake News Corpus

arXiv:2609.25006v1 Announce Type: new Abstract: Text classifiers trained on the ISOT/Kaggle 'Fake and Real News' corpus routinely report accuracy and F1 above 0.98, a level of performance that sits un

Agents

When and How Should an Agent Clarify? CIGAsk: Teaching LLMs to Clarify via Counterfactual Information Gain

arXiv:2609.24290v1 Announce Type: new Abstract: Instruction-tuned LLMs faced with underspecified queries often commit to a single interpretation rather than ask for clarification, producing confidentl

agentsarxiv-cs-ai

You Only Need 2/3 of the Chosen Experts: An Empirical Study of Dynamic Expert Pruning in Fine-Grained MoE LLMs

arXiv:2609.25809v1 Announce Type: new Abstract: Fine-grained mixture-of-experts (MoE) architectures have become a mainstream design for open-weight LLMs, with hundreds of experts and increasingly many

researcharxiv-cs-lg

A Hybrid Attention Model Learning Unified Time-aware Patch Representation for Irregular Multivariate Time Series Forecasting

arXiv:2609.22836v1 Announce Type: new Abstract: Time series foundation models (TSFMs) have recently delivered impressive zero-shot performance across diverse forecasting tasks. However, real-world dec

AdaMerge: Tuning-Free Patch Compression for Multi-Vector Visual Document Retrieval

arXiv:2609.22562v1 Announce Type: new Abstract: Multi-vector visual document retrieval (VDR) models such as ColPali and ColNomic achieve strong accuracy by representing each document with hundreds to

An Empirical Study and Open Testbed for Federated Fine-Tuning of Vision-Language-Action Models

model-releasesarxiv-cs-ro

arXiv:2609.22973v1 Announce Type: new Abstract: Adapting a pretrained Vision-Language-Action (VLA) model to a new robot, environment, or task requires demonstrations that are collected locally and oft

An Iterative LangGraph Agent for Text-to-SQL: Natural Language Access to the Chicago Crime Database

arXiv:2609.22917v1 Announce Type: new Abstract: Non-technical stakeholders frequently cannot write the SQL needed to extract insights from operational databases. We built and evaluated a Text-to-SQL a

Bayesian Filtering in Physical Systems via Test-time Trained Flow Matching

arXiv:2609.23383v1 Announce Type: cross Abstract: Bayesian filtering provides a principled framework for online state estimation under uncertainty, yet its application to systems with high-dimensional

Beyond Average Error through Oracle-Informed Stress Tests for Time-Series Forecasting

arXiv:2609.22820v1 Announce Type: new Abstract: Average squared error cannot reveal whether forecasting performance degrades because the future becomes less predictable or because forecasts move farth

Beyond Point Prediction: Artificial Representative Trees with Uncertainty

arXiv:2609.24528v1 Announce Type: cross Abstract: Random forests (RFs) predict well but are opaque, whereas single decision trees are interpretable but unstable. Artificial representative trees (ARTs)

Beyond Similarity: Coverage-Aware Prompt Selection for Time Series Forecasting with LLMs

arXiv:2609.22977v1 Announce Type: cross Abstract: Similarity-based retrieval is the dominant rule for conditioning large language models (LLMs) in in-context learning, retrieval-augmented generation,

Can Spiking Neural Networks play pinball? A neuromorphic motion detector for target tracking

arXiv:2609.24403v1 Announce Type: new Abstract: Biological visual systems achieve continuous, low-latency motion perception by processing sparse, asynchronous spiking signals, enabling real-time track

CARE: Experience-Guided Atomic Corrective Execution for Vision-Language-Action Policies

model-releasesarxiv-cs-ro

arXiv:2609.24118v1 Announce Type: new Abstract: Vision-Language-Action (VLA) policies achieve strong performance in robotic manipulation but remain brittle once execution deviates from nominal traject

Combining Foundation Model Confidence and Monocular Depth for Training-Free Out-of-Distribution Segmentation

arXiv:2609.22896v1 Announce Type: new Abstract: Autonomous vehicles operating in open-world scenarios are inevitably confronted with previously unknown objects, such as exotic animals or loose cargo.

Do Student LLMs Inherit OOD Robustness? Invariance-Weighted Distillation for Reliable Knowledge Transfer

arXiv:2609.22566v1 Announce Type: new Abstract: Knowledge distillation (KD) aims to compress high-performance teacher LLMs into lightweight students. However, distilled students often exhibit substant

Does the Truthfulness Signal Survive Code-Mixing? Probing Hidden States for Hallucination Detection in Hinglish

arXiv:2609.22138v1 Announce Type: new Abstract: Hidden-state hallucination probing - training a linear classifier on an LLM's internal activations to detect whether a generated answer is faithful to t

GameHorizon Suite: Multi-Horizon Data and Evaluation in Gameplay

arXiv:2609.25001v1 Announce Type: new Abstract: Modern video games provide a measurable testbed for AI models, combining abilities of visual understanding, instruction decomposition, goal planning, an

Ground-Truth Subgraphs for Better Training and Evaluation of Knowledge Graph Augmented LLMs

arXiv:2511.04473v3 Announce Type: replace-cross Abstract: Retrieval of information from graph-structured knowledge bases represents a promising direction for improving the factuality of LLMs. While va

H2LooP Telecom Model v1: From Telecom Comprehension to Autonomous Issue and PR Resolution

arXiv:2609.22241v1 Announce Type: new Abstract: We present H2LooP Telecom Model v1, a domain-specialized large language models fine-tuned for the telecommunications industry. We release two domain-ada

INTCORT: Training-Free Spatial Reasoning Enhancement for Vision-Language Models via Input Transformations and Confidence Routing

arXiv:2609.24813v1 Announce Type: new Abstract: Vision-Language Models (VLMs) have demonstrated remarkable capabilities in multimodal tasks, yet they still exhibit poor ability in spatial reasoning. E

iSDFT: Information-Proximal Self-Distillation for Continual Learning in LLMs

arXiv:2609.24646v1 Announce Type: new Abstract: On-policy self-distillation fine-tuning (SDFT) learns new skills from demonstrations while reducing forgetting, but it always distils toward the full de

Tutorials

LLM-Based FORM Code Generation with Verification-Driven Fine-Tuning

arXiv:2609.23367v1 Announce Type: cross Abstract: FORM is a domain-specific symbolic manipulation language widely used in particle physics for processing the very large algebraic expressions arising f

tutorialsarxiv-cs-cl

MiTHras: Task-specific Hierarchical Semi-supervised Contrastive Masked Autoencoder for Mitotic Figure Analysis

arXiv:2609.24736v1 Announce Type: new Abstract: Mitotic figure (MF) analysis supports tumor grading and prognostic assessment, but automated models remain sensitive to differences in tissue type and i

MobileCybench: Evaluating Agent Vulnerability Discovery via Executable Probes

arXiv:2609.23980v1 Announce Type: cross Abstract: AI agents now report vulnerabilities faster than maintainers can review them. Reports often depend on security properties specific to the application,

MSI-Bench: Evaluating Multi-Speaker Voice Interaction for Collaborative AI Agents

arXiv:2609.24812v1 Announce Type: new Abstract: Voice provides a natural and immediate interface for AI agents. Many settings in which voice agents could be useful, including meetings, households, and

Pay More Attention To Text In High-Resolution MLLMs

arXiv:2609.23495v1 Announce Type: new Abstract: Failures of high-resolution MLLMs are commonly attributed to a visual problem, motivating zooming, cropping, and related visual interventions to recover

R-GEAN: Regimen-Guided Edit Action Network for Within-Admission Medication Change Prediction

arXiv:2609.22959v1 Announce Type: cross Abstract: The medications prescribed to a patient often change during a hospital admission as clinicians start, stop, or continue therapies. We study whether mo

RefAM: Attention Magnets for Zero-Shot Referral Segmentation

arXiv:2509.22650v3 Announce Type: replace Abstract: Most existing approaches to referring segmentation achieve strong performance only through fine-tuning or by composing multiple pre-trained models,

Safety

RLVR^{2}: Reinforcement Learning with Verifiable Rubric-based Ranking

arXiv:2609.23457v1 Announce Type: new Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) is expanding from tasks with well-defined correctness signals, such as mathematics and code, towar

safetyarxiv-cs-lg

SDC-GON: Singular Decomposition and Consistency-Regularized Green's Operator Networks for Solving Partial Differential Equations

arXiv:2609.23206v1 Announce Type: cross Abstract: Green's function based operator approximation offers an efficient route for solving linear partial differential equations under varying boundary condi

The Role of Dataset Linguistic Structure in the Cultural Awareness of Large Language Models

arXiv:2602.01161v2 Announce Type: replace Abstract: The global deployment of large language models (LLMs) has raised concerns about cultural misalignment, yet the linguistic properties of fine-tuning

Tool-Augmented On-Policy Distillation for LLM Domain Adaptation in Sequence-Based Omics Tasks

arXiv:2609.23435v1 Announce Type: cross Abstract: Multi-omics sequences contain complex biological patterns, yet deciphering their mechanisms for automated scientific discovery remains challenging. As

TTSE: A Two-Track Online Self-Evolution Framework

arXiv:2609.24289v1 Announce Type: new Abstract: As Large Language Model (LLM) agents are applied in continuously interactive environments, driving the evolution of their own capabilities becomes a cor

TWIG: A Time-Causal Wavelet Operator for Autoregressive Forecasting on Irregular Graphs

arXiv:2609.22585v1 Announce Type: new Abstract: We introduce TWIG (Time-Causal Wavelet Operator for Irregular Graphs), a graph-native neural operator for autoregressive surrogate modeling on static ir

WebMRIQC: A Web-Based Implementation of MRIQC for Accessible MRI Image Quality Assessment in Resource-Constrained Settings

arXiv:2609.24014v1 Announce Type: new Abstract: Reliable quality control (QC) of magnetic resonance imaging (MRI) is essential for reliable diagnostic neuroimaging, yet standard manual assessment is s

What Makes Good Multilingual Reasoning? Disentangling Traces with Measurable Features

arXiv:2604.04720v2 Announce Type: replace Abstract: Large Reasoning Models (LRMs) still exhibit large performance gaps between English and other languages, yet much current work assumes these gaps can

Auditing a KB Elicitation of Frontier LLM Knowledge: A Multi-dimensional Analysis of GPTKB v1.5