Search: “benchmark”

STATERA: Hidden Mass Estimation via Zero-Shot Sim-to-Real Kinematics using Frozen Temporal Tubelets

arXiv:2610.00003v1 Announce Type: cross Abstract: Vision models pretrained for frame-level appearance often struggle to infer hidden physical properties from motion. We study center-of-mass (CoM) loca

2 Oct 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Watch, Infer, Coordinate: Inferring Robot Partner Constraints for Zero-Shot Coordination

DGX agent

arXiv:2610.02170v1 Announce Type: cross Abstract: Robots operating in the physical world will increasingly need to coordinate with other robots, particularly in manipulation tasks where an object may

model-releasesarxiv-cs-ai

2 Oct 2026

When Do Biological Reasoning Models Use Their Biological Inputs?

arXiv:2610.00898v1 Announce Type: new Abstract: Biological reasoning models use post-training to connect LLMs to biological foundation model representations and biological text. Their benchmark accura

2 Oct 2026

Research

Which LLM to pick? Online Active Model Selection for Large Language Models

arXiv:2610.01592v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly applied to process streaming data, with practitioners relying on benchmarks to select the best model eve

researcharxiv-cs-lg

2 Oct 2026

4MT-VLM: How Coarse Is a VLMs Cognitive Map?

arXiv:2609.39238v1 Announce Type: new Abstract: An agent that moves must recognise a place from a viewpoint it has never seen. We introduce 4MT-VLM, a dataset of procedurally generated landscapes, eac

Agents

After a Decade: Bringing Shadow Removal into the Real World with Agentic Training Data

arXiv:2609.38607v1 Announce Type: cross Abstract: Shadow removal looks nearly solved on established benchmarks, yet remains brittle in the real world. Models have advanced; the paired training data th

agentsarxiv-cs-ai

AIM: Agentic Idea Management for Automated Research

arXiv:2609.38445v1 Announce Type: new Abstract: Frontier LLMs are increasingly used to automate scientific research through iterative search. We distinguish idea-driven search from solution-driven sea

APTInvestBench: Evaluating Autonomous APT Investigation under Varying Telemetry

arXiv:2609.38954v1 Announce Type: cross Abstract: Large language model (LLM) agents could help security operations centers (SOCs) investigate advanced persistent threats (APTs) by turning weak leads i

Argument Structure Prediction in Online Conversations: A Comparative Study of Modeling Paradigms and Task Architectures

arXiv:2609.39225v1 Announce Type: new Abstract: Argument structure prediction (ASP) constructs complete argument structures from discourse by identifying argumentative units and their relations. While

Argus: A Real-EKS Study of When Predicting Spot Interruptions Beats Simple Checkpointing

arXiv:2609.39067v1 Announce Type: new Abstract: Elastic Compute Cloud (EC2) Spot is 60% to 90% cheaper than On-Demand but can be reclaimed on just a 2-minute notice; for expensive multi-node training

Agents

AutoDataBench: A Data-centric Testbed for Accelerating Auto Research

arXiv:2609.40097v1 Announce Type: new Abstract: Existing auto-research benchmarks often entangle multiple sources of improvement, including training frameworks, hyperparameters, compute budgets, and d

agentsarxiv-cs-cl

Autoresearch in Mixed-Integer Linear and Nonlinear Programming

arXiv:2609.39360v1 Announce Type: new Abstract: Despite recent progress in autoresearch, applying it to practical operations research problems, typically formulated as NP-hard mixed-integer linear or

BAM! Bayesian Anything Model: a foundation model for generative computational imaging

model-releasesarxiv-cs-cv

arXiv:2609.39660v1 Announce Type: new Abstract: Generative models are transforming Bayesian computational imaging, yet the field still lacks physics-aware foundation models. Current practice falls int

Breaking Babel: A Self-Evolving Multi-Agent System for Long-Form Subtitle Translation

arXiv:2609.38660v1 Announce Type: cross Abstract: Long-form subtitle translation requires reasoning over discourse and cultural context spanning episodes or entire series, while maintaining consistent

Cheap to Draw, Expensive to Trust: Certifying Test-Time Scaling Curves

arXiv:2609.40190v1 Announce Type: cross Abstract: Sampling several answers and keeping the one a verifier scores highest is one of the simplest ways to buy accuracy at test time. Its effect is reporte

Community-Driven API and AI Writer Design for Openly Scaling Community Notes

arXiv:2609.40067v1 Announce Type: cross Abstract: Community Notes is a crowd-sourced approach for adding context to posts on X. Contributors propose and rate notes, forming the inputs to an open-sourc

Comparison of techniques for fine-tuning open-weight models for entity extraction from radiology reports

arXiv:2609.40236v1 Announce Type: new Abstract: Converting free-text radiology reports into structured labels supports cohort building, quality assurance, and monitoring of clinical imaging models, bu

ECHO-G: Embodied Co-speech Humanoid mOtion Generation

arXiv:2609.39575v1 Announce Type: cross Abstract: Generating full-body co-speech motion for humanoid robots requires coordinating speech prosody, linguistic content, and embodiment-specific motion. To

FANVIDv2: Evaluating Video Super-Resolution by Face and Licence-Plate Recognition Under Compound Degradation

model-releasesarxiv-cs-cv

arXiv:2609.39649v1 Announce Type: new Abstract: Video super-resolution (VSR) is normally judged by PSNR and SSIM on clips that were downsampled bicubically, although in surveillance its purpose is to

FlapKAD: A Simulation Dataset of Coupled Wing Kinematics and Aerodynamic Dynamics for Flapping-Wing Aerial Vehicles

model-releasesarxiv-cs-ro

arXiv:2609.38719v1 Announce Type: new Abstract: Experimental investigation and modeling of flapping-wing aerial vehicles are limited by the scarcity of large-scale records that temporally align wing k

From DNA Design to DNA Slimming: Auditable Agentic Discovery of a Deletion-Only Designer

arXiv:2609.40143v1 Announce Type: new Abstract: Compact regulatory DNA can free up space in vector payloads, reduce synthesis and assay burden, and expose which sequence features drive predicted activ

From Verification Failures to Reusable Guidance for Coding Agents

arXiv:2609.39022v1 Announce Type: cross Abstract: Coding agents need to establish that a program satisfies a specification and that the specification captures the requested behavior. We study how expe

GeoGAT: Bidirectional Temporal Sampling Meets Hierarchical Graph Attention for Global Video Geo-localization

model-releasesarxiv-cs-cv

arXiv:2609.39128v1 Announce Type: new Abstract: Global video geo-localization aims to infer the geographic location of a video worldwide, evaluating performance across four geographic hierarchies: cit

GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesis

arXiv:2609.38923v1 Announce Type: new Abstract: Working agents need to read diverse files, coordinate tools, and produce deliverables. Training such agents requires tasks built on many real files with

Hierarchical Reasoning Model

arXiv:2506.21734v4 Announce Type: replace Abstract: Reasoning, the process of devising and executing complex goal-oriented action sequences, remains a critical challenge in AI. Current large language

Large Language Models are Approximate Survival Estimators

arXiv:2609.38181v1 Announce Type: new Abstract: Survival analysis estimates time-to-event outcomes from patient covariates and is widely used for medical risk assessment. Patients seeking prognostic i

Learning from Runtime Feedback through Failure-Bank Self-Evolution for Vision-Language-Action Models

arXiv:2609.39820v1 Announce Type: cross Abstract: Vision-language-action (VLA) models generalize broadly across robotic manipulation tasks, but complex environments require balancing task success with

Listening to the Wise Few: Query-Key Alignment Unlocks Latent Correct Answers in Large Language Models

arXiv:2410.02343v2 Announce Type: replace Abstract: Large language models (LLMs) routinely fail to output the correct option in multiple-choice question answering (MCQA) while encoding the answer inte

Lowest Span Confidence: Zero-Shot Hallucination Detection from a Single LLM Response

arXiv:2601.19918v2 Announce Type: replace Abstract: Hallucinations in Large Language Models (LLMs), i.e., plausible but non-factual generations, pose a significant challenge to reliable deployment in

MASCRDM: Multi-Agent System for Compliance Risk Detection and Mitigation in Training Process of Large Language Models

arXiv:2609.39107v1 Announce Type: new Abstract: Large Language Models (LLMs) have been applied in various fields. However, ensuring compliance and safety of LLMs, such as avoiding discrimination and b

MatLoom: Layered Text-to-Material Generation in a Compact Program Space

arXiv:2609.40322v1 Announce Type: cross Abstract: Material generation should produce not only an appearance, but also the rules that construct it. We introduce MatLoom, a compact, layer-oriented langu

MedKIT: Evaluating Knowledge Integration and Generalization in Large Language Models

arXiv:2609.38543v1 Announce Type: new Abstract: Constantly evolving real-world knowledge necessitates models to be updated continuously. Especially in medicine, as clinical evidence changes over time,

NMIXX: Domain-Adapted Neural Embeddings for Cross-Lingual eXploration of Finance

arXiv:2507.09601v3 Announce Type: replace-cross Abstract: Financial text embeddings must distinguish changes in event status, perspective, and obligations even when passages share similar wording. NMI

PhantomEnvironments: Training LLM Agents in Fictional Worlds

arXiv:2609.40221v1 Announce Type: cross Abstract: Training LLM agents with reinforcement learning (RL) is bottlenecked by environments, which must provide verifiable rewards, support long-horizon inte

Removing Timing Shortcuts Improves Non-Invasive Brain-to-Text

arXiv:2609.40359v1 Announce Type: new Abstract: We find that major reported improvements in decoding words from non-invasive brain recordings are largely reproducible without any brain data. In the in

Riemannian Flow Models with Reinforcement Learning for Molecular Crystal Structure Prediction

arXiv:2609.39773v1 Announce Type: new Abstract: Crystal structure governs material properties, making crystal structure prediction (CSP) a fundamental problem in materials science. Generative models a

RoPE at the End of Its Rope? Theory, Diagnosis, and Mitigation of Long-Context Failures

arXiv:2609.39929v1 Announce Type: cross Abstract: Long-context failures of RoPE-based language models can arise from RoPE's intrinsic tradeoff between maintaining stable token preferences and distingu

RSI-Master: Structuring Experiments to Guide Autonomous Model Improvement

arXiv:2609.35561v2 Announce Type: replace Abstract: Recursive self-improvement (RSI) seeks to enable AI systems to participate in improving their own capabilities. A concrete pathway is autonomous mod

Self-Repulsive Sampling for Diffusion Language Models

arXiv:2609.39560v1 Announce Type: new Abstract: Sampling several responses and voting over their answers can improve a language model's accuracy, but repeated answers limit the benefit of additional s

Sequential Bayesian Evaluation of Large Language Model Behavior

arXiv:2511.10661v2 Announce Type: replace Abstract: It is increasingly important to evaluate the characteristics of systems based on large language models (LLMs). Evaluations in this context often rel

Should I stay or should I show? Learning to selectively disclose information

arXiv:2609.39818v1 Announce Type: new Abstract: In many high-stakes settings, human decision-makers can acquire support information before making a decision. However, acquiring information is costly,

SkillSeek: Revisiting Agent Skill Retrieval at Marketplace Scale

arXiv:2609.38822v1 Announce Type: cross Abstract: Anthropic's Agent Skills package reusable procedural know-how for an LLM agent into SKILL.md directories, and open-source aggregations have grown past

STARS: From Spatiotemporal Dynamics to Social Representations in Human-Robot Interaction

arXiv:2609.40245v1 Announce Type: cross Abstract: Robot navigation in dynamic, human-centered environments requires socially-compliant decisions grounded in robust scene understanding. Recent Vision-L

TomasuLLM: Out-of-Order Speculative Execution for LLM Agents

arXiv:2609.38201v1 Announce Type: new Abstract: Long-running tools can dominate coding-agent latency: compilers, test suites, and repository commands take seconds to minutes while the agent idles. Thi

Safety

Trust Is Not a Score: Runtime Assurance Contracts for High-Risk AI Agents

arXiv:2609.39717v1 Announce Type: new Abstract: Benchmarks, audits, and agent protocols describe performance, permissions, and repair, but not how observed evidence should change an agent's authority

safetyarxiv-cs-ai

VAmoS Part Deux: Harder, More Realistic Voice-Agent Simulation

arXiv:2609.38512v1 Announce Type: new Abstract: Voice agents in production must handle several requests, background speech, and customers who lose patience. We introduce VAmoS Energy, a benchmark that

Who Said What, and Will It Be Remembered? Evaluating Persistent Speaker Attribution Across Meetings

arXiv:2609.39344v1 Announce Type: cross Abstract: Speech transcripts used as long-term memory must preserve both words and stable speaker identities. Existing meeting-transcription metrics either igno

AgentBug-Smith: Automatically Reproducing Real-World Harness Bugs in Agentic Systems

arXiv:2609.37864v1 Announce Type: cross Abstract: Agent harness bugs exhibit unique characteristics and remain challenging for state-of-the-art software agents to repair. Progress in this area is furt