Search: “benchmark”

Beyond Interaction Capacity: Estimator Scaling with Recursive Models for CTR Prediction

arXiv:2609.37905v1 Announce Type: cross Abstract: Click-Through Rate prediction, a core task in recommendation and advertising systems, relies on modeling interactions among sparse categorical feature

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Beyond Pixels: A Vector-to-Graph Framework for Reliable Schematic Auditing

DGX agent

arXiv:2602.11678v2 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs) have shown remarkable progress in visual understanding, yet they suffer from a critical limitation: structu

model-releasesarxiv-cs-ai

30 Sept 2026

Safety

BRIDGE: Bilevel Retrieval-Credit-Aware Agentic Reinforcement Learning

arXiv:2609.36505v1 Announce Type: new Abstract: Agentic reinforcement learning (ARL) with verifiable rewards improves the ability of large language models (LLMs) to tackle knowledge-intensive tasks by

safetyarxiv-cs-ai

Can Agents Design Libraries for Agents?

arXiv:2609.36730v1 Announce Type: new Abstract: Agents increasingly build on code written by other agents, and they reimplement rather than reuse, growing the codebases later agents must work in. To m

Can Language Models Learn to Forecast Stock Prices

arXiv:2609.36914v1 Announce Type: new Abstract: Post-training has been shown to significantly improve language models' performance on tasks with verifiable outcomes, including mathematical reasoning,

CineSubBench: Evaluating LLMs on Long-Form Narrative and Cultural Understanding from Multilingual Movie Subtitles

arXiv:2609.36218v1 Announce Type: cross Abstract: Large language models are increasingly evaluated in specialized domains such as law, medicine, software engineering, and cybersecurity, yet film remai

CRJudgeBench: Can AI Detect Plausible but Invalid Code Reviews?

arXiv:2609.37216v1 Announce Type: cross Abstract: Large language models can generate plausible code-review comments, but such comments may contain technically incorrect claims that mislead developers.

Draft in Parallel, Condition Through Depth: Adjacent Causal Injection for Speculative Decoding

arXiv:2609.36173v1 Announce Type: cross Abstract: Parallel speculative drafting generates multiple candidates in one backbone pass, but independent token selection can produce inconsistent continuatio

EpiCon: Collective Agent Learning through Co-Evolving Multimodal Memory

arXiv:2609.37923v1 Announce Type: new Abstract: Agents can learn from past executions, but enabling different agents to reuse and build on one another's experience remains challenging. We introduce Ep

agentsarxiv-cs-cv

EquivDP3: A SIM(3)-Invariant Point-Cloud Encoder for Data-Efficient Humanoid Loco-Manipulation

model-releasesarxiv-cs-ro

arXiv:2609.36575v1 Announce Type: new Abstract: Visuomotor policies for humanoid loco-manipulation must generalize across object poses and lighting from only a handful of demonstrations. 3D Diffusion

Exemplar2VQA: A Scalable Exemplar-Driven Visual Question Answering Generation Framework via Multi-Agent Coding

arXiv:2609.37655v1 Announce Type: new Abstract: Advancing spatial intelligence in Multimodal Large Language Models (MLLMs) is bottlenecked by the scarcity of complex, scalable 3D question-answer (QA)

agentsarxiv-cs-cv

FORUM: Frozen Outputs Reconciled Using Model Agreement for Visual Grounding

arXiv:2609.37488v1 Announce Type: cross Abstract: Frozen multimodal large language models (MLLMs) now solve standard referring expression comprehension with a single prompted call, yet on adversarial

Research

Hierarchical Utility Calibration for Structured Multiclass Decisions

arXiv:2609.36532v1 Announce Type: cross Abstract: In multiclass probabilistic prediction, Utility Calibration (UC), which focuses auditing on specified utilities, has recently received attention as a

researcharxiv-cs-lg

How Many Labels Does a Language Need? Annotation Budgets and Cross-Lingual Pooling for African-Language Text Classification

arXiv:2609.37882v1 Announce Type: new Abstract: Every text classifier for an African language begins with a budgeting question: how many labelled examples are needed, and can labels from other African

Identifiability Guarantees for Drivers and Dynamics of Delayed Physical Systems

arXiv:2609.37944v2 Announce Type: cross Abstract: A wide range of methods have been proposed, including physics-informed neural networks, which are powerful but do not guarantee identifiability of the

IESR:Efficient MCTS-Based Modular Reasoning for Text-to-SQL with Large Language Models

arXiv:2602.05385v2 Announce Type: replace Abstract: Text-to-SQL is a key natural language processing task that maps natural language questions to SQL queries, enabling intuitive interaction with web-b

Improving Function Space Flow Matching with Kernel Optimal Transport

arXiv:2609.38049v1 Announce Type: new Abstract: Generative models for function-valued data, such as time series and solutions of partial differential equations, must learn distributions over infinite-

Research

Inter-patient ECG Arrhythmia Classification with LGNs and LUTNs

arXiv:2601.11433v2 Announce Type: replace Abstract: Deep Differentiable Logic Gate Networks (LGNs) and Lookup Table Networks (LUTNs) are demonstrated to be suitable for the automatic classification of

researcharxiv-cs-lg

Is Agent Code Less Maintainable Than Human Code?

arXiv:2606.21804v2 Announce Type: replace-cross Abstract: Maintainability is a core dimension of software engineering, shaping how code is written, reviewed, and developed over time. While coding agen

agentsarxiv-cs-ai

Koa-action: Fast and Consistent Structured Decision Making with Generative LLMs

arXiv:2609.36115v1 Announce Type: new Abstract: Industry applications often demand low-latency classification, yet current large language model (LLM) approaches remain poorly suited for latency-critic

LIBERO-MAX: Do Robot Policies Adapt When the World Changes?

arXiv:2609.36518v1 Announce Type: cross Abstract: Robots must often continue a task after a target moves, the viewpoint shifts, or an obstacle appears, even though their earlier observations and commi

LLM unbranding: Erasing Commercial Identity while Preserving Generic Utility

arXiv:2609.37127v1 Announce Type: new Abstract: Establishing unbranding as a critical practice to prevent visual logos from acquiring negative connotations is standard in image generation. Large Langu

LongCat-DeepResearch Technical Report

arXiv:2609.36071v1 Announce Type: new Abstract: We present LongCat-DeepResearch, a deep research system that combines an enhanced LongCat model with a multi-agent workflow for producing comprehensive,

LongHarness Bench: Stress-Testing Language Model Harnesses for Long-Context Reasoning

arXiv:2609.38137v1 Announce Type: new Abstract: Language-model (LM) harnesses enable LMs to operate effectively over long contexts using additional compute. However, existing long-context evaluations

MAPLE: Medical Aspect-Based Summarization with Phrase-Level Evidence

arXiv:2601.03418v3 Announce Type: replace Abstract: Trustworthy clinical summarization requires every claim to be traceable to its evidence, yet existing attribution often resolves only to the sentenc

Mirror-Score: Calibrated, Inference-only Scoring Exposes the Limits of Sequence-compatibility Ranking in D-peptide Design

arXiv:2609.36057v1 Announce Type: new Abstract: D-peptides combine protease resistance with high target specificity, but computational design of D-peptide binders remains immature. Mirror-Peptidizer i

Applications

MultiTalk: Scaling Full-Duplex Speech Models to Long, Multi-Party, Bilingual Conversation

arXiv:2609.36903v1 Announce Type: cross Abstract: End-to-end full-duplex speech models have brought open-source machine conversation closer to human-like interaction, yet existing systems remain limit

applicationsarxiv-cs-ai

PDE-OBS: Controlled Evaluation Across Observation Patterns

arXiv:2609.36521v2 Announce Type: new Abstract: Physical-field reconstruction and forecasting depend on both measurement density and spatial layout, yet evaluation under a single observation pattern d

Physics-Guided Flow-Map Matching for Precipitation Nowcasting

model-releasesarxiv-cs-cv

arXiv:2609.37487v1 Announce Type: new Abstract: Precipitation nowcasting, generating future radar fields from past observations, is critical for flood warning and disaster response. It is also a deman

Port-Hamiltonian Latent Deliberation: Mitigating the Deliberation Drift Cliff in Test-Time Compute Scaling

arXiv:2609.37351v1 Announce Type: cross Abstract: Test-time compute scaling has emerged as a cornerstone of advanced machine reasoning, yet performing iterative deliberation directly within continuous

PrecogUI: Proactive GUI Agents via Pre-cognitive Simulation and Experience Retrieval

arXiv:2609.36923v1 Announce Type: new Abstract: Existing reactive Graphical User Interface (GUI) agents often fail in long-horizon, dynamic scenarios, where unexpected disturbances trigger attention-d

ProgressCompass: Embodied Progress Reward Models Are Lost Without the Right Context

arXiv:2609.36684v1 Announce Type: new Abstract: Embodied agents now take on ever longer tasks. For long tasks, knowing only whether a task finally succeeds or fails says little; the steps along the wa

RAE-PPG: Duration-Grounded Retain-and-Extend Pretraining for PPG Foundation Models

arXiv:2609.36794v1 Announce Type: new Abstract: Signal features derived from photoplethysmography (PPG) require different signal durations to characterize. Existing PPG foundation models treat duratio

Research

REALHOP: Rethinking Multi-Hop Reasoning Evaluation via Behavioral Auditing

arXiv:2609.36984v1 Announce Type: new Abstract: Complex questions often require multi-hop reasoning that connects facts distributed across sources or distant regions of a long context through intermed

researcharxiv-cs-ai

Reliability Testing of Medical Model Performance under Distributed Deployment

arXiv:2609.36525v1 Announce Type: cross Abstract: Distributed inference has become an indispensable part of deploying medical models under practical latency, memory, and throughput constraints. Althou

Relic: From Multi-Agent Collaboration to Persistent Organizational Capability

arXiv:2609.32965v2 Announce Type: replace Abstract: Multiple agents may often conflict in an organization: for example, one coding agent changes an interface in a repository, but another continues to

RepoMAS: Solving Progressively Specified Tasks with Issue-Driven Multi-Agent Systems

arXiv:2609.32490v2 Announce Type: replace Abstract: LLM-based multi-agent systems (MASs) have shown strong potential for solving complex tasks, but most assume that task requirements are sufficiently

Retrieve, Reproduce, Reveal: Dissecting Retrieval-Augmented Software Vulnerability Detection

arXiv:2609.37669v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) is increasingly used to enhance Large Language Model (LLM)-based software vulnerability detection by grounding pr

SalamahBench: Dialect and Category Level Safety Evaluation of Arabic Language Models

arXiv:2603.04410v3 Announce Type: replace-cross Abstract: While different stakeholders are trying to leverage Arabic Language Models (ALMs), safety alignment in ALMs remains largely underexplored, hin

Spatial-OPSD: Self-Improving Spatial Reasoning via Label-Free Self-Distillation

model-releasesarxiv-cs-cv

arXiv:2609.37055v1 Announce Type: new Abstract: Vision-language models (VLMs) increasingly operate in embodied and spatially grounded settings, where accurate understanding of depth, viewpoint, and th

StateTape: Action-Conditioned Evidence Lifecycle Modeling for Long-Horizon Coding Agents

arXiv:2609.36319v1 Announce Type: new Abstract: Despite the recent success of coding agents built on large language models, it remains challenging to run them over long horizons, since every observati

Stochastic World Models for Verifying Vision-Based Neural Feedback Systems

arXiv:2609.38120v1 Announce Type: new Abstract: Verifying a vision-based neural feedback system requires a model of the observations its controller acts upon. Such a model must capture the variation t

Local Ai

The Commit-Abstain Circuit: Why Language Models Hallucinate Instead of Abstaining

arXiv:2609.32964v2 Announce Type: replace Abstract: Language models (LMs) often hallucinate by committing to confident answers rather than abstaining, even when they do not have enough information to

local-aiarxiv-cs-ai

Safety

The Layer Mystery of VLA: An Information-Theoretical Analysis of VLA Latent Interface

arXiv:2609.36118v1 Announce Type: new Abstract: Vision-language-action (VLA) policies connect a pretrained vision-language backbone to an action head through a latent interface, but which backbone lay

safetyarxiv-cs-ai

Safety

Towards Better Training Signal: Advantage Clipped Policy Optimization

arXiv:2609.36816v1 Announce Type: new Abstract: Reinforcement learning (RL) has become a cornerstone for improving the reasoning capabilities of large language models (LLMs), but the need for on-polic

safetyarxiv-cs-lg

UnlearningSoup: Is Repeated Tuning Necessary for Large Language Model Unlearning?

arXiv:2609.37076v1 Announce Type: new Abstract: Large language models trained on vast corpora inherently risk memorizing harmful content that may later re-emerge in their outputs. To mitigate this iss

Visual sensitivity is not claim retractability: persistence-aware credit assignment for multimodal reinforcement learning

arXiv:2609.36572v1 Announce Type: new Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has been extended to Large Vision-Language Models (LVLMs), and perception-aware methods further en

WEFT: Scaling Tool-Use Post-Training for General-Purpose Agents

arXiv:2609.36887v1 Announce Type: new Abstract: Recent efforts to scale tool-use post-training have largely centered on the synthesis of executable environments, which constitute only one component of

agentsarxiv-cs-ai