Search: “benchmark”

EmbodiedCLBench: Evaluating Continual Learning for Self-Evolving Embodied Agents

arXiv:2610.13021v1 Announce Type: new Abstract: Continual learning requires models to accumulate past experience and transfer it to new tasks. Despite substantial research on continual learning, exist

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

EvoBelief: Falsifiable World Models for Self-Improving LLM Agents

DGX agent

arXiv:2610.12789v1 Announce Type: new Abstract: Self-evolving LLM agents typically improve how they act through accumulated experience, reflection, or skills. Yet even procedurally capable agents can

model-releasesarxiv-cs-ai

12 Oct 2026

Machine Learning and Time-Series Foundation Models for Day-Ahead Electricity Forecasting in a University Building

arXiv:2610.12638v1 Announce Type: cross Abstract: Day-ahead electricity forecasts can help building operators schedule heating, ventilation, and other services around anticipated demand. Choosing a fo

Masked Diffusion Language Agents for Tool-Integrated Chemical Reasoning

arXiv:2610.13330v1 Announce Type: new Abstract: Designing tool-integrated reasoning agent systems for complex chemical tasks remains a fundamental challenge. Although recent chemical agents have demon

MC-EvoBench: Auditing Experience-Driven Self-Improvement in Minecraft Agents

arXiv:2610.13829v1 Announce Type: cross Abstract: A central challenge in embodied recursive self-improvement is enabling agents to convert interaction history into capabilities that persist beyond one

OGPO: Offline Goal-conditioned Policy Optimization for Recoverable Vision-Language-Action Models

arXiv:2610.12914v1 Announce Type: new Abstract: Vision-language-action (VLA) models have shown strong promise in robotic manipulation, yet their post-training still predominantly relies on trajectory-

Personalization Without Stereotyping: Do Speech LLMs Know When to Turn a Deaf Ear?

arXiv:2610.13550v1 Announce Type: new Abstract: Recent speech LLMs can leverage rich paralinguistic cues, enabling more complex and personalized interactions. However, little work investigates how thi

Realism VS Accuracy: Event Sequence Forecasting from a Generative Modeling Perspective

arXiv:2610.12586v1 Announce Type: new Abstract: Event sequences are chains of random events, each described by heterogeneous (numerical and categorical) features. The problem of event sequence forecas

Temporal Evidence Forests for Long-Horizon Multi-Party Conversational Memory

arXiv:2610.12874v1 Announce Type: new Abstract: Long-term memory has been widely adopted in LLM-based agents to support persistent interaction and personalized assistance. Long-term multi-party intera

Trajectory Prediction for Autonomous Driving in Road Construction Zones Using Human-in-the-Loop Driving Data

arXiv:2610.12747v1 Announce Type: cross Abstract: Ego-trajectory prediction in urban roadway work zones remains an underexplored topic in autonomous-driving research, with limited dedicated data and s

UkrMeme: Multimodal Explainable Persuasion Detection in Ukrainian Memes

arXiv:2610.13783v1 Announce Type: new Abstract: Memes play a central role in modern online communication, especially in contexts of political conflict where visual and textual cues combine to convey p

Who&When Pro: Can LLMs Really Attribute Failures in AI Agents?

arXiv:2607.09996v2 Announce Type: replace Abstract: Automated failure attribution uses LLMs to identify where and why agentic systems fail. As agents become more capable, their failures become subtler

Code Understanding is a Bottleneck for Coding Agents

arXiv:2610.10610v1 Announce Type: cross Abstract: Repository benchmarks (e.g., SWE-bench) for coding agents often assume that lines of code edited can predict task difficulty, but such datasets' poor

DataVista: Diagnosing Multimodal LLMs on Data Video Understanding

arXiv:2610.11993v1 Announce Type: cross Abstract: Data video is a media form that integrates data visualization with video narrative, widely adopted in news reporting and business analysis. Compared w

DivMoE: Fine-Grained MoE Upcycling via Cross-Domain Expert Composition

arXiv:2610.11317v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) architectures have become essential for scaling large language models, with recent work demonstrating the benefits of fine-grai

Evaluating Rubric Generation with Interventional Transfer

arXiv:2610.10809v1 Announce Type: new Abstract: Instance-specific rubrics are common in AI benchmarks where reliable evaluation requires specific expert knowledge. This approach is difficult to scale,

FastBench: Can Streaming VLMs Perceive High-Dynamic Real-World Streams?

arXiv:2610.12427v1 Announce Type: cross Abstract: Streaming Video Large Language Models (VLMs) enable continuous video understanding, yet existing benchmarks focus on low-dynamic scenarios. Under boun

Research

From Pixels to Structure: Lightweight Vision-Language Models for Document OCR and Structured JSON Extraction

arXiv:2610.11818v1 Announce Type: cross Abstract: While massive, closed-source Vision-Language Models (VLMs) set strong benchmarks for document understanding, their dependence on commercial APIs limit

researcharxiv-cs-ai

HENet++: Hybrid Encoding and Multi-task Learning for 3D Perception and End-to-end Autonomous Driving

arXiv:2511.07106v2 Announce Type: replace Abstract: Three-dimensional feature extraction and multi-task perception are fundamental components of modern autonomous driving systems. Although large image

Look Where You Can: Active View Selection for CAD Reconstruction under Occlusion

arXiv:2610.11954v1 Announce Type: new Abstract: CAD reconstruction methods assume a luxury reality rarely grants: unrestricted visual access to the object, photographed from any desired angle. Real ob

Tutorials

Mid-Training Language Models on Raw Video

arXiv:2610.11019v1 Announce Type: cross Abstract: Multimodal large language models learn mostly from paired image-text data or annotated video, and raw web video is rarely used to further train an exi

tutorialsarxiv-cs-ai

OmniCapBench: A Deep-Structured Evaluation Framework for Fine-Grained Audio-Visual Captioning

arXiv:2610.12458v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are rapidly evolving toward continuous audio--visual reasoning, creating an urgent need for evaluations that ex

Safe Actions Alone Do Not Ensure Safe Agents: Identifying Unfulfilled Obligations with Guard Models

arXiv:2610.11773v1 Announce Type: new Abstract: Guard models are increasingly used to safeguard LLM-based agents, primarily by identifying actions that agents are forbidden to perform. However, identi

TRACE: Diagnosing Verifier Brittleness in Agentic Evaluation

arXiv:2610.11678v1 Announce Type: new Abstract: Verifier scores now serve as both benchmark metrics and training rewards for large language model (LLM) agents, and a change in score is routinely read

A Comparative Study of Evaluation Metrics for Long-Document Financial Narrative Summarization with Transformers

arXiv:2610.09529v1 Announce Type: new Abstract: There are more than 2,000 listed companies on the UK's London Stock Exchange, divided into 11 sectors who are required to communicate their financial re

Safety

A Framework for the Systematic Review of ML Assets in AI Registries

arXiv:2610.09551v1 Announce Type: new Abstract: Background: Modern software systems increasingly rely on Machine Learning (ML) assets (i.e., pre-trained models, datasets, benchmarks) for building, eva

safetyarxiv-cs-lg

HeiCo-FOCUS: A Clinically Grounded Dataset for Long-Context Video Understanding

arXiv:2610.10156v1 Announce Type: new Abstract: Recent advances in Vision-Language Models (VLMs) have led to rapid progress in video understanding across a wide range of benchmark tasks. However, exis

How Private is Private? A Comparative Study for Face De-Identification

arXiv:2610.10334v1 Announce Type: new Abstract: Face de-identification (FDeID) has emerged as a critical privacy-preserving technology, yet its evaluation remains fundamentally fragmented. Existing pr

Safety

MOTIP2: Spatial Priors for End-to-End Multi-Object Tracking

arXiv:2610.10391v1 Announce Type: new Abstract: End-to-end multi-object trackers have narrowed the gap with classical tracking-by-detection on association-difficult benchmarks. Yet they still make spa

safetyarxiv-cs-cv

Perceptually Aligned Evaluation of Style Transfer

arXiv:2610.10003v1 Announce Type: new Abstract: Style transfer lacks a reliable evaluation standard: ground truth is inherently ill-defined, and existing automatic metrics often fail to reflect human

PHRBench: A Behavioral Evaluation of Post-Hallucination Reasoning in LLMs

arXiv:2610.10455v1 Announce Type: new Abstract: Hallucinated information can propagate through multi-stage LLM systems and become part of the context for subsequent reasoning. Existing studies of post

RSIGym: A Flexible Environment for Recursive Self-Improvement

arXiv:2610.10310v1 Announce Type: new Abstract: Recursive self-improvement requires carrying accepted changes into later improvement cycles, while studying agent-proposed changes also requires substan

RunningTab: Direct Workspace Interaction with Environment-Side Tabs

arXiv:2610.10444v1 Announce Type: cross Abstract: Much knowledge work produces new deliverables from files a workspace already holds, and LLM agents are beginning to take such work over. Through direc

Towards Accurate End-Effector Localization for UMI-Style Robotic Manipulation Teaching

model-releasesarxiv-cs-ro

arXiv:2610.09857v1 Announce Type: new Abstract: Robot demonstration learning requires accurate and temporally complete end-effector localization during close-range manipulation and camera occlusion. E

Which Language Should a Skeleton Speak? Language Choices in Multilingual Reasoning

arXiv:2610.09607v1 Announce Type: new Abstract: Skeleton-based reasoning prompting is a promising training-free approach for structuring LLM reasoning, but prior work largely assumes an English-centri

2d-fet-bench: from spatial reasoning to fet design on flakes

arXiv:2610.07423v1 Announce Type: new Abstract: Field-effect transistor (FET) layouts on exfoliated two-dimensional flakes are typically drawn by hand for each flake, placing contacts and gates to mat

ALIVE: Interaction-Aligned Object Insertion for First-Frame-Guided Video Editing

arXiv:2610.08779v1 Announce Type: new Abstract: Current video editors can insert objects but often struggle to make them participate in interactions such as being picked up or manipulated. We introduc

Beyond Corrected Memory: Execution Consistency in Multi-Agent Systems

arXiv:2610.08101v1 Announce Type: new Abstract: Shared memory coordinates agents' actions, but correct records do not establish that those actions satisfy task requirements. Memory governance and fail

Beyond the Embedding Bottleneck: Adaptive Retrieval-Augmented 3D CT Report Generation

arXiv:2603.15822v2 Announce Type: replace Abstract: Automated radiology report generation from 3D CT volumes often suffers from incomplete pathology coverage. We provide empirical evidence that this l

BioStudyBench: Evaluating Agents on Post-Cutoff Biomedical Studies

arXiv:2610.07614v1 Announce Type: new Abstract: We evaluate whether AI agents can match the reported findings of published biomedical studies using public data. Existing evaluations do not consistentl

Calibrated Answers About Randomized Trials From a 4-Billion-Parameter Open Model: A Registered Test and a License-Clean Release

arXiv:2610.07019v1 Announce Type: new Abstract: Fiorillo v0.5 is an open model that answers typed questions with a probability for each answer. Its main specialist reads a randomized trial's article,

Dynamic Alignment and Calibration for Multimodal Learning

arXiv:2610.07928v1 Announce Type: cross Abstract: Dynamic multimodal learning aims to learn robust representations by adaptively modeling information discrepancies across modalities. However, existing

EMODE: Dynamic Para-Semantic Experts for Emotion-Aware Speech Language Modeling

arXiv:2610.06956v1 Announce Type: new Abstract: Large speech language models have demonstrated strong capabilities in unified cross-modal understanding and generation, yet paralinguistic cues, especia

Evaluating Behavioral Context for Interpretable IAM Policy Risk Scoring in Cloud Environments

arXiv:2610.07345v1 Announce Type: cross Abstract: IAM policy analysis typically emphasizes the authorization capabilities encoded in a policy, but security analyst review priority may also depend on t

Evaluating Escalation Signals for LLM Routing: Targets, Controls, and Five Ways to Fool Yourself

arXiv:2610.07354v1 Announce Type: new Abstract: Deciding when to escalate a query from a small language model to a larger one requires a cheap signal that predicts, before the large model is called, w

Even Small Reasoners Should Quote Their Sources: Introducing the Pleias-RAG Model Family

arXiv:2504.18225v2 Announce Type: replace Abstract: We introduce a new generation of small reasoning models for RAG, search, and source summarization. Pleias-RAG-350m and Pleias-RAG-1B are mid-trained

Evidence-Bound Reasoning: Neuro-Semantic Verification of Biomedical AI in Glioblastoma Radiogenomics

arXiv:2610.08660v1 Announce Type: new Abstract: Background: Biomedical AI can generate plausible explanations without reliably verifying whether each statement is supported by patient-specific evidenc

Geometric Coherence via Weighted Matching for 3D Heterogeneous Multi-Agent Reach-Avoid Games

model-releasesarxiv-cs-ro

arXiv:2610.06882v1 Announce Type: new Abstract: We study assignment quality in 3D heterogeneous multi-agent reach-avoid games and identify a recurring failure mode of cardinality-only matching in geom