Search: “benchmark”

Interpretable Hypergraph Learning via Neural Additive Models

arXiv:2610.07458v1 Announce Type: new Abstract: Hypergraphs offer a natural framework for modeling networked data, where dependencies among entities are governed by higher-order interactions. While hy

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

MedZERO: Self-Evolving Agents for Open-Ended Medical Reasoning Through Controlled Knowledge Accumulation

DGX agent

arXiv:2610.08327v1 Announce Type: new Abstract: Large language models (LLMs) have shown promise in medical question answering and clinical reasoning, yet their improvement remains constrained by stati

researcharxiv-cs-ai

7 Oct 2026

Multimodal Knowledge Distillation for Gastric Adenocarcinoma Classification from Whole-Slide Images

arXiv:2610.07913v1 Announce Type: cross Abstract: Gastric adenocarcinoma (GA) is a leading cause of cancer-related mortality worldwide, and accurate histopathological subtype classification from whole

PERSIST: Who-What-When Memory Across Sessions for Full-Duplex Spoken Dialogue

arXiv:2610.07725v1 Announce Type: new Abstract: Modern voice assistants may be shared by multiple users and should be able to answer questions about earlier conversations such as 'When did I originall

Personal-Agent Mediated Recommendation with Cross-Platform User History

arXiv:2610.07588v1 Announce Type: new Abstract: Modern recommendation is shifting from platform-centric personalization toward user-governed personalization, where a personal LLM agent can act on the

Real-Time Generation of Game Video Commentary with Multimodal LLMs: Pause-Aware Decoding Approaches

arXiv:2603.02655v2 Announce Type: replace-cross Abstract: Real-time video commentary generation provides textual descriptions of ongoing events in videos. It supports accessibility and engagement in d

ReGraph: A Computational Account of Emergent Generalization in the 'what' and 'where' Dual Visual Streams

arXiv:2610.07962v1 Announce Type: cross Abstract: Where generalization capacity--the ability to extract context-invariant relational structures--first emerges remains a central question in AI and neur

Uncertainty in Representation Learning on Knowledge Graphs

arXiv:2610.06974v1 Announce Type: new Abstract: Knowledge graph embedding (KGE) methods represent entities and predicates in continuous vector spaces to infer missing knowledge. Despite strong benchma

Verifying Coordination in Parallel Coding Agents: NP-Bench and a Scheduling Planner

arXiv:2610.07261v1 Announce Type: new Abstract: A team of coding agents can look fine agent by agent yet fail as a team: each passes its own tests while the merged result is broken, and single-agent e

What the Elevation Map Cannot See: Semantic-Aware Locomotion and Execution-Aware Navigation for Humanoid Robot

model-releasesarxiv-cs-ro

arXiv:2610.07396v1 Announce Type: new Abstract: Navigation for humanoid robots is critical, yet large-scale evaluation on physical hardware is often impractical due to cost and safety concerns, making

All against the machine: the Solo score for rating skill in variable environments

arXiv:2610.04523v1 Announce Type: cross Abstract: We propose a distribution-free metric to rate individual skill in ``player-versus-environment'' settings, where participants face heterogeneous tasks

Assembling Insights for Agentic Machine Learning Engineering Systems

arXiv:2610.04927v1 Announce Type: cross Abstract: Agentic machine learning engineering (MLE) is an emerging AI4SE application for complex ML tasks and a step toward recursive self-improvement of AI sy

BossouChimpanzee: Long-term Chimpanzee Video Dataset

arXiv:2610.05293v1 Announce Type: new Abstract: We describe the BossouChimpanzee video dataset, a unique long-term visual record of wild chimpanzees at an outdoor laboratory for field experiments in B

Causal Lag Structure Discovery in Confounded Time Series via Orthogonalized Adaptive Estimation

arXiv:2610.05618v1 Announce Type: cross Abstract: Finding which variables cause which others in multivariate time series, and at what lags, is central to science and policy, yet existing methods force

Code2Games: Enabling Coding Agents for Gaming World Generation

arXiv:2610.05033v1 Announce Type: new Abstract: Generating a high-quality gaming world from a natural-language game intent requires joint reasoning about scene structure, spatial layout, gameplay obje

CodeForge-MA: Execution-Verified Multi-Agent Learning with Language-Conditioned LoRA for Multilingual Code Generation

arXiv:2610.05481v1 Announce Type: cross Abstract: Large language models for code generation often fail on execution, multilingual coverage, and contamination control, especially under frozen backbone

CoHyFuse: Condition-wise Hypergraph Fusion with Global Connectome in Task-fMRI

arXiv:2610.05913v1 Announce Type: new Abstract: Task-fMRI connectomes reveal state-dependent neural reconfigurations, yet conventional methods marginalize these signals by aggregating distinct conditi

DelegationBench: Measuring When AI Agents Should Ask Before Acting

arXiv:2610.05532v1 Announce Type: cross Abstract: AI agents that send emails, edit files, and make purchases must decide when to act on their own and when to check with the user first. This decision i

Disentangling Task Difficulty from Run-Level Failure in Agent Failure Prediction

arXiv:2610.05572v1 Announce Type: new Abstract: Predicting whether an LLM agent will fail has emerged as a promising direction for supporting intervention during execution. Recent approaches report st

FADE: Frame-Aware Diffusion-Transformer-based Multi-Concept Erasure for Video Unlearning

arXiv:2610.03980v1 Announce Type: new Abstract: Text-to-video (T2V) diffusion models can reproduce copyrighted, violent, or explicit content, which motivates concept erasure: removing designated conce

Homogeneous Semantic Alignment and Hierarchical Expert Routing for Radiology Report Generation

arXiv:2610.04499v1 Announce Type: new Abstract: Radiology report generation (RRG) aims to convert medical images into diagnostic texts to assist in clinical decision-making and alleviate the workload

Lossy Compression of PDE Training Inputs: Field Reconstruction Error Does Not Order the Cost to a Trained Operator

arXiv:2610.06095v1 Announce Type: new Abstract: Operator-learning benchmarks are stored at full precision and have grown to terabyte scale. Rate-distortion theory says how many bits the stored field n

Hardware

MetaKernelBench: Measuring GPU Kernel Knowledge Transfer Beyond Code

arXiv:2610.05014v1 Announce Type: new Abstract: Recent GPU kernel optimization agents retain what they learn in knowledge bases or as distilled skills. Kernel benchmarks score each attempt's implement

hardwarearxiv-cs-lg

One Figure, Every Canvas: Editable Flowchart Relayout via Agentic Pipeline

arXiv:2610.06852v1 Announce Type: new Abstract: Pipeline figures in ML papers must be repurposed across many canvases, including paper columns, 16:9 slides, portrait posters, 1:1 social teasers, 9:16

OVAL: Output-Aware Local Page Bases for KV Cache Retrieval

arXiv:2610.06686v1 Announce Type: new Abstract: Long context inference with large language models becomes increasingly expensive as attention must operate over an ever growing KV cache. Page sparse at

Protocol-Sensitive Evaluation of Log Anomaly Detection: Component Costs and Target-Access Sensitivity on HDFS and BGL

arXiv:2610.05807v1 Announce Type: cross Abstract: Protocol choices can change the conclusions drawn from log anomaly detection benchmarks even when detector settings are fixed. We present a joint empi

RefAtomNet++: Advancing Referring Atomic Video Action Recognition using Multi-Trajectory Semantic Retrieval

arXiv:2510.16444v2 Announce Type: replace Abstract: Who is being described, where are they, and what are they doing? Referring Atomic Video Action Recognition (RAVAR) answers these questions jointly b

Rethinking Tabular Foundation Models On Data Streams

arXiv:2610.05352v1 Announce Type: new Abstract: Tabular foundation models (TFMs) outperform established machine learning models on tabular benchmarks through in-context learning. Building on this succ

SepRQ : Self-Supervised Speech Mixture Representation Learning via Mask-Free, Multi-Scale Source Separation

arXiv:2610.04690v1 Announce Type: cross Abstract: Self-supervised learning (SSL) is standard for speech representation learning, but mainstream models are designed around single-speaker audio, limitin

Sparse-View 4D Gaussian Splatting via Spatiotemporal Priors and Generative Assistance

arXiv:2610.04606v1 Announce Type: new Abstract: We present a 4D Gaussian Splatting framework for the Sparse-View Track of the SIGGRAPH Asia 2026 Volumetric Video Challenge, which requires dynamic scen

Video Encoders Built on Image Representations

arXiv:2610.06616v1 Announce Type: new Abstract: The design of a video encoder determines when frames begin to interact and which frame-specific visual evidence remains accessible to the language model

VideoResearchAgent: Grounded Task Synthesis and Sim-to-Real RL for Open-Web Video Research

arXiv:2610.04911v1 Announce Type: cross Abstract: Existing deep research agents are designed primarily for text- and image-based web sources, while video reasoning systems typically assume that releva

What Does a Harness Repair? A Preregistered Study of Visibility, Baseline Adequacy and Evaluation Defects

arXiv:2610.05533v1 Announce Type: new Abstract: Harness search keeps a change to the prompts, reasoning switches, token budgets or parsers around a frozen model if the change raises a score. Such a ga

What Does It Cost to Simulate a Quantum Sentence Classifier? An Energy and Compute Perspective on Near-Term QNLP

arXiv:2610.06176v1 Announce Type: cross Abstract: Near-term quantum natural language processing (QNLP) experiments often run on classical simulators, so simulator cost is part of the field's practical

Adaptive Mutual Distillation for Balanced Multi-Task Post-Training of Large Language Models

arXiv:2610.02856v1 Announce Type: new Abstract: Multi-task post-training of large language models (LLMs) aims to improve performance across tasks with unequal amounts of training data. Existing method

Agents

ArrivalBench: Agent-Generated Data Pipelines Are Correct Once and Wrong Under Time

arXiv:2610.02363v1 Announce Type: new Abstract: Benchmarks for agent-generated data work grade a pipeline by running it once against a fixed snapshot. ArrivalBench instead re-executes the pipeline an

agentsarxiv-cs-lg

Behavior Pack Optimization for Video MLLM Post-Training

arXiv:2610.03141v1 Announce Type: new Abstract: Video multimodal large language models (MLLMs) keep climbing video question answering benchmarks, yet shuffling the frames, masking the segment that sup

researcharxiv-cs-cv

Beyond Random Splits: Evaluating Drug-Target Affinity Models Under Chemically and Biologically Motivated Distribution Shifts Copy

arXiv:2610.03456v1 Announce Type: new Abstract: Drug-target affinity (DTA) prediction is widely used to prioritize candidate compounds before costly experimental screening. DTA models are often compar

Characterizing the Performance Gap in Human Activity Recognition for Older Adults

arXiv:2610.02711v1 Announce Type: cross Abstract: Human activity recognition (HAR) from wrist-worn accelerometers is increasingly used for health and behavioral tracking. Yet, most wearable HAR models

Local Ai

Does Physics Live in the Activations? Localizing Physical Quantities in Video Diffusion Models

arXiv:2610.03154v1 Announce Type: new Abstract: Video generation models produce strikingly realistic sequences and are increasingly proposed as world models, yet recent benchmarks reveal pronounced de

local-aiarxiv-cs-cv

EmbPASS: Towards Cross-Embodiment Open Panoramic Segmentation

arXiv:2610.03248v1 Announce Type: new Abstract: Panoramic images provide a complete 360-degree field of view, enabling comprehensive scene understanding for embodied perception. However, heterogeneous

Enrich-on-Graph: Query-Graph Alignment for Complex Reasoning with LLM Enriching

arXiv:2509.20810v2 Announce Type: replace Abstract: Large Language Models (LLMs) exhibit strong reasoning capabilities in complex tasks. However, they still struggle with hallucinations and factual er

Evaluating and Improving the Robustness of Large Language Models to Input Sequence Variations

arXiv:2610.02432v1 Announce Type: cross Abstract: Large language models (LLMs) in production systems face prompt injections, trojans (backdoors), and manipulation of automatic quality metrics. This th

Evaluating the Retrieval Robustness of Large Language Models

arXiv:2505.21870v2 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) generally enhances large language models' (LLMs) ability to solve knowledge-intensive tasks. But RAG coul

Evaluation format, not model capability, drives measured triage failure in the assessment of consumer health AI

arXiv:2603.11413v4 Announce Type: replace-cross Abstract: A recent Nature Medicine study reported that ChatGPT Health under-triages 51.6% of emergencies and concluded that consumer-facing AI triage po

Finding the Move Is Not Winning the Game: XiangqiBench for Closed-Loop Evaluation of LLM Agents

arXiv:2610.02425v1 Announce Type: new Abstract: Static evaluations credit a language model for naming the right move, but an agent must carry a plan through to a verified outcome while an opponent res

Found but Not Read: When Extracted Text Closes the Retrieval-Reading Gap in Document Vision-Language Models

arXiv:2610.02880v1 Announce Type: new Abstract: Retrieval-augmented document question answering assumes that once the right page is found, a vision-language model (VLM) can read it. We show that this

ManiPhysicsBench: Physics-Based Assessment of Object Preservation in VLA Manipulation

arXiv:2610.02802v1 Announce Type: new Abstract: Vision-language-action (VLA) models aim to perform diverse manipulation tasks, but task success in existing rigid-body benchmarks does not indicate whet

researcharxiv-cs-ro