Search: “benchmark”

arXiv:2603.17380v3 Announce Type: replace-cross Abstract: Virtual-cell models aim to predict how cell populations respond to perturbations, but control and treated cells are measured as unpaired popul

tutorialsarxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

SDARE-Bench: Evaluating Large Language Models on Conversational Stigma Detection and Response in Dyadic and Group Dialogue

DGX agent

arXiv:2609.01548v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly used in advice seeking and decision making that may affect social judgements. Despite stigma's profound ef

model-releasesarxiv-cs-cl

2 Sept 2026

SeerGuard: A Safety Framework for Mobile GUI Agents via World Model Prediction

arXiv:2607.15550v2 Announce Type: replace Abstract: Mobile graphical user interface (GUI) agents have demonstrated remarkable capabilities in automating complex tasks, yet they introduce critical safe

safetyarxiv-cs-ai

Sierpinski--Knopp Wasserstein Distance for Persistence Diagrams and Applications to 2-Wasserstein Approximation

model-releasesarxiv-cs-lg

arXiv:2609.01528v1 Announce Type: cross Abstract: This paper introduces the Sierpinski-Knopp (SK) Wasserstein distance, a fast metric between persistence diagrams. The SK-Wasserstein distance, denoted

Superposed Latent Autoencoder

arXiv:2609.01158v1 Announce Type: cross Abstract: Autoencoders typically meet tight latent-memory budgets by making each latent representation smaller, sacrificing representational capacity. We ask a

researcharxiv-cs-ai

Towards a Belief-Based World Model for LLM Agents

arXiv:2609.00455v1 Announce Type: new Abstract: Large language models (LLMs) are being used as policies for autonomous decision-making and planning in many domains. Despite their strong reasoning capa

Towards Generalizable Visually Grounded Exploration of Household Devices

arXiv:2609.00845v1 Announce Type: new Abstract: Recent advancements in Vision-Language Models (VLMs) have demonstrated impressive capabilities in static visual recognition and high-level semantic reas

trajectory-judge: What Outcome-Only LLM Judges Miss on Agent Trajectories

arXiv:2609.00038v1 Announce Type: cross Abstract: Outcome-only evaluation is the production default for LLM agents: show a judge the request and the final reply and ask whether it was handled well. Th

safetyarxiv-cs-ai

Uncovering Understanding-Generation Synergy in Native Unified Multimodal Models: From Representation, Task to System

arXiv:2609.01607v1 Announce Type: new Abstract: While unified multimodal models (UMMs) jointly perform visual understanding and generation within a single model, functional unification does not guaran

safetyarxiv-cs-cv

A collective capability boundary in frontier large language models on guideline-conformant and case-specific oncology decision-making

arXiv:2608.28592v1 Announce Type: new Abstract: Large language models (LLMs) achieve high scores on medical knowledge examinations, yet real-world oncology is not a knowledge test--it is a sequence of

A Universal Context-Reuse Layer for Cross-Model KV Sharing

arXiv:2608.30963v1 Announce Type: cross Abstract: Modern large language model (LLM) serving systems increasingly operate over repeated or shared context, yet each model typically performs its own pref

Adversarial Calibration Attack on Autonomous Vehicles

arXiv:2608.28778v1 Announce Type: cross Abstract: Autonomous vehicles (AVs) rely on accurate camera-LiDAR calibration for multimodal sensor fusion. In practice, calibration can drift due to vibration,

An Agentic Retrobiosynthesis Framework with Learned Frontier Selection

arXiv:2608.30702v1 Announce Type: cross Abstract: Large language models are increasingly used as agents for multistep retrosynthesis, raising the question of how much their search policy contributes i

Annotated Surrogate Retrieval for Polish Statutory Law

arXiv:2608.30929v1 Announce Type: new Abstract: We present a family of retrieval methods for Polish statutory law built on document surrogates: language-model annotations attached to statutory article

APT: Atomic Physical Transitions for Causal Video-Language Understanding

arXiv:2606.18586v2 Announce Type: replace-cross Abstract: Physical events are not understood by their names alone, but by the causal state changes that compose them. A clip-level label such as 'bounce

Agents

Augmenting Human Performance with an XR Agent Learning from Online Behavior and BCI Evidence

arXiv:2608.30369v1 Announce Type: new Abstract: We present OLIVE, a framework for adapting a foundation model to provide real-time assistance in temporally demanding, high-stakes, and dynamic tasks. W

agentsarxiv-cs-ai

A.X K2 Technical Report

arXiv:2608.30181v1 Announce Type: new Abstract: We introduce A.X K2, a 688B-parameter Mixture-of-Experts (MoE) language model trained from scratch as a high-performance foundation for agentic applicat

Biomechanical 3D Body: Self-Supervised Distillation of Biomechanical Pose from a 3D Body Foundation Model

arXiv:2608.29928v1 Announce Type: new Abstract: State-of-the-art monocular body recovery methods predict mesh vertices and angles on the corresponding kinematic tree, but their outputs lack biomechani

Tutorials

CGFM-Nav: Cognitive Graph-Field Memory for Semantic-Guided Lifelong Multimodal Embodied Navigation

arXiv:2608.29114v1 Announce Type: cross Abstract: Vision-and-Language Navigation (VLN) requires agents to reason over accumulated observations while continuously exploring unseen regions. However, exi

tutorialsarxiv-cs-ai

CoCoA: Context-Conditional Cultural Alignment for Large Language Models

arXiv:2608.29492v1 Announce Type: new Abstract: Large Language Models (LLMs) often favor Western-associated entities across cultural contexts. Conventional debiasing methods aim for uniform neutrality

safetyarxiv-cs-cl

CogEvol: Towards Efficient and Reliable Learning Environment Generation

arXiv:2608.30968v1 Announce Type: cross Abstract: We present CogEvol, a family of models trained specifically for Learning Environment Generation: turning a course brief into a finished learning artif

COGTRL: Training LLMs for Scientific Discovery Assistance using Cognitive Traces via Reinforcement Learning

arXiv:2608.30109v1 Announce Type: new Abstract: Large Language Models (LLMs) trained on extensive scientific research are increasingly integrated as assistants for scientific discovery. However, most

ContextBias: Controlled Evaluation of Bias Persistence Under Context Shift in Text-to-Image Models

arXiv:2608.29847v1 Announce Type: cross Abstract: Text-to-image models learn associations between concepts - in the case of this paper, people's professions, which we refer to as roles - and visual at

DART: Draft-Agreement Routing for Training-Free Adaptive Thinking Budgets in Hybrid Reasoning Models

arXiv:2606.23181v2 Announce Type: replace Abstract: Hybrid reasoning models can answer directly or spend extra tokens on extended thinking. A practical router should choose between these modes for eac

researcharxiv-cs-ai

Demand-Side Measurement for Generative Engine Optimization: Constructing and Validating a Million-Persona, Intent-Annotated Buyer Corpus

arXiv:2608.30023v1 Announce Type: cross Abstract: Generative engines such as ChatGPT, Gemini, and Perplexity answer buyer questions directly and name a shortlist of brands inside the answer. Studying

DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editing

arXiv:2607.02290v2 Announce Type: replace Abstract: Recent image generation and editing models can produce visually appealing natural images, yet they remain unreliable when the target image is a know

researcharxiv-cs-cv

Distributional Validity and Calibration of a Korean Synthetic Persona Panel for Digital and AI Service Use: A Secondary-Data Validation Against the Korea Media Panel Survey

arXiv:2608.28615v1 Announce Type: cross Abstract: Synthetic personas based on large language models (LLMs) are increasingly proposed as substitutes for human survey respondents, yet systematic validat

Does Latent Planning Survive Point Clouds? Action-Conditioned JEPA World Models for Geometric Observations

arXiv:2608.29434v1 Announce Type: cross Abstract: JEPA world models make latent-space planning a practical route to control, but they are built almost exclusively on images. Whether latent prediction

Evaluating LLMs on Conversational Text-to-SQL under Chain Ambiguity and Intent Drift

arXiv:2608.29543v1 Announce Type: cross Abstract: Recent advances in large language models (LLMs) have established conversational text-to-SQL as a practical interface between users and databases, ofte

Facts Without Rules: Boundary Metadata Collapse in Multi-Agent LLM Handoffs

arXiv:2608.29028v1 Announce Type: new Abstract: Multi-agent LLM systems often coordinate by compressing an upstream interaction into a handoff artifact that downstream agents treat as shared state. We

FoundYou: A Unified Model for Personalized Segmentation and Retrieval

arXiv:2608.29917v1 Announce Type: new Abstract: Personalized segmentation and personalized retrieval both aim to identify the same physical object across different images. While the former localizes t

Applications

Free Speech and Artificial Intelligence

arXiv:2608.28973v1 Announce Type: cross Abstract: Philosophers and legal scholars are engaged in debates about the implications of artificial intelligence for freedom of expression. This paper analyze

applicationsarxiv-cs-ai

From Speech to Subtitles: Evaluating ASR Models in Subtitling Italian Television Programs

arXiv:2512.19161v2 Announce Type: replace Abstract: Subtitles are essential for video accessibility and audience engagement. Modern Automatic Speech Recognition (ASR) systems, built upon Encoder-Decod

GridFlow: Structured Latent Flow for Seamless City-Scale 3D Point Cloud Generation

arXiv:2608.29793v1 Announce Type: new Abstract: Generating realistic 3D city environments from remote sensing data is important for simulation, urban planning, and mixed reality, yet existing point cl

GUIDE: Guiding Internal Evidence with Language Instructions

arXiv:2608.30712v1 Announce Type: new Abstract: Large multimodal models follow instructions about what to generate, but not necessarily about what evidence to rely on. Hence, models may continue to de

Hi-Q: Hierarchical Evidence-guided Query Refinement for Multi-Hop Question Answering

arXiv:2608.30468v1 Announce Type: new Abstract: A central bottleneck in multi-hop Question Answering (QA) is that the granularity at which a question is expressed often differs from the granularity at

researcharxiv-cs-cl

ImageEval 2026: Culturally Grounded Arabic Multimodal Evaluation

arXiv:2608.30475v1 Announce Type: cross Abstract: We present an overview of the ImageEval 2026 shared task on culturally grounded Arabic multimodal evaluation. It includes two tasks: (i) AynVQA, cover

Agents

Last Step Matters: Early Uncertainty Cannot Predict Failure in Long-Horizon Agents

arXiv:2608.29685v1 Announce Type: new Abstract: Early failure prediction is important for long-horizon agents, as it enables timely intervention and can reduce inference and tool-use costs. Uncertaint

agentsarxiv-cs-lg

Latency-Response Theory Model: Evaluating Large Language Models via Response Accuracy and Chain-of-Thought Length

arXiv:2512.07019v4 Announce Type: replace-cross Abstract: The proliferation of Large Language Models (LLMs) necessitates valid evaluation methods to provide guidance for both downstream applications a

Lazy Grounding: Attacking Search Agents with Factual Evidence

arXiv:2608.30303v1 Announce Type: new Abstract: Search agents reduce hallucination by grounding answers in retrieved web evidence. Yet reliance on retrieval also creates an attack surface: poisoned co

Learning to Evaluate Before Improving: Automatic Rubric Induction for Automatic Research Agents

arXiv:2608.31076v1 Announce Type: cross Abstract: Autonomous scientific research agents are increasingly applied to end-to-end scientific workflows, including literature review, data analysis, experim

LLM Judges as Raters: A Pre-Registered Audit of Severity, Halo, Reliability, and Version Instability in LLM Essay Scoring on Public Corpora

arXiv:2608.29517v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as essay graders in learning analytics, evaluated almost exclusively with agreement statistics. Educa

Lot Machine: Multimodal Lot Extraction from Auction Catalogs

arXiv:2608.30510v1 Announce Type: cross Abstract: For provenance research and art market studies, auction catalogs are an essential resource to trace specific objects over time and space. While histor

Mamba-Assisted Non-Markovian Closure for Reduced-Order Modeling

model-releasesarxiv-cs-lg

arXiv:2606.05371v2 Announce Type: replace Abstract: Reduced-order modeling of high-dimensional dynamical systems is often hindered by closure effects arising from unresolved variables, which can intro

Mamba-driven MRI-to-CT Synthesis for MRI-only Radiotherapy Planning

arXiv:2603.23295v2 Announce Type: replace Abstract: Radiotherapy workflows for oncological patients increasingly rely on multi-modal medical imaging, commonly involving both Magnetic Resonance Imaging

MariSat: A Maritime Dataset for Instance Segmentation of Objects in Satellite and Aerial Images

arXiv:2608.29852v1 Announce Type: new Abstract: Automated maritime surveillance from satellite and aerial imagery requires large, precisely annotated datasets, which remain scarce for the instance-seg

MedCache: Efficient and Temporally Valid Memory for Longitudinal Clinical Agents

model-releasesarxiv-cs-lg

arXiv:2608.29528v1 Announce Type: new Abstract: Longitudinal clinical agents must maintain an evolving patient state from evidence distributed across visits, time points, and specialties. However, how

Modality Fault Lines: Structural Corruptions Reveal Fragile Omni-Modal Reasoning

arXiv:2608.29278v1 Announce Type: new Abstract: Omni-modal large language models are increasingly evaluated on clean text--vision--audio inputs, where every channel is present, synchronized, and readi

researcharxiv-cs-cl