Search: “benchmark”

RetiSEM: Generalising Causal Models for Fragmented Biomedical Data

arXiv:2606.24488v1 Announce Type: cross Abstract: Learning causal models from fragmented biomedical data is challenging because clinical, molecular, and imaging variables are often incomplete or not j

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Reward-Centered ReST-MCTS: A Robust Decision-Making Framework for Robotic Manipulation in High Uncertainty Environments

DGX agent

arXiv:2503.05226v2 Announce Type: replace-cross Abstract: Monte Carlo tree search is attractive for robotic manipulation because it can improve action selection through simulation without requiring a

model-releasesarxiv-cs-ai

24 Jun 2026

To Compare, or Not to Compare: On Methodological Practices in Evaluating Social Bias

model-releasesarxiv-cs-cl

arXiv:2606.24596v1 Announce Type: new Abstract: As Large Language Models are increasingly deployed in critical applications, robustly evaluating their social biases is paramount. However, the current

Trimming the Long-Tail of Visual World Modeling Evaluation

arXiv:2606.24256v1 Announce Type: new Abstract: Physical interactions follow a long-tailed distribution: a set of common and regular interactions dominates human experience and visual data, while a br

VeriPilot: An LLM-Powered Verilog Debugging Framework

arXiv:2606.23759v1 Announce Type: cross Abstract: Verilog debugging remains one of the most time-consuming stages in digital circuit design. Recent advances in Large Language Models (LLMs) have enable

VisCritic: Visual State Comparison as Process Reward for GUI Agents

arXiv:2606.24525v1 Announce Type: new Abstract: GUI agents powered by vision-language models show strong potential for automating digital tasks, yet frequently fail in long-horizon scenarios due to th

We've provided some updated results on Mistral OCR that make use of the annotation feature for charts. The overall score is ahead of GPT-5.5…

model-releasesjerry-liu--x

We've provided some updated results on Mistral OCR that make use of the annotation feature for charts. The overall score is ahead of GPT-5.5 and just behind Gemini 3.1 Pro, which is quite impressive f

Research

What's Missing in Vision-Language Models? Probing Their Struggles with Causal Order Reasoning

arXiv:2506.00869v3 Announce Type: replace Abstract: Despite the impressive performance of vision-language models (VLMs) on downstream tasks, their ability to understand and reason about causal relatio

researcharxiv-cs-cl

When Retrieval Metrics Mislead: Measuring Policy Signal in Long-Horizon Tool-Use Agents

arXiv:2606.23937v1 Announce Type: cross Abstract: Exact-match retrieval recall is often used as a proxy for whether a retriever supplies useful policy context to a downstream decision model. We test t

World Value Models for Robotic Manipulation

model-releasesarxiv-cs-ro

arXiv:2606.24742v1 Announce Type: new Abstract: Generalist value models play a pivotal role in scaling robotic policy learning from large-scale, mixed-quality data. Mathematically, accurate value esti

AgentMisalignment: Measuring the Propensity for Misaligned Behaviour in LLM-Based Agents

arXiv:2506.04018v3 Announce Type: replace-cross Abstract: As Large Language Model (LLM) agents become more widespread, associated misalignment risks increase. While prior research has studied agents'

BELDE: Building a Large-scale Earth-observation Land-cover Dataset for Europe

arXiv:2606.20909v1 Announce Type: new Abstract: Earth observation imagery plays a critical role in environmental monitoring, urban planning, disaster assessment, and climate analysis. While multi-spec

Beyond the LUMIR challenge: The pathway to foundational registration models

arXiv:2505.24160v3 Announce Type: replace-cross Abstract: Medical image challenges have played a transformative role in advancing the field, catalyzing innovation and establishing new performance benc

CAOA -- Completion-Assisted Object-CAD Alignment

arXiv:2606.18429v2 Announce Type: replace Abstract: Accurately aligning CAD models to their corresponding objects in indoor RGB-D scans is a central challenge in 3D semantic reconstruction. The task r

Cluster-Specific Localized Drift Detection for Efficient Batch Model Adaptation under Controlled Distribution Shift

arXiv:2606.22026v1 Announce Type: new Abstract: Machine learning systems deployed in dynamic environments frequently operate under nonstationary data distributions, where controlled distribution shift

CodePercept: Code-Grounded Visual STEM Perception for MLLMs

arXiv:2603.10757v2 Announce Type: replace Abstract: When MLLMs fail at Science, Technology, Engineering, and Mathematics (STEM) visual reasoning, a fundamental question arises: is it due to perceptual

Counsel: A Meta-Evaluation Dataset for Agentic Tasks

arXiv:2606.21627v1 Announce Type: cross Abstract: As agentic systems tackle increasingly complex multi-step tasks, evaluating their trajectories presents a major bottleneck - human annotation of a sin

safetyarxiv-cs-lg

Early-Exit Graph Neural Networks for Link Prediction

arXiv:2606.22167v1 Announce Type: new Abstract: Graph Neural Networks are great for link prediction in various network-like structures; however, the question of their speed/quality tradeoff has been b

ENVS: Environment-Native Verified Search for Long-Horizon GUI Agents

arXiv:2606.22948v1 Announce Type: cross Abstract: As multimodal agents move from interface understanding to real software control, successful trajectory discovery in live desktop environments becomes

From Point Estimates to Distributions: GMM Pooling for MIL in Preterm Birth Prediction

arXiv:2606.23005v1 Announce Type: new Abstract: Preterm birth (PTB) prediction can enable targeted surveillance and timely intervention, yet most ultrasound-based models use a single selected transvag

GeoFidelity-Bench: Evaluating Segment-Level Geographic Fidelity in Text-to-Image Street-View Generation

arXiv:2606.23669v1 Announce Type: new Abstract: Text-to-image models can generate visually plausible city streets, but whether their outputs correspond to a requested road segment rather than a generi

GeoTransolver: Learning Physics on Irregular Domains Using Multi-scale Geometry Aware Physics Attention Transformer

arXiv:2512.20399v3 Announce Type: replace Abstract: We present GeoTransolver, a multiscale geometry-aware physics attention transformer for Computer Aided Engineering (CAE). GeoTransolver extends the

Mat-Pref: Verifiable-Reward Training Improves Compositional Reasoning in Inorganic Materials

arXiv:2606.21830v1 Announce Type: new Abstract: Reinforcement learning from verifiable rewards (RLVR) has driven rapid progress in mathematical and code reasoning, but when extended to science, existi

MORL-A2C: Multi-Objective Reinforcement Learning Reranker for Optimizing Healthiness in MOPI-HFRS

arXiv:2606.23603v1 Announce Type: new Abstract: Unhealthy dietary behavior continues to be a persistent public health issue in the United States, exacerbated by recommendation systems that prioritize

Nous: A Predictive World Model for Long-Term Agent Memory

arXiv:2606.22030v1 Announce Type: cross Abstract: We present Nous, a novel agent memory architecture grounded in the principle that knowledge is prediction, not storage. Rather than persisting facts a

Physics-Guided Dual-Stream Heterogeneous Graph Neural Network for Predicting Full-Field Structural Response of Stiffened Panels

arXiv:2606.20916v1 Announce Type: new Abstract: Iterative design and optimization of large, complex structures require fast and accurate prediction of stress, displacement, and other fields. Finite el

Research

Prompting Diffusion Models for Zero-Shot Instance Segmentation

arXiv:2606.22660v1 Announce Type: new Abstract: Several disruptive research directions have recently emerged in computer vision, including foundation models achieving previously unseen zero-shot perfo

researcharxiv-cs-cv

Revealing the Pitfalls and Re-Evaluating the Advancement of Heterophilic Graph Learning

arXiv:2409.05755v3 Announce Type: replace Abstract: Over the past decade, Graph Neural Networks (GNNs) have achieved great success on machine learning tasks with relational data. However, recent studi

RouteJudge: An Open Platform for Reproducible and Preference-Aware LLM Routing

arXiv:2606.18774v2 Announce Type: replace Abstract: We present RouteJudge, an online pairwise preference evaluation framework for LLM routing systems, with a public platform available at https://route

RoverDevKit: An open, physics-grounded tradespace toolkit for conceptual design of lunar micro-rovers

model-releasesarxiv-cs-ro

arXiv:2606.21755v1 Announce Type: new Abstract: Pre-Phase-A design of lunar micro-rovers is dominated by tightly coupled mobility, power, thermal, and mass trades, yet conceptual-design tooling for th

Local Ai

SARIF: Segment Anything for Robust Image Forensics

arXiv:2606.21108v1 Announce Type: new Abstract: Image forgery localization remains challenging due to diverse manipulation techniques and distribution shifts. Existing forgery localization models achi

local-aiarxiv-cs-cv

SATURN: Symbolic Spatial Reasoning for Multi-Perspective Grounding

arXiv:2606.22694v1 Announce Type: new Abstract: Vision-Language Models (VLMs) remain unreliable when spatial reasoning requires composing relations whose meanings depend on frames of reference. Existi

SingGuard: A Policy-Adaptive Multimodal LLM Guardrail with Dynamic Reasoning

arXiv:2606.22873v1 Announce Type: new Abstract: Vision-language models (VLMs) are increasingly deployed in consumer, medical, financial, and enterprise applications. This broad deployment expands the

Skill Coverage: A Test Adequacy Metric for Agent Skills

arXiv:2606.20659v1 Announce Type: cross Abstract: Agent skills encode reusable procedural knowledge that guides large language model agents across tasks and execution contexts. Existing evaluations pr

Specialize Roles, Mix Deployments: Pushing the Cost-Accuracy Frontier of LLM Agent Teams

arXiv:2606.20629v1 Announce Type: cross Abstract: LLM agents are increasingly deployed as multi-role teams, where tasks are divided across specialized roles such as planner, executor, and verifier. In

Applications

UniFFBench: Evaluating Universal Machine Learning Force Fields Against Experimental Measurements

arXiv:2508.05762v3 Announce Type: replace-cross Abstract: Universal machine learning force fields (UMLFFs) promise to revolutionize materials science by enabling rapid atomistic simulations across the

applicationsarxiv-cs-lg

Agents

UniviewVLA: A Unified Multiview Vision-Language-Action Model with World Modeling

arXiv:2606.21501v1 Announce Type: new Abstract: Occluded tasks remain a bottleneck in robot manipulation. Existing solutions either deploy additional physical cameras requiring training-inference came

agentsarxiv-cs-ro

VQActFlow: Vector-Quantized Action Mode Steering for Multi-Task Robot Manipulation

arXiv:2606.21600v1 Announce Type: new Abstract: Multi-task robot manipulation policies are challenging to learn from demonstration because traditionally a single network must select among qualitativel

safetyarxiv-cs-ro

4DP-QA: Scalable QA for 4D Perception in Vision Language Models

arXiv:2606.11568v1 Announce Type: new Abstract: Despite recent advances, Vision Language Models (VLMs) still struggle to grasp the dynamics of the world. We note that the ability to reason about a 4D

A Survey of Reasoning and Agentic Systems in Time Series with Large Language Models

arXiv:2509.11575v3 Announce Type: replace Abstract: Time series reasoning treats time as a first-class axis and incorporates intermediate evidence directly into the answer. This survey defines the pro

safetyarxiv-cs-ai

APEX: Automated Prompt Engineering eXpert with Dynamic Data Selection

arXiv:2606.11459v1 Announce Type: cross Abstract: Large Language Models are highly sensitive to prompt formulation, necessitating automatic prompt optimization to unlock their full potential. While ev

Atlas H&E-TME: Scalable AI-Based Tissue Profiling at Expert Pathologist-Level Accuracy

arXiv:2606.12346v1 Announce Type: cross Abstract: Hematoxylin and eosin (H&E) staining is the cornerstone of histopathology, yet scalable, quantitative analysis of H&E whole-slide images (WSIs) remain

Can AI Agents Synthesize Scientific Conclusions?

arXiv:2606.11337v1 Announce Type: new Abstract: Scientific AI agents increasingly retrieve evidence, reason across sources, and synthesize conclusions used in consequential decisions. Yet, their abili

CoVR-R:Reason-Aware Composed Video Retrieval

arXiv:2603.20190v2 Announce Type: replace Abstract: Composed Video Retrieval (CoVR) aims to find a target video given a reference video and a textual modification. Prior work assumes the modification

Debiasing Without Protected Attributes: Latent Concept Erasure from Textual Profiles

model-releasesarxiv-cs-cl

arXiv:2606.12088v1 Announce Type: new Abstract: Most fairness research in NLP assumes direct access to protected attributes such as gender, race, or nationality. In practice, however, such information

Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models

arXiv:2606.11324v1 Announce Type: cross Abstract: We introduce Embodied-R1.5, a unified Embodied Foundation Model (EFM) that integrates comprehensive embodied reasoning capabilities, spanning embodied

Fine-tuning Multi-modal LLMs with ART: Art-based Reinforcement Training

arXiv:2606.11854v1 Announce Type: cross Abstract: There are two main Parameter-Efficient Fine-Tuning (PEFT) techniques for Large Language Models (LLMs). While Low-Rank Adaptation (LoRA) introduces add

Fourier Features Let Agents Learn High Precision Policies with Imitation Learning

arXiv:2606.12334v1 Announce Type: new Abstract: High-precision robotic manipulation requires fine-grained spatial reasoning that is often difficult to achieve with RGB-only policies due to depth ambig

safetyarxiv-cs-lg