Search: “evaluation”

ParallelWorld: Test-Time Scaling for Embodied Reasoning

arXiv:2608.22971v1 Announce Type: new Abstract: Embodied Reasoning constitutes a fundamental capability of embodied intelligence, serving as the basis for autonomous perception, reasoning, and interac

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

PersonaMem-v3: Toward Omni-Platform Personal Intelligence for Holistic User Understanding, Recommendation, and Agentic Tasks

DGX agent

arXiv:2608.21381v1 Announce Type: cross Abstract: Personal intelligence is becoming a central frontier for user-facing AI agents. To be helpful in everyday life, agents must understand users across th

model-releasesarxiv-cs-cl

25 Aug 2026

POOL: Propagated Uncertainty Over Lookalikes

arXiv:2608.23086v1 Announce Type: new Abstract: Black-box large language models need confidence scores that can separate likely-correct from likely-incorrect outputs, enabling systems to prioritize hu

presto: Efficient, Training-free, and Open-world Object Placement via Imaginary Search

arXiv:2608.21543v1 Announce Type: cross Abstract: Object placement is critical in image composition, requiring spatially and semantically coherent positioning of objects within diverse scenes. Existin

ProBel: Propaganda Detection with Techniques, Spans, and Explanations

arXiv:2608.22388v1 Announce Type: cross Abstract: Propaganda detection includes several related prediction levels, ranging from sentence-level decisions to technique classification and span identifica

Query-Driven Multimodal Information Extraction from Long Documents

arXiv:2608.22214v1 Announce Type: new Abstract: In domain-specific multimodal long documents, images and text jointly convey complex knowledge that cannot be fully captured by plain text alone. Howeve

Redteaming Leading Arabic LLMs with ASAS

arXiv:2608.21985v1 Announce Type: new Abstract: As the adoption of large language models (LLMs) grows in Arabic-speaking regions, ensuring their safety and cultural alignment is increasingly critical.

RIBOSPAN: A Long-Context RNA Foundation Model for Versatile RNA Modeling

arXiv:2608.22849v1 Announce Type: new Abstract: Full-length RNAs, particularly messenger RNAs, often exceed the context lengths used to pretrain existing RNA foundation models, limiting complete-trans

Risk-Sensitive Reinforcement Learning with Smoothed Quantile Objectives

arXiv:2608.22227v1 Announce Type: new Abstract: Reinforcement Learning (RL) has achieved tremendous success in recent years. However, the classical foundations of RL do not account for the risk sensit

safetyarxiv-cs-lg

Robust Bimanual Vision-Language-Action Models via Embarrassingly Simple Modality Masking

arXiv:2608.22419v1 Announce Type: cross Abstract: Query-based Vision-Language-Action (VLA) models offer low-latency inference that is attractive for bimanual robotic manipulation, but we observe that

safetyarxiv-cs-cv

Runtime Action Interference for AI Control of AlphaStar in StarCraft II

arXiv:2608.21398v1 Announce Type: cross Abstract: A trained reinforcement learning policy does not determine the complete behavior that users encounter: deployment code still schedules, admits, suppre

safetyarxiv-cs-ai

SlideGen: Collaborative Multimodal Agents for Scientific Slide Generation

arXiv:2512.04529v3 Announce Type: replace Abstract: Creating presentation slides from scientific papers is not simply a matter of summarizing paragraphs. A presenter is required to decide what story t

SPAR-Hate: An Auditor-Guided Multi-Agent Framework for Bilingual Hate Speech Parsing

arXiv:2608.22018v1 Announce Type: new Abstract: Hate speech detection has recently shifted from coarse-grained classification to structured parsing, where systems must jointly identify hateful targets

Sparse Multi-Stage Expert-Agent Routing for Complex Clinical Reasoning

arXiv:2608.21948v1 Announce Type: new Abstract: Complex clinical reasoning requires models to update diagnostic hypotheses as new evidence emerges and to coordinate different medical specialities unde

agentsarxiv-cs-cv

SRMT: Shared Memory for Multi-agent Lifelong Pathfinding

arXiv:2501.13200v2 Announce Type: replace-cross Abstract: Coordination in decentralized multi-agent reinforcement learning (MARL) necessitates that agents share information about their behavior and in

SWE Refactor Bench: Can Coding Agents Complete a Long-Horizon, Whole-Repository Stack Migration?

arXiv:2608.23564v1 Announce Type: cross Abstract: Modern software systems accumulate technical debt over decades of development, which makes migration expensive and largely manual. As coding agents be

Through the Schrodinger Bridge: Benchmarking Antemortem Image Restoration from Postmortem Autolysis to Enhance Forensic Diagnostics

model-releasesarxiv-cs-cv

arXiv:2608.21813v1 Announce Type: new Abstract: Forensic histopathology, essential for determining cause of death and disease diagnosis, is severely impeded by postmortem autolysis, i.e., an irreversi

TO-Agents: A Multi-Agent AI Framework for Subjective Preference-Guided Topology Optimization

arXiv:2605.21622v2 Announce Type: replace Abstract: Topology optimization can generate efficient structures, but designers often must manually translate qualitative intent, such as desired visual styl

Token-Level Likelihood-Array Regression for Membership Inference and AI-Generated Text Detection

arXiv:2608.22179v1 Announce Type: cross Abstract: Membership inference asks whether a text was used to train a language model, whereas AI-generated text detection asks whether it was generated by a la

researcharxiv-cs-lg

UNCLE-Grasp: A Task-Adapted Framework for Uncertainty-Aware Grasping of Leaf-Occluded Strawberries

arXiv:2601.14492v3 Announce Type: replace Abstract: Robotic strawberry harvesting remains challenging under partial occlusion, where leaves obscure fruit geometry and make grasp decisions based on a s

researcharxiv-cs-ro

Local Ai

Vision-Language Models for Occupational Physical Exposure Assessment: Estimating External Hand Forces in Manual Material Handling Tasks from RGB Video

arXiv:2608.22586v1 Announce Type: cross Abstract: External hand forces are important inputs to biomechanical analyses of occupational physical exposure and injury risk, yet continuous force measuremen

local-aiarxiv-cs-ai

WADE: A Reasoning-Annotated Benchmark for Multi-Instance Floating-Waste Grounding with Compact Vision-Language Models

model-releasesarxiv-cs-cv

arXiv:2608.22950v1 Announce Type: new Abstract: Floating waste in inland waterways threatens aquatic ecosystems and requires timely monitoring under cluttered, multi-object conditions. Existing aquati

When Does AI for PDEs Yield Scientific Evidence?

arXiv:2608.22504v1 Announce Type: new Abstract: Existing AI-for-PDE benchmarks primarily assess models in terms of predictive or approximation accuracy. In physics research, however, AI outputs often

Local Ai

Where World Models Break: Natural-Input Failure Discovery

arXiv:2608.22421v1 Announce Type: new Abstract: World models predict action-conditioned futures and serve as critical internal simulators for downstream planning and control. However, catastrophic pre

local-aiarxiv-cs-ai

Why better models don’t fix every agent failure: Lessons from OpenAI

In this installment of Rise of the AI Engineer, Stuart Sy from OpenAI, explains why the bottleneck has moved off the model and onto context, evals, and observability. The post Why better models don’t

agentsarize-ai

Your AI, On a Dial: Controlling Investment Bias in LLMs with a Single Neuron

arXiv:2608.22852v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used in investment decision-making, yet prior work shows that they exhibit systematic, model-specific inve

safetyarxiv-cs-ai

A Critical Audit of Spatiotemporal Forecasting Benchmark Datasets and Baselines

arXiv:2608.20980v1 Announce Type: new Abstract: Graph neural networks (GNNs) are routinely employed for short-range forecasting on multivariate time series with a spatial graph structure. Despite the

A Deep Reinforcement Learning Framework for Closed-loop Guidance of Fish Schools via Virtual Agents

arXiv:2603.28200v2 Announce Type: replace-cross Abstract: Guiding collective motion in biological groups is a fundamental challenge in understanding social interaction rules. In this study, we propose

safetyarxiv-cs-lg

Applications

A Factorial Ablation of a Speech-to-SFT Pipeline: Differential Effects on Data Quality and Downstream Transfer

arXiv:2608.20394v1 Announce Type: cross Abstract: Industry pipelines that turn speech into supervised fine-tuning (SFT) data via multi-stage refinement are increasingly adopted but, to our knowledge,

applicationsarxiv-cs-cl

Affective Context Amplifies Sycophancy in LLM Responses

arXiv:2608.21242v1 Announce Type: new Abstract: As conversational companions, large language models (LLMs) often have access to users' emotional states. We study how this affective context modulates L

researcharxiv-cs-cl

AID-Guard: Stateful Authorization for Delegated Agent Effects

arXiv:2608.21159v1 Announce Type: cross Abstract: Tool-using AI agents turn delegated tasks into provider effects, yet authorization often ends at admission while provider state, delivery, retry, and

An integrated diffusion-weighted imaging processing and interpretation platform for MR-guided radiotherapy

arXiv:2608.20519v1 Announce Type: cross Abstract: Background: Magnetic resonance imaging-guided linear accelerators (MR-Linacs) allow diffusion-weighted imaging (DWI) to be acquired at every treatment

Asymmetric Capacity Allocation in Self-Refinement Pipelines

arXiv:2608.21345v1 Announce Type: new Abstract: Self-refinement, typically structured as generation, critique, and revision, is a widely adopted paradigm for improving LLM generation and serves as a c

Applications

Auditable by Construction: An Ontology-Driven Framework for Trustworthy LLM Analytics in Enterprise Finance

arXiv:2608.20661v1 Announce Type: new Abstract: Enterprise adoption of large language models in finance is constrained less by fluency than by trust: in Financial Planning and Analysis (FP&A) and othe

applicationsarxiv-cs-ai

BackDFL: A Unified Benchmark For Backdoor Attacks and Defenses In Decentralized Federated Learning

arXiv:2608.21137v1 Announce Type: new Abstract: Decentralized Federated Learning (DFL) promises trust-free collaborative learning by replacing the centralized parameter server with peer-to-peer model

Belief Without Behavior: Measuring the Translation of Theory of Mind into Coordinated Social Action in Vision-Language Models

arXiv:2608.20975v1 Announce Type: new Abstract: Effective social interaction requires agents to translate mental state inferences into coordinated behavioral signals across verbal and nonverbal channe

Benchmarking noisy label detection methods

arXiv:2510.16211v2 Announce Type: replace Abstract: Label noise is a common problem in real-world datasets, affecting both model training and validation. Clean data are essential for achieving strong

Beyond End-to-End Success: Diagnosing Failures in Long-Horizon Security LLM Agents

arXiv:2608.20563v1 Announce Type: cross Abstract: Long-horizon security LLM agents must carry information and decisions across many dependent interactions, where later actions often depend on services

Local Ai

Calibrating Criterion Revision in LLM Agents: Failure Modes and a Trace-Anchored Protocol

arXiv:2608.20729v1 Announce Type: new Abstract: Language-model agents can improve after failure or carry text across episodes without revising what counts as success. We study the narrower attribution

local-aiarxiv-cs-ai

Can We Trust AI Agents? A Case Study of an LLM-Based Multi-Agent System for Ethical AI

arXiv:2411.08881v3 Announce Type: replace-cross Abstract: AI-based systems, including Large Language Models (LLMs), impact millions by supporting diverse tasks but face issues like misinformation, bia

safetyarxiv-cs-ai

Tutorials

CDRL: Certification-Driven Reinforcement Learning for Neutrino Flavor Model Discovery

arXiv:2608.20686v1 Announce Type: new Abstract: Many scientific discovery problems require searching combinatorial hypothesis spaces under complex domain constraints. Reinforcement learning (RL) offer

tutorialsarxiv-cs-ai

Delay-corrected Bellman operator + causal attribution for constrained RL contraction proof under unknown stochastic delay [R]

model-releasesr-machinelearning

Standard constrained RL assumes consequences are immediate and attributable to the current action. This breaks down whenever violations are delayed and stochastic, which is most real-world settings yo

DirEAG: Dirichlet Evidence Aggregation for Calibrating Verbalized Confidence in Mathematical Reasoning

arXiv:2608.20717v1 Announce Type: new Abstract: Reliable confidence estimation is essential for using large language models in mathematical reasoning, but black-box verbalized confidence is difficult

Dorsal Hand Images for Immersive (XR) and Privacy-preserving Age Assurance and Child Safety

arXiv:2608.21009v1 Announce Type: new Abstract: Ensuring that Extended Reality (XR) environments are age-appropriate is an important regulatory and safety challenge. However, current age assurance ope

safetyarxiv-cs-cv

GeoExplain: Multimodal Reasoning based on Hierarchy of Visual Information in Street View

arXiv:2506.16633v3 Announce Type: replace-cross Abstract: Multimodal reasoning is a process of understanding, integrating and inferring information across different data modalities. It has recently at

Identify, Locate, Link: End-to-End Key-Value Extraction from Document Images

model-releasesarxiv-cs-cl

arXiv:2608.20868v1 Announce Type: cross Abstract: Document processing pipelines traditionally cascade optical character recognition (OCR) engines with downstream models for structured information extr

ImmigrationReason: A Structured Dataset of U.S. Immigration Appeals for Legal Reasoning Research

model-releasesarxiv-cs-cl

arXiv:2608.20391v1 Announce Type: new Abstract: Most legal NLP resources draw from federal case law and focus on coarse classification, leaving administrative adjudication, where the vast majority of

Inhibitory Attention for Clinical Long-Context Reasoning: Characterizing and Mitigating Lost-in-the-Middle Effects in EHR Processing

arXiv:2608.20348v1 Announce Type: cross Abstract: Electronic health records now routinely exceed 100,000 tokens per patient. Yet large language models exhibit the lost-in-the-middle (LitM) effect: inf