Search: “evaluation”

LLMs Know When They Know, but Do Not Act on It: A Metacognitive Harness for Test-time Scaling

arXiv:2605.14186v1 Announce Type: new Abstract: Large language models (LLMs) often expose useful signals of self-monitoring: before solving a problem, they can estimate whether they are likely to succ

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Measuring and Mitigating Toxicity in Large Language Models: A Comprehensive Replication Study

DGX agent

arXiv:2605.14087v1 Announce Type: new Abstract: Large Language Models (LLMs), when trained on web-scale corpora, inherently absorb toxic patterns from their training data. This leads to ``toxic degene

safetyarxiv-cs-cl

15 May 2026

Mechanical Enforcement for LLM Governance:Evidence of Governance-Task Decoupling in Financial Decision Systems

arXiv:2605.14744v1 Announce Type: cross Abstract: Large language models in regulated financial workflows are governed by natural-language policies that the same model interprets, creating a principal-

ML-Embed: Inclusive and Efficient Embeddings for a Multilingual World

arXiv:2605.15081v1 Announce Type: cross Abstract: The development of high-quality text embeddings is increasingly drifting toward an exclusionary future, defined by three critical barriers: prohibitiv

MMTutorBench: The First Multimodal Benchmark for AI Math Tutoring

model-releasesarxiv-cs-cl

arXiv:2510.23477v2 Announce Type: replace Abstract: Effective math tutoring requires not only solving problems but also diagnosing students' difficulties and guiding them step by step. While multimoda

Monitoring Data-aware Temporal Properties (Extended Version)

arXiv:2605.14666v1 Announce Type: new Abstract: Dynamic systems in AI are often complex and heterogeneous, so that an internal specification is not accessible and verification techniques such as model

Network-Aware Bilinear Tokenization for Brain Functional Connectivity Representation Learning

arXiv:2605.14048v1 Announce Type: new Abstract: Masked autoencoders (MAEs) have recently shown promise for self-supervised representation learning of resting-state brain functional connectivity (FC).

Neural Signals Generate Clinical Notes in the Wild

arXiv:2601.22197v3 Announce Type: replace-cross Abstract: Generating clinical reports that summarize abnormal patterns, diagnostic findings, and clinical interpretations from long-term EEG recordings

On the Cultural Anachronism and Temporal Reasoning in Vision Language Models

arXiv:2605.15071v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) are increasingly applied to cultural heritage materials, from digital archives to educational platforms. This work ident

OneSearch-V2: The Latent Reasoning Enhanced Self-distillation Generative Search Framework

arXiv:2603.24422v2 Announce Type: replace-cross Abstract: Generative Retrieval (GR) has emerged as a promising paradigm for modern search systems. Compared to multi-stage cascaded architecture, it off

Orchard: An Open-Source Agentic Modeling Framework

arXiv:2605.15040v1 Announce Type: new Abstract: Agentic modeling aims to transform LLMs into autonomous agents capable of solving complex tasks through planning, reasoning, tool use, and multi-turn in

agentsarxiv-cs-ai

PaAno: Patch-Based Representation Learning for Time-Series Anomaly Detection

arXiv:2602.01359v2 Announce Type: replace-cross Abstract: Although recent studies on time-series anomaly detection have increasingly adopted ever-larger neural network architectures such as transforme

PEML: Parameter-efficient Multi-Task Learning with Optimized Continuous Prompts

arXiv:2605.14055v1 Announce Type: cross Abstract: Parameter-Efficient Fine-Tuning (PEFT) is widely used for adapting Large Language Models (LLMs) for various tasks. Recently, there has been an increas

PolitNuggets: Benchmarking Agentic Discovery of Long-Tail Political Facts

arXiv:2605.14002v1 Announce Type: new Abstract: Large Reasoning Models (LRMs) embedded in agentic frameworks have transformed information retrieval from static, long context question answering into op

RAM-W600: A Multi-Task Wrist Dataset and Benchmark for Rheumatoid Arthritis

model-releasesarxiv-cs-cv

arXiv:2507.05193v4 Announce Type: replace-cross Abstract: Rheumatoid arthritis (RA) is a common autoimmune disease that has been the focus of research in computer-aided diagnosis (CAD) and disease mon

Rethinking Molecular OOD Generalization via Target-Aware Source Selection

arXiv:2605.13932v1 Announce Type: new Abstract: Robust prediction of molecular properties under extreme out-of-distribution (OOD) scenarios is a pivotal bottleneck in AI-driven drug discovery. Current

Safe Bayesian Optimization for Complex Control Systems via Additive Gaussian Processes

arXiv:2408.16307v3 Announce Type: replace-cross Abstract: Automatic controller tuning is attractive for robotics and mechatronic systems whose dynamics are difficult to model accurately, but direct bl

SciPaths: Forecasting Pathways to Scientific Discovery

model-releasesarxiv-cs-cl

arXiv:2605.14600v1 Announce Type: new Abstract: Scientific progress depends on sequences of enabling contributions, yet existing AI4Science benchmarks largely focus on citation prediction, literature

Talk is (Not) Cheap: A Taxonomy and Benchmark Coverage Audit for LLM Attacks

model-releasesarxiv-cs-cl

arXiv:2605.15118v1 Announce Type: cross Abstract: We introduce a reusable framework for auditing whether LLM attack benchmarks collectively cover the threat surface: a 4imes6 Target imes Technique mat

Temporal Fair Division in Multi-Agent Systems: From Precise Alternation Metrics to Scalable Coordination Proxies

arXiv:2605.14879v1 Announce Type: cross Abstract: A plethora real-world environments require agents to compete repeatedly for the same limited resource, calling for a temporal notion of fairness judge

safetyarxiv-cs-lg

Text Knows What, Tables Know When: Clinical Timeline Reconstruction via Retrieval-Augmented Multimodal Alignment

arXiv:2605.15168v1 Announce Type: cross Abstract: Reconstructing precise clinical timelines is essential for modeling patient trajectories and forecasting risk in complex, heterogeneous conditions lik

Vendor-Conditioned Contrastive Learning for Predicting Organizational Cyber Threat Targets

arXiv:2012.14425v2 Announce Type: replace-cross Abstract: Cyberattacks cause billions of dollars in damage annually, with malicious hackers often sharing exploit code and techniques on underground for

Applications

What if Tomorrow is the World Cup Final? Counterfactual Time Series Forecasting with Textual Conditions

arXiv:2605.14422v1 Announce Type: new Abstract: Time series forecasting has become increasingly critical in real-world scenarios, where future sequences are influenced not only by historical patterns

applicationsarxiv-cs-lg

Adaptive mine planning under geological uncertainty: A POMDP framework for sequential decision-making

arXiv:2605.13702v1 Announce Type: new Abstract: Strategic mine production scheduling under geological uncertainty is conventionally formulated as a stochastic optimization problem in which a fixed ext

Addressing Finite-Horizon MDPs via Low-Rank Tensor Value Approximation

arXiv:2501.10598v3 Announce Type: replace Abstract: We study the problem of learning optimal policies in finite-horizon Markov Decision Processes (MDPs) using low-rank reinforcement learning (RL) meth

safetyarxiv-cs-lg

An Agentic LLM-Based Framework for Population-Scale Mental Health Screening

arXiv:2605.13046v1 Announce Type: new Abstract: Mental health disorders affect millions worldwide, and healthcare systems are increasingly overwhelmed by the volume of clinical data generated from ele

agentsarxiv-cs-ai

Are Compact Rationales Free? Measuring Tile Selection Headroom in Frozen WSI-MIL

arXiv:2605.12575v1 Announce Type: cross Abstract: Whole-slide image (WSI) multiple instance learning (MIL) classifiers can achieve strong slide-level AUC while leaving the full-bag prediction opaque.

Automated alignment is harder than you think

arXiv:2605.06390v2 Announce Type: replace Abstract: A leading proposal for aligning artificial superintelligence (ASI) is to use AI agents to automate an increasing fraction of alignment research as c

Benchmarking Attribute Discrimination in Infant-Scale Vision-Language Models

arXiv:2512.18951v3 Announce Type: replace Abstract: Infants learn not only object categories but also fine-grained visual attributes such as color, size, and texture from limited experience. Prior inf

Local Ai

BlockVLA: Accelerating Autoregressive VLA via Block Diffusion Finetuning

arXiv:2605.13382v1 Announce Type: new Abstract: While autoregressive (AR) Vision-Language-Action (VLA) models have demonstrated formidable reasoning capabilities in robotic tasks, their sequential dec

local-aiarxiv-cs-ro

Local Ai

CANTANTE: Optimizing Agentic Systems via Contrastive Credit Attribution

arXiv:2605.13295v1 Announce Type: cross Abstract: LLM-based multi-agent systems have demonstrated strong performance across complex real-world tasks, such as software engineering, predictive modeling,

local-aiarxiv-cs-ai

Children's English Reading Story Generation via Supervised Fine-Tuning of Compact LLMs with Controllable Difficulty and Safety

arXiv:2605.13709v1 Announce Type: cross Abstract: Large Language Models (LLMs) are widely applied in educational practices, such as for generating children's stories. However, the generated stories ar

Continual Learning with Multilingual Foundation Model

arXiv:2605.13415v1 Announce Type: cross Abstract: This paper presents a multi-stage framework for detecting reclaimed slurs in multilingual social media discourse. It addresses the challenge of identi

Do Activation Verbalization Methods Convey Privileged Information?

arXiv:2509.13316v4 Announce Type: replace-cross Abstract: Recent interpretability methods have proposed to translate LLM internal representations into natural language descriptions using a second verb

researcharxiv-cs-lg

DocAtlas: Multilingual Document Understanding Across 80+ Languages

model-releasesarxiv-cs-cv

arXiv:2605.12623v1 Announce Type: cross Abstract: Multilingual document understanding remains limited for low-resource languages due to scarce training data and model-based annotation pipelines that p

Domain Adaptation of Large Language Models for Polymer-Composite Additive Manufacturing Using Retrieval-Augmented Generation and Fine-Tuning

arXiv:2605.12516v1 Announce Type: cross Abstract: General-purpose large language models (LLMs) often struggle to generate reliable responses in specialized engineering domains due to limited domain gr

Driving Intents Amplify Planning-Oriented Reinforcement Learning

arXiv:2605.12625v1 Announce Type: cross Abstract: Continuous-action policies trained on a single demonstrated trajectory per scene suffer from mode collapse: samples cluster around the demonstrated ma

safetyarxiv-cs-cv

Ego2World: Compiling Egocentric Cooking Videos into Executable Worlds for Belief-State Planning

arXiv:2605.13335v1 Announce Type: new Abstract: Embodied agents in household environments must plan under partial observation: they need to remember objects, track state changes, and recover when acti

Emotional Expression in Low-Degrees-of-Freedom Robots: Assessing Perception with Reachy Mini

model-releasesarxiv-cs-ro

arXiv:2605.12786v1 Announce Type: new Abstract: Emotion expression is central to human--robot interaction, yet little is known about how people interpret affect on robots with sparse, non-anthropomorp

FIKA-Bench: From Fine-grained Recognition to Fine-Grained Knowledge Acquisition

arXiv:2605.13193v1 Announce Type: new Abstract: Fine-grained recognition in everyday life is often not a closed-book classification problem: when encountering unfamiliar objects, humans actively searc

agentsarxiv-cs-cv

Follow-Bench: A Unified Motion Planning Benchmark for Socially-Aware Robot Person Following

model-releasesarxiv-cs-ro

arXiv:2509.10796v4 Announce Type: replace Abstract: Robot person following (RPF) -- mobile robots that follow and assist a specific person -- has emerging applications in personal assistance, security

From Instance Selection to Fixed-Pool Data Recipe Search for Supervised Fine-Tuning

arXiv:2605.12944v1 Announce Type: new Abstract: Supervised fine-tuning (SFT) data selection is commonly formulated as instance ranking: score each example and retain a top-k subset. However, effective

researcharxiv-cs-lg

Generating synthetic computed tomography for radiotherapy: SynthRAD2025 challenge report

arXiv:2605.13555v1 Announce Type: cross Abstract: Radiation therapy (RT) requires precise dose delivery over multiple fractions, with CT fundamental for treatment planning due to its electron density

Graph-Based Financial Fraud Detection with Calibrated Risk Scoring and Structural Regularization

arXiv:2605.12782v1 Announce Type: new Abstract: Financial transaction fraud prevention faces challenges such as complex relationship structures, concealed behavioral patterns, and dynamically changing

safetyarxiv-cs-lg

GraphIP-Bench: How Hard Is It to Steal a Graph Neural Network, and Can We Stop It?

arXiv:2605.12827v1 Announce Type: cross Abstract: Graph neural networks (GNNs) deployed as cloud services can be stolen through model-extraction attacks, which train a surrogate from query responses t

Harnessing Agentic Evolution

arXiv:2605.13821v1 Announce Type: new Abstract: Agentic evolution has emerged as a powerful paradigm for improving programs, workflows, and scientific solutions by iteratively generating candidates, e

agentsarxiv-cs-ai

ImageAttributionBench: How Far Are We from Generalizable Attribution?

model-releasesarxiv-cs-cv

arXiv:2605.12967v1 Announce Type: new Abstract: The rapid advancement of generative AI has enabled the creation of highly realistic and diverse synthetic images, posing critical challenges for image p

IndicMedDialog: A Parallel Multi-Turn Medical Dialogue Dataset for Accessible Healthcare in Indic Languages

arXiv:2605.13292v1 Announce Type: cross Abstract: Most existing medical dialogue systems operate in a single-turn question--answering paradigm or rely on template-based datasets, limiting conversation