Search: “evaluation”

SkillEvolBench: Benchmarking the Evolution from Episodic Experience to Procedural Skills

arXiv:2605.24117v1 Announce Type: new Abstract: Large language model (LLM) agents accumulate rich episodic trajectories while solving real-world tasks, but it remains unclear whether such experience c

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

SLAP: Stratified Loss-based Pruning for On-Policy Data-Efficient Instruction Tuning

DGX agent

arXiv:2605.23969v1 Announce Type: new Abstract: Instruction tuning has optimized the specialized capabilities of large language models (LLMs), but it often requires extensive datasets and prolonged tr

model-releasesarxiv-cs-cl

26 May 2026

SliceWorld: A Predictive and Controllable World-State Model for CT Report Generation

arXiv:2605.24371v1 Announce Type: cross Abstract: CT report generation (CTRG) requires models to summarize three-dimensional anatomical context and pathological findings from hundreds of axial slices.

safetyarxiv-cs-cl

Tutorials

Small Ensemble-based Data Assimilation: A Machine Learning-Enhanced Data Assimilation Method with Limited Ensemble Size

arXiv:2510.15284v2 Announce Type: replace Abstract: Ensemble-based data assimilation (DA) methods have become increasingly popular due to their inherent ability to address nonlinear dynamic problems.

tutorialsarxiv-cs-lg

Smart Timing for Mining: A Deep Learning Framework for Bitcoin Hardware ROI Prediction

arXiv:2512.05402v2 Announce Type: replace-cross Abstract: Bitcoin mining hardware acquisition requires strategic timing due to volatile markets, rapid technological obsolescence, and protocol-driven r

SoK: A Comprehensive Security Analysis of Jailbreak Resilience in GPT and DeepSeek Models

arXiv:2506.18543v2 Announce Type: replace-cross Abstract: The rapid proliferation of Large Language Models (LLMs) has heightened concerns regarding their exposure to jailbreak attacks, which craft adv

Spiking the training data to correct for test set contamination

arXiv:2605.24818v1 Announce Type: cross Abstract: The literature on test set contamination largely focuses on detection, but the correction of contaminated test scores is underexplored. Our core propo

Split-Merge: A Difference-based Approach for Dominant Eigenvalue Problem

model-releasesarxiv-cs-lg

arXiv:2501.15131v3 Announce Type: replace-cross Abstract: The computation of the dominant eigenpair for symmetric positive semidefinite matrices is fundamental in numerical optimization. This work shi

STaT: Resolving Shape Distortion in Non-Stationary Time Series via Tri-Modal Synergy

arXiv:2605.25943v1 Announce Type: new Abstract: Recent research in time series forecasting frequently investigates the integration of textual and visual modalities with numerical models to better navi

safetyarxiv-cs-lg

StructBreak: Structural Cognitive Overload-Induced Safety Failures in MLLMs

arXiv:2605.25534v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) excel at structural reasoning yet suffer from a sharp logical brittleness in structural consistency. We term th

SURGE: On the Potential of Large Language Models as General-Purpose Surrogate Code Executors

model-releasesarxiv-cs-cl

arXiv:2502.11167v5 Announce Type: replace-cross Abstract: Neural surrogate models are powerful and efficient tools in data mining. Meanwhile, large language models (LLMs) have demonstrated remarkable

Synheart Capacity: A Theory-Driven Physiological Representation of Cognitive Capacity Dynamics from Wearable Signals

arXiv:2605.24416v1 Announce Type: new Abstract: Human cognitive performance is constrained by limited mental resources, yet continuous computational estimation of cognitive capacity dynamics remains a

T2S-MPC: Time-Embedded Online Adaptive Model Predictive Control for Time-Varying Dynamics

arXiv:2605.24852v1 Announce Type: new Abstract: Recent advances in learning-based model predictive control (MPC) have leveraged neural networks for online model learning, achieving strong performance

Task-Aligned Self-Supervised Learning for Medical Image Analysis: A Systematic Review and Practical Design Guidelines

arXiv:2605.23995v1 Announce Type: cross Abstract: Self-supervised learning (SSL) has emerged as a promising paradigm for addressing the annotation bottleneck in medical imaging by learning representat

Terrain-Adaptive Grouser Wheel for Optimal Planetary Exploration: Design and Experimental Investigation

arXiv:2605.24311v1 Announce Type: new Abstract: Planetary rovers operating in extraterrestrial environments often encounter significant mobility challenges due to varying terrain features such as grad

researcharxiv-cs-ro

The Model Is Not the Product: A Dual-Pillar Architecture for Local-First Psychological Coaching

arXiv:2605.24411v1 Announce Type: new Abstract: Existing language model applications struggle to meet the demand for emotionally oriented support, primarily due to their inability to maintain deep, pe

The Multilingual Curse at the Retrieval Layer: Evidence from Amharic

arXiv:2605.24556v1 Announce Type: cross Abstract: Multilingual retrieval increasingly underpins cross-lingual question answering and retrieval-augmented generation. Strong zero-shot scores on multilin

The Time is Here for Just-in-Time Systems: Challenges and Opportunities

arXiv:2605.24096v1 Announce Type: cross Abstract: Core systems like key-value stores have historically taken years to build, and are designed to be general so as to amortize cost across deployments, p

The Tokenizer Tax Across 25 European Languages: Domain Invariance, Cross-Lingual Few-Shot Effects, and the Ukrainian Penalty

arXiv:2605.24718v1 Announce Type: new Abstract: Tokenizer fertility the number of tokens per word imposes a hidden cost on non-English NLP. We measure fertility for ten foundation models across 25 Eur

They Are Not the Same: Direct Causes Are Not Grounded Emotion Explanations

arXiv:2605.25208v1 Announce Type: new Abstract: Emotion-Cause Pair Extraction (ECPE) was introduced to explain why an emotion occurs, but this goal is now often reduced to binary pair/non-pair predict

Topology-Driven Transferability Estimation of Medical Foundation Models for Segmentation

arXiv:2602.23916v2 Announce Type: replace-cross Abstract: The advent of large-scale self-supervised learning (SSL) has produced a vast zoo of medical foundation models. However, selecting optimal medi

Toward a Benchmark for Controllable Simulation of Imperfect Students with Large Language Models

arXiv:2605.25601v1 Announce Type: cross Abstract: Teacher education requires deliberate practice with learners who exhibit identifiable strengths, weaknesses, and partial mastery. Large language model

Agents

Toward Enactive Artificial Intelligence

arXiv:2605.24238v1 Announce Type: new Abstract: In this paper, we advocate for incorporating enactive approaches to perception and cognition into artificial intelligence (AI). Enactive approaches view

agentsarxiv-cs-ai

Agents

Towards Multi-Turn Dialog Systems for Industrial Asset Operations and Maintenance

arXiv:2605.24953v1 Announce Type: new Abstract: Industrial asset operations and maintenance question answering is inherently multi-turn, iterative, and highly dependent on external tool invocation. Ho

agentsarxiv-cs-ai

Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system security

arXiv:2605.23989v1 Announce Type: new Abstract: Agentic AI systems -- Large Language Models (LLMs) augmented with planning, tool use, memory, and long-horizon interactions -- can execute complex tasks

TRAFA: Anticipating User Actions to Reduce Errors in Procedural Tasks with Predictive Feedback

arXiv:2605.24526v1 Announce Type: cross Abstract: Interactive assistance systems typically provide feedback after an action has been completed, supporting error recovery but not preventing the error i

Train-Free Segmentation in MRI with Cubical Persistent Homology

arXiv:2401.01160v3 Announce Type: replace-cross Abstract: We investigate a framework for train-free MRI segmentation based on Topological Data Analysis. The pipeline proceeds in three steps, first ide

Transformers over-extend what humans underlearn: the case of Spanish L-shaped morphome

arXiv:2507.21556v3 Announce Type: replace Abstract: The cognitive reality of irregular morphological patterns has been debated for decades: do speakers extend them to novel forms, or are they lexical

applicationsarxiv-cs-cl

TriVAL: A Tri-Validation Framework for Faithful Automatic Optimization Modeling

arXiv:2605.23966v1 Announce Type: cross Abstract: Optimization modeling serves as the pivotal bridge between natural-language problem descriptions and optimization solvers, and remains a cornerstone f

Trust but Verify: Prover-Verifier Deliberation for Selective LLM Prediction

arXiv:2605.25133v1 Announce Type: new Abstract: Reliably knowing when a language model is correct is almost as important as being correct. We introduce prover-verifier deliberation (PVD), an inference

TTPrint: Evidence-Grounded TTP Extraction via Diverge-then-Converge Verification

arXiv:2605.25836v1 Announce Type: cross Abstract: Extracting MITRE ATT&CK techniques from cyber threat intelligence (CTI) reports is an open-set, multi-label problem requiring both high recall (not mi

Turn-Based Structural Triggers: Prompt-Free Backdoors in Multi-Turn LLMs

arXiv:2601.14340v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) are widely integrated into interactive systems such as dialogue agents and task-oriented assistants. This growing

Unbalanced Incomplete Multi-view Clustering via the Scheme of View Evolution: Weak Views are Meat; Strong Views do Eat

arXiv:2011.10254v3 Announce Type: replace-cross Abstract: Incomplete multi-view clustering is an important technique to deal with real-world incomplete multi-view data. Previous works assume that all

applicationsarxiv-cs-ai

Uncertainty-DTW for Sequences and Visual Tokens

arXiv:2605.25110v1 Announce Type: cross Abstract: Aligning structured data is a fundamental problem in computer vision and machine learning, underlying tasks such as time series analysis, human action

VectorArk: Learning Practical Image Vectorization with Rounded Polygon Representation

arXiv:2605.24398v1 Announce Type: cross Abstract: Recent vision-language model (VLM)-based approaches have achieved impressive results on image vectorization tasks. However, they are typically evaluat

applicationsarxiv-cs-ai

Verified SHAP: Provable Bounds for Exact Shapley Values of Neural Networks

arXiv:2605.24084v1 Announce Type: cross Abstract: Shapley additive explanations (SHAP) are widely recognised as computationally intractable for neural networks, since they induce an exponential search

VisualOverload: Probing Visual Understanding of VLMs in Really Dense Scenes

arXiv:2509.25339v3 Announce Type: replace-cross Abstract: Is basic visual understanding really solved in state-of-the-art VLMs? We present VisualOverload, a slightly different visual question answerin

Voting with the Graph: Stable RLAIF via Topological Consistency Maximization

arXiv:2510.15514v3 Announce Type: replace Abstract: Reinforcement Learning from AI Feedback (RLAIF) relies on LLM judges as preference measurement instruments, yet these instruments are fundamentally

What Gets Cited: Competitive GEO in AI Answer Engines

arXiv:2605.25517v1 Announce Type: new Abstract: AI answer engines generate answers from retrieved pages but cite only a few sources. This makes visibility depend not just on ranking, but on being cite

What Happens Next? Anticipating Future Motion by Generating Point Trajectories

arXiv:2509.21592v2 Announce Type: replace-cross Abstract: We consider the problem of forecasting motion from a single image, i.e., predicting how objects in the world are likely to move, without the a

applicationsarxiv-cs-ai

When Correct Beliefs Collapse: Epistemic Resilience of LLMs under Clinical Pressure

arXiv:2605.23932v1 Announce Type: new Abstract: Despite strong medical benchmark accuracy, LLMs can exhibit severe multi-turn sycophancy in clinical dialogue, abandoning initial correct diagnosis unde

When Does Synthetic Patent Data Help? Volume-Fidelity Trade-offs in Low-Resource Multi-Label Classification

arXiv:2605.24296v1 Announce Type: new Abstract: We study when LLM-generated synthetic data helps low-resource multi-label patent classification, separating true synthetic value from the confound that

When Mean CE Fails: Median CE Can Better Track Language Model Quality

arXiv:2605.24667v1 Announce Type: new Abstract: Mean cross-entropy is the standard validation metric for language models, but it can fail to track model quality during training. We examine this in two

Which Is Better For Reducing Outdated and Vulnerable Dependencies: Pinning or Floating?

arXiv:2510.08609v3 Announce Type: replace-cross Abstract: Developers consistently use version constraints to specify acceptable versions of the dependencies for their project. Pinning dependencies can

Whose Alignment? Comparing LLM Process Alignment Across Diverse Organizational Decision Contexts

arXiv:2605.25256v1 Announce Type: new Abstract: Aligning AI systems with organizational decision-making is typically framed as a single-target problem: make the model behave like the organization. We

Agents

Why We Need World Models for AGI: Where LLMs Fail and How World Models May Outperform

arXiv:2605.23972v1 Announce Type: new Abstract: Large language models achieve strong performance in language generation and knowledge-intensive tasks, yet remain limited in settings requiring causal r

agentsarxiv-cs-ai

WideDepth: Millimeter-Accurate Benchmark for Fisheye Depth Estimation

model-releasesarxiv-cs-ro

arXiv:2605.24074v1 Announce Type: cross Abstract: Fisheye cameras are increasingly adopted in robotics for near-field manipulation, navigation, and immersive perception, yet indoor depth benchmarks wi

X-DiffVLA: X-Embodied Diffusion Action Heads for Vision-Language-Action Models

arXiv:2605.25044v1 Announce Type: new Abstract: Learning universal policies from cross-embodied data remains a fundamental challenge in robotics. Although Vision-Language-Action (VLA) models are pre-t

safetyarxiv-cs-ro