Search: “evaluation”

SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agents

arXiv:2605.05726v2 Announce Type: replace Abstract: As LLM agents are increasingly deployed with large libraries of reusable skills, selecting the right skill for a user request has become a critical

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

Small Language Models as Judges for Rubric-Based Reinforcement Learning

DGX agent

arXiv:2608.30005v1 Announce Type: new Abstract: Rubric-based reinforcement learning extends RL beyond tasks with exact answers or rule-based verifiers by scoring responses against instance-specific cr

local-aiarxiv-cs-cl

1 Sept 2026

Tutorials

SMG: Semantic Motion Graph for Monocular Dynamic Gaussian Splatting

arXiv:2608.31023v1 Announce Type: new Abstract: We study dynamic Gaussian Splatting from monocular videos. While recent advancements in dynamic Gaussian splatting offer a promising foundation for mode

tutorialsarxiv-cs-cv

SmoothRL: Online Reinforcement Learning During Asynchronous Execution

arXiv:2608.29768v1 Announce Type: new Abstract: Deploying robot policies in the physical world requires satisfying two fundamental desiderata: reliability and smooth real-time execution. However, depl

safetyarxiv-cs-ro

SocialReasonBench: A Video-QA Benchmark for Social Reasoning with Counterfactual Narrative Videos

model-releasesarxiv-cs-cl

arXiv:2608.30716v1 Announce Type: new Abstract: Recent advances in Large Multimodal Models (LMMs) have greatly improved video understanding, yet their ability to reason about human-centered social sit

Tutorials

SonicMaster: Towards Controllable All-in-One Music Restoration and Mastering

arXiv:2508.03448v4 Announce Type: replace-cross Abstract: Music recordings often suffer from audio quality issues such as excessive reverberation, distortion, clipping, tonal imbalances, and a narrowe

tutorialsarxiv-cs-ai

Local Ai

SpanCalib-VLM: Calibrated Hallucination Span Detection in Vision-Language Models

arXiv:2608.29974v1 Announce Type: cross Abstract: Detecting hallucinations in Large Vision-Language Models (LVLMs) requires both accurate span localization and well-calibrated confidence scores. Fine-

local-aiarxiv-cs-cl

SPARK: Skeleton-Guided Reasoning Synthesis from Large-Scale Scientific Literature

arXiv:2608.30214v1 Announce Type: new Abstract: Scientific reasoning remains challenging for open-source models, largely due to the lack of high-quality scientific reasoning data. Existing datasets ar

Sparse Competition during Training For the Emergence of Specialized Modules

arXiv:2608.30978v1 Announce Type: new Abstract: Modularity in deep neural networks has been proposed as a means of improving both interpretability and training by promoting disentangled representation

SpectraTac: A Compact Camera-Free Optical Tactile Sensor with Distributed Color Sensing

arXiv:2608.30368v1 Announce Type: new Abstract: Tactile sensing is essential for physical interaction in robotics and human--machine systems. However, combining rich tactile information with compact h

researcharxiv-cs-ro

Local Ai

StageWell: A Process-Aligned Chinese Corpus for Positive-Psychology Support Dialogue

arXiv:2608.29326v1 Announce Type: cross Abstract: Positive psychology dialogue aims to support emotional distress and positive resource building, requiring models to produce not only empathetic replie

local-aiarxiv-cs-ai

Stop Before You Fail: Operational Capability Boundaries for Mitigating Unproductive Reasoning in Large Reasoning Models

arXiv:2509.24711v4 Announce Type: replace Abstract: Current answering paradigms for Large Reasoning Models (LRMs) often fail to account for the fact that some questions may lie beyond the model's oper

Structured State Reconciliation for Human-AI Task Handover

arXiv:2608.28907v1 Announce Type: cross Abstract: Task handover requires communicating enough current state for a successor to resume work, yet the relevant information is often divided between system

Supraglacial Lake Fate Is Knowable Long Before the Season Ends

arXiv:2608.30113v1 Announce Type: new Abstract: A supraglacial lake on the Greenland Ice Sheet ends its melt season in one of four ways: it drains rapidly through a hydrofracture, drains slowly across

T-MAP: Red-Teaming LLM Agents with Trajectory-aware Evolutionary Search

arXiv:2603.22341v2 Announce Type: replace-cross Abstract: While prior red-teaming efforts have focused on eliciting harmful text outputs from large language models (LLMs), such approaches fail to capt

TACS: Trajectory-Aware Candidate Selection for LLM Jailbreak Suffix Optimization

arXiv:2608.29564v1 Announce Type: new Abstract: Gradient-based jailbreak suffix optimization methods typically update the suffix by retaining the candidate with the lowest current loss. We show that t

safetyarxiv-cs-cl

Target-Aware State-Adaptive p-Dirichlet Graph Neural Regression for Non-Invasive Body-Composition Estimation

arXiv:2608.29496v1 Announce Type: new Abstract: Accurate estimation of body-composition outcomes, including body fat percentage (BFP), bone mineral density (BMD), and appendicular lean mass (ALM), is

Temperature-Adaptive Transformed Teacher Matching

arXiv:2608.29099v1 Announce Type: cross Abstract: Temperature scaling is a core component of knowledge distillation, yet its role and effect are still not fully understood. Transformed Teacher Matchin

researcharxiv-cs-cv

Tensor Methods for Language Models: From Token Representation to Training, Adaptation, Inference, Compression, and Interpretability

arXiv:2608.30505v1 Announce Type: cross Abstract: Large language models (LLMs) are built from structured high-dimensional objects such as token representations, weights, adaptation updates, caches, an

Test-Time Scaling for Video Diffusion Models via Diagnosis-Guided Candidate Recycling

arXiv:2608.29322v1 Announce Type: new Abstract: Recent video diffusion models have achieved remarkable generation quality, but high-fidelity results still largely depend on closed-source systems or co

researcharxiv-cs-cv

The First Token Is a Clue: Verbalizing Multi-Token Concepts from the J-lens

model-releasesarxiv-cs-cl

arXiv:2608.31084v1 Announce Type: new Abstract: The Jacobian Lens (J-lens) is a recent tool for interpreting LLMs. It reads a hidden state as a ranked list of vocabulary tokens, leaving multi-token co

The Illusion of Replacement: Rethinking Specialized Machine Learning Models in the Foundation Model Era

arXiv:2608.28980v1 Announce Type: cross Abstract: Can the specialized architectures that machine learning has traditionally built for structured data be replaced by language-based models? This questio

The Safety Relay in Roleplay Jailbreaks: A Component-Resolved Causal Analysis of Harm Recognition and Refusal

arXiv:2608.30585v1 Announce Type: new Abstract: Large language models are trained to follow instructions while refusing harmful requests. Jailbreaks exploit this balance to elicit content a model woul

safetyarxiv-cs-lg

The Signal in the Noise: An Auditable Reliability Layer for Biomedical Text Classification

arXiv:2608.28595v1 Announce Type: new Abstract: Biomedical NLP pipelines routinely presuppose clean input text, yet large-scale corpora assembled through automated PDF parsing harbour pervasive OCR-li

Titans-QFWP: A Regime-Aware Hybrid Quantum Fast Weight Programmer for Portfolio Optimization

model-releasesarxiv-cs-lg

arXiv:2608.29093v1 Announce Type: new Abstract: We propose Titans-QFWP, a hybrid reinforcement learning architecture integrating a Quantum Fast Weight Programmer with Titans-style memory (Persistence,

Toward a Cross-Lingual Romanization Ecosystem for Sinitic Languages: A Paired Mandarin-Cantonese Case Study

arXiv:2608.29170v1 Announce Type: new Abstract: This paper proposes the Sinitic Romanization Ecosystem, a cross-lingual Sinitic romanization design framework with supporting digital infrastructure and

safetyarxiv-cs-cl

Toward Generalizable Deep Learning Based Peatland Fire Detection via Walsh Hadamard Transform and Domain Adaptation

arXiv:2603.02465v2 Announce Type: replace-cross Abstract: Machine learning-based wildfire detection has advanced significantly using deep learning models trained on large wildfire image and video data

Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Security

arXiv:2608.29596v1 Announce Type: new Abstract: Autonomous large language model (LLM) agents increasingly face reliability, context consumption, and execution stability bottlenecks when deployed on co

Agents

Towards Fully Automated Medical Imaging Code Generation via Validation-based Context Engineering

arXiv:2608.29016v1 Announce Type: new Abstract: Large language models (LLMs) have demonstrated considerable promise in program generation for small-scale and conventional application development; howe

agentsarxiv-cs-cv

Tracing Generated Samples to Training-Data Clusters in Flow-Matching Models

arXiv:2608.30081v1 Announce Type: cross Abstract: Understanding which training samples influence a generated image is an important problem in generative modeling. In flow matching, training samples in

researcharxiv-cs-cv

'Train classical, deploy quantum' requires rethinking generalization

model-releasesarxiv-cs-lg

arXiv:2608.31117v1 Announce Type: cross Abstract: Generative models have become central across science and industry, from image and text synthesis to the design of molecules and materials. Quantum gen

Training-Free Hidden-State Refinement for Flow-Matching Image Generators

arXiv:2608.29160v1 Announce Type: cross Abstract: We aim to improve frozen flow-matching image generators by adding inference computation inside the denoiser, without changing model weights or the out

Training-free LLM Verification via Recycling Few-shot Examples

arXiv:2506.17251v3 Announce Type: replace-cross Abstract: Although large language models (LLMs) have achieved remarkable performance, the inherent stochasticity of their reasoning processes and varyin

TriPilot-FF: Coordinated Whole-Body Teleoperation with Force Feedback

arXiv:2602.09888v2 Announce Type: replace Abstract: Mobile manipulators broaden the operational envelope for robot manipulation. However, the whole-body teleoperation of such robots remains a problem:

safetyarxiv-cs-ro

Local Ai

TRIPPULSE: Multi-Agent Travel Planning with Review-Grounded Reasoning

arXiv:2608.30924v1 Announce Type: new Abstract: Travel itinerary generation requires balancing strict spatio-temporal constraints with human preferences. Existing LLM-based planners mainly rely on str

local-aiarxiv-cs-cl

Turning the Spell Around: Lightweight Alignment Amplification via Rank-One Safety Injection

arXiv:2508.20766v2 Announce Type: replace-cross Abstract: Safety alignment in Large Language Models (LLMs) often involves mediating internal representations to refuse harmful requests. Recent research

Uncertainty Makes It Stable: Curiosity-Driven Quantized Mixture-of-Experts

arXiv:2511.11743v4 Announce Type: replace-cross Abstract: Deploying deep neural networks on resource-constrained devices faces two critical challenges: maintaining accuracy under aggressive quantizati

safetyarxiv-cs-ai

Uncertainty of Vision Medical Foundation Models

arXiv:2608.30390v1 Announce Type: new Abstract: Accurate uncertainty estimation is essential for machine learning systems de- ployed in high-stakes domains such as medicine. Traditional approaches pri

Universal Redundancies in Time Series Foundation Models

arXiv:2602.01605v2 Announce Type: replace Abstract: Time Series Foundation Models (TSFMs) leverage extensive pretraining to accurately predict unseen time series during inference, without the need for

safetyarxiv-cs-lg

Applications

Unknown Unknowns: Do Hidden Intentions in LLMs Evade Detection?

arXiv:2601.18552v2 Announce Type: replace Abstract: LLMs expand accessibility and provide wide-reaching access to information. Yet these interactions also create opportunities to embed subtle, goal-or

applicationsarxiv-cs-cl

Unleashing the Potential of Mamba: Boosting a LiDAR 3D Sparse Detector by Using Cross-Model Knowledge Distillation

arXiv:2409.11018v3 Announce Type: replace Abstract: The LiDAR 3D object detector that balances accuracy and speed is crucial for achieving real-time perception in autonomous driving. However, many exi

safetyarxiv-cs-cv

Using Prosody to Predict Syntactic Structure

arXiv:2608.30260v1 Announce Type: cross Abstract: While it is well-established that prosody carries crucial cues for syntactic structure, the degree and nature of correspondence between these two doma

Validating FKG.in: Soundness Assessment in LLM-Augmented Indian Food Knowledge

arXiv:2608.29249v1 Announce Type: new Abstract: The online culinary ecosystem is increasingly populated by recipe content generated, modified, or summarized by Large Language Models (LLMs). While ofte

Vectors from Larger Language Models Predict Human Reading Time and fMRI Data More Poorly when Dimensionality Expansion is Controlled

arXiv:2505.12196v2 Announce Type: replace Abstract: The impressive linguistic abilities of large language models (LLMs) have recommended them as models of human sentence processing, with some conjectu

researcharxiv-cs-cl

VeloBins: Learning Velocity and Its Uncertainty via Bins and Error-Conditioned Gaussian Labels for Aerial Inertial Odometry

arXiv:2608.29720v1 Announce Type: new Abstract: Inertial odometry (IO) is critical for aerial robots, where aggressive maneuvers and poor lighting degrade visual sensors. Recent learning-based IO meth

researcharxiv-cs-ro

Verification-Aware Training for Speculative Decoding

model-releasesarxiv-cs-cl

arXiv:2608.30135v1 Announce Type: new Abstract: Speculative decoding accelerates large language model inference by using a draft model to generate candidate tokens, which are verified by the target mo

Agents

View-oriented Conversation Compiler for Agent Trace Analysis

arXiv:2603.29678v3 Announce Type: replace Abstract: We observe that an agent trace is a structured document. A coding agent session contains user turns, assistant text, chain of thought blocks, tool c

agentsarxiv-cs-ai

Vision Models Predict Urban Scene Appraisal with Limited Neural Alignment

model-releasesarxiv-cs-cv

arXiv:2608.30964v1 Announce Type: new Abstract: Pretrained vision embeddings are increasingly used as general-purpose representations for modelling how people appraise urban scenes, and are validated