Search: “evaluation”

Algometrics: Forecasting Under Algorithmic Feedback

arXiv:2605.23978v1 Announce Type: new Abstract: In algorithmic markets, predictive models become part of the data-generating process they aim to forecast. Once their outputs are converted into trades,

All Leaks Count, Some Count More: Interpretable Temporal Contamination Detection and Mitigation in LLM Backtesting

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2602.17234v2 Announce Type: replace Abstract: Backtesting LLMs on resolved events assumes models reason only from pre-cutoff knowledge, yet pretrained models inevitably leak post-cutoff knowledg

researcharxiv-cs-ai

26 May 2026

An Interpretable CF-RL-TOPSIS Fusion Model for Skills-Aware Talent Recommendation

arXiv:2605.24155v1 Announce Type: cross Abstract: Effective skills-aware talent recommendation must balance behavioral transition patterns, trajectory-sensitive adaptation, and inspectable occupation-

Anatomy-Anchored Self-Supervision: Distilling Vision Foundation Models for Invariant Ultrasound Representation

arXiv:2605.25402v1 Announce Type: cross Abstract: Self-supervised pre-training paradigm has gained increasing prominence for learning transferable representations in medical imaging, yet existing meth

APT-Agent: Automated Penetration Testing using Large Language Models

arXiv:2605.24949v1 Announce Type: cross Abstract: Penetration testing is essential to securing modern web infrastructures, yet traditional manual methods struggle to keep pace with their scale and com

Assessing the Operational Viability of Foundation Models for Time Series Forecasting

arXiv:2605.24381v1 Announce Type: cross Abstract: Time series forecasting drives operational decisions in areas like finance, transportation, and energy. While supervised learning approaches achieve s

applicationsarxiv-cs-ai

ASTRO: Adaptive Spatio-Temporal Reinforcement Optimization for GNN Powered Anomly Detection in Cyber Physical Systems

arXiv:2605.25135v1 Announce Type: cross Abstract: Anomaly detection in Industrial Internet of Things (IIoT) environments is essential to protect the Industrial Control Systems (ICS) and Cyber-Physical

applicationsarxiv-cs-ai

AstroMind: A High-Fidelity Benchmark for Spacecraft Behavior Reasoning Based on Large Language Models

model-releasesarxiv-cs-cl

arXiv:2605.24573v1 Announce Type: new Abstract: Understanding why a spacecraft maneuvers -- rather than simply that it did -- is an increasingly important problem for space domain awareness as Earth o

Attested Tool-Server Admission: A Security Extension to the Model Context Protocol

arXiv:2605.24248v1 Announce Type: cross Abstract: The Model Context Protocol (MCP) standardizes how a large-language-model (LLM) agent and an external tool server exchange messages, but not trust: a h

ATWL: A Formal Language for Representing, Comparing, and Reusing Visual Analytics Workflows

arXiv:2605.25489v1 Announce Type: new Abstract: Visual analytics (VA) workflows are inherently complex, involving data transformation, feature engineering, visual representation, and human interpretat

Authority Inversion in LLM-Mediated Ubiquitous Systems: When Models Trust Users Over Sensors

arXiv:2605.23938v1 Announce Type: new Abstract: Large language models (LLMs) increasingly fuse heterogeneous inputs in ubiquitous systems. Yet, how LLMs implicitly allocate authority when sensor measu

Authority Signals in Claude AI Health Citations: A Descriptive Analysis Using the Authority Signals Framework

arXiv:2605.23921v1 Announce Type: cross Abstract: This study seeks to determine the authority signals used by Anthropic's Claude AI in its presentation of sources when answering consumer health questi

BackWeak: Backdooring Knowledge Distillation Simply with Weak Triggers and Fine-tuning

arXiv:2511.12046v2 Announce Type: replace-cross Abstract: Knowledge Distillation (KD) is essential for compressing large models, yet relying on pre-trained 'teacher' models downloaded from third-party

BC Protocol: Structured Dual-Expert Dialogue for Eliciting High-Quality Chain-of-Thought Post-Training Data

arXiv:2605.25549v1 Announce Type: cross Abstract: High-quality expert chain-of-thought (CoT) data is one of the core bottlenecks in large language model (LLM) post-training. Existing data production m

Behind EvoMap: Characterizing a Self-Evolving Agent-to-Agent Collaboration Network

arXiv:2605.25815v1 Announce Type: new Abstract: Agent-to-Agent (A2A) networks enable autonomous AI agents to collaborate by sharing reusable problem-solving instructions. However, how these decentrali

Benchmarking non-conformity score functions in conformal prediction

arXiv:2605.24983v1 Announce Type: new Abstract: Conformal prediction is a useful and versatile alternative to model calibration in machine learning classification. It replaces single-class prediction

Beyond Summaries: Structure-Aware Labeling of Code Changes with Large Language Models

arXiv:2605.26100v1 Announce Type: cross Abstract: Code review is a critical practice in software engineering, yet the growing scale and frequency of code patches in modern projects, together with the

Hardware

Beyond the Aggregation Dilemma: Prior-Retaining Decoupled Learning for Multimodal Graphs

arXiv:2605.24684v1 Announce Type: cross Abstract: Multimodal Attributed Graph Learning (MAGL) integrates intrinsic node attributes with structural topology via graph aggregation. However, as pretraine

hardwarearxiv-cs-ai

Beyond the Proxy: Trajectory-Distilled Guidance for Offline GFlowNet Training

arXiv:2505.20110v3 Announce Type: replace-cross Abstract: Generative Flow Networks (GFlowNets) excel at sampling diverse, high-reward objects. In many practical applications where active reward querie

BigMac: Breaking the Pareto Frontier of Compute and Memory in Multimodal LLM Training

arXiv:2605.25451v1 Announce Type: new Abstract: Training multimodal large language models (MLLMs) is challenged by both model and data heterogeneity. Existing systems redesign the training pipeline to

BlitzRank: Principled Zero-shot Ranking Agents with Tournament Graphs

arXiv:2602.05448v4 Announce Type: replace Abstract: Selecting the top m from n items via expensive k-wise comparisons is central to settings ranging from LLM-based document reranking to crowdsourced e

BODHI: Precise OS Kernel Specification Inference

arXiv:2605.23931v1 Announce Type: new Abstract: The formal verification of operating system kernels requires precise specifications that capture the intended behavior of system calls. Writing these sp

Bridging the Gap: Enabling Soft Actor Critic for High Performance Legged Locomotion

arXiv:2605.24975v1 Announce Type: cross Abstract: Proximal Policy Optimization (PPO) has become the de facto standard for training legged robots, thanks to its robustness and scalability in massively

Byzantine-Robust Federated Learning with Learnable Aggregation Weights

arXiv:2511.03529v2 Announce Type: replace Abstract: Federated Learning (FL) enables clients to collaboratively train a global model without sharing their private data. However, the presence of malicio

CAFD: Concept-Aware DNN Fault Detection using VLMs

arXiv:2605.24008v1 Announce Type: new Abstract: Fault detection for Deep Neural Networks (DNNs) has received increasing attention in recent years. While more advanced hybrid approaches have been propo

CALIBURN: A Regime-Sensitivity Study of Operationally Calibrated Streaming Intrusion Detection

arXiv:2605.24696v1 Announce Type: cross Abstract: Streaming network intrusion detection systems must process flows continuously while keeping memory bounded, but most current methods leave alerting th

Capture-Calibrate-Coach: A Graph-Based Framework for Knowledge Monitoring Estimation and Adaptive Feedback

arXiv:2605.25419v1 Announce Type: new Abstract: Effective learning support requires understanding not only what learners know but also how accurately they perceive their own understanding. This metaco

Chain-of-Thought Hijacking

arXiv:2510.26418v4 Announce Type: replace Abstract: Large Reasoning Models (LRMs) improve task performance through extended inference-time reasoning. Although previous studies suggest that longer reas

ChainzRule: Sample-Efficient, Robust Deep Learning Across Tabular, NLP, and Vision Tasks

arXiv:2605.24340v1 Announce Type: new Abstract: Production deep learning systems across enterprise domains operate under constraints that academic benchmarks routinely obscure: labeled data is expensi

Characterizing Linear Alignment Across Language Models

arXiv:2603.18908v4 Announce Type: replace Abstract: Language models increasingly appear to learn similar representations, despite differences in training objectives, architectures, and data modalities

CHESTNUT: A QoS Dataset for Mobile Edge Environments

arXiv:2410.19248v2 Announce Type: replace Abstract: Quality of Service (QoS) is an important metric to measure the performance of network services. Nowadays, it is widely used in mobile edge environme

ChunkLLM: A Lightweight Pluggable Framework for Accelerating LLMs Inference

arXiv:2510.02361v2 Announce Type: replace-cross Abstract: Transformer-based large models excel in natural language processing and computer vision, but face severe computational inefficiencies due to t

Claw-Anything: Benchmarking Always-On Personal Assistants with Broader Access to User's Digital World

arXiv:2605.26086v1 Announce Type: new Abstract: Large language model agents are increasingly envisioned as always-on personal assistants with access to anything relevant in the user's digital world. Y

Clustering based on Stochastic Dominance with application for risk averters and risk seekers

arXiv:2605.24422v1 Announce Type: cross Abstract: Stochastic Dominance (SD) theory provides a rigorous framework for selecting superior assets tailored to the asset allocation needs of investors with

Code2UML: Agentic LLMs with context engineering for scalable software visualization

arXiv:2605.24453v1 Announce Type: cross Abstract: Large Language Model (LLM)-based code analysis tools are adopted to automate software documentation tasks. However, the scalability of these approache

CollectionLoRA: Collecting 50 Effects in 1 LoRA via Multi-Teacher On-Policy Distillation

arXiv:2605.25378v1 Announce Type: cross Abstract: Customized image editing aims to equip pre-trained diffusion models with specific visual effects using limited paired data, typically via Low-Rank Ada

Concept Drift Adaptation Using Self-Supervised and Reinforcement Learning In Android Malware Detection

arXiv:2605.24294v1 Announce Type: cross Abstract: Android malware detectors often degrade after deployment because of concept drift, while full retraining at each maintenance step is costly. We propos

Concept Unlearning via Cross-Attention Activation Projection for Diffusion Models

arXiv:2605.25765v1 Announce Type: cross Abstract: Concept unlearning aims to erase a target concept from a pretrained text-to-image diffusion model without retraining. Closed-form methods are attracti

Confidence and Calibration of Activation Oracles for Reliable Interpretation of Language Model Internals

arXiv:2605.26045v1 Announce Type: cross Abstract: Activation oracles aim to make the activations of other models legible to humans and yield promising results compared to white-box interpretability te

Confidence Calibration in Large Language Models

arXiv:2605.23909v1 Announce Type: new Abstract: We investigate the calibration of large language models' (LLMs') confidence across diverse tasks. The results of our preregistered study show that the c

Context-CoT: Enhancing Context Learning via High-Quality Reasoning Synthesis

arXiv:2605.25354v1 Announce Type: new Abstract: While LLMs excel at reasoning over prompts using static pretrained knowledge, they struggle significantly with context learning-the ability to dynamical

ContextEcho: A Benchmark for Persona Drift in Long Agentic-Coding Sessions

model-releasesarxiv-cs-cl

arXiv:2605.24279v1 Announce Type: new Abstract: A frontier language model's acknowledged 'helpful programming assistant' persona does not survive long agentic-coding sessions in the deployment regime

Convex-Neural RRT*: Fast and Reliable Learning-Guided Sampling for High-Quality Robot Path Planning

model-releasesarxiv-cs-lg

arXiv:2605.25006v1 Announce Type: cross Abstract: Sampling-based algorithms for robot path planning offer probabilistic completeness and strong empirical convergence properties across environments wit

Local Ai

CoRe-Code: Collaborative Reinforcement Learning for Code Generation

arXiv:2605.24812v1 Announce Type: new Abstract: Large language models (LLMs) have achieved strong performance in code generation, but most methods rely on autoregressive decoding without global planni

local-aiarxiv-cs-ai

Cultivating Machine Intelligence: The OMEGA Shift from Top-Down Optimization to Autopoietic Cognitive Ecologies

arXiv:2605.25062v1 Announce Type: cross Abstract: The dominant artificial intelligence paradigm trains neural architectures via gradient descent against proxy objectives and reinforcement learning fro

CVEvolve: Autonomous Algorithm Discovery for Unstructured Scientific Data Processing

arXiv:2605.11359v2 Announce Type: replace Abstract: Scientific data processing often requires task-specific algorithms or AI models, creating a barrier for domain scientists who need to analyze their

CyBOKClaw: Human-in-the-Loop CyBOK Mapping for Cybersecurity Curriculum

arXiv:2605.24663v1 Announce Type: cross Abstract: This paper presents CyBOKClaw, an interpretable human-in-the-loop retrieval framework for mapping cybersecurity keywords or phrases (KWoPs) to the Cyb

D^2-Monitor: Dynamic Safety Monitoring for Diffusion LLMs via Hesitation-Aware Routing

arXiv:2605.25893v1 Announce Type: new Abstract: Despite the emergence of diffusion large language models (D-LLMs) as an alternative to autoregressive large language models (AR-LLMs), safety monitoring