Search: “evaluation”

SPOT: Sparse Probing and Outcome Calibration for On-Policy Distillation

arXiv:2608.04419v1 Announce Type: cross Abstract: On-policy distillation (OPD) provides dense teacher supervision on student-generated trajectories, but standard reverse-KL training can assign insuffi

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

SSTQ:Privacy-Preserving Vector Quantization via Subsampled Stochastic TurboQuant

DGX agent

arXiv:2608.05127v1 Announce Type: cross Abstract: Achieving local differential privacy in distributed optimization while maintaining low communication cost remains challenging. Existing vector quantiz

researcharxiv-cs-ai

6 Aug 2026

Static Timing Orchestration for Tree-Structured Robot Control Firmware

arXiv:2608.04600v1 Announce Type: new Abstract: As robotic systems become increasingly complex, generating control firmware from structural description files has emerged as a promising paradigm for re

researcharxiv-cs-ro

Suppression Sticks, Locality Is Fragile: A Closed-Loop Target-and-Control Audit of Task-Vector Negation in VLA Policies

arXiv:2608.04692v1 Announce Type: cross Abstract: Task-vector arithmetic offers a closed-form way to modify a model, yet its behavioral locality remains unclear in closed-loop robot control. We presen

local-aiarxiv-cs-lg

SurgNarrator: A Generative Retrieval Framework for Surgical Video Understanding

arXiv:2608.04676v1 Announce Type: new Abstract: Surgical procedures unfold as structured and recurring clinical events, whose real-time understanding via intraoperative surgical videos is critical for

tutorialsarxiv-cs-cv

SVI-DAG: A Structured Variational Inference Approach to Bayesian Causal Discovery

arXiv:2608.04930v1 Announce Type: cross Abstract: Bayesian causal discovery seeks to determine the posterior distribution of causal theories, which are interpreted as directed acyclic graphs (DAGs) th

researcharxiv-cs-ai

Taalas buried the lede for the amazing demo of their first tape out. 15k tokens per second with a llama 8b model, ability to scale that up e…

model-releasesemad-mostaque--x

Taalas buried the lede for the amazing demo of their first tape out. 15k tokens per second with a llama 8b model, ability to scale that up etched onto silicon As models satisfice etching makes sense,

Temporal Context Awareness: A Defense Framework Against Multi-turn Manipulation Attacks on Large Language Models

arXiv:2503.15560v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly vulnerable to sophisticated multi-turn manipulation attacks, where adversaries strategically build conte

Terminal Agents Suffice for Enterprise Automation

arXiv:2604.00073v3 Announce Type: replace-cross Abstract: There has been growing interest in building agents that can interact with digital platforms to execute meaningful enterprise tasks autonomousl

agentsarxiv-cs-ai

The Effect of Perceived Race and Gender on Police Language Use: Experimental Evidence from VR Simulations

arXiv:2608.05050v1 Announce Type: cross Abstract: Against the backdrop of violence in police interactions with the U.S. public, we explore how deferentially police officers speak to virtual characters

researcharxiv-cs-ai

The Order Is the Guarantee: Verifier-Budgeted Code Deletion with Static-First Learned Proposals

arXiv:2608.04611v1 Announce Type: cross Abstract: Frontier coding models now match or exceed strong human reference points on programming benchmarks, yet benchmark success does not imply maintainable

The Personalization Mirage: How LLMs Fabricate User Profiles, and Why Self-Monitoring Misleads

arXiv:2608.04570v1 Announce Type: new Abstract: Personalized LLMs with persistent memory are increasingly deployed, yet the faithfulness of their user models remains unexamined. We study over-inferenc

researcharxiv-cs-cl

Thinking with Anchors: Grounded and Efficient Document Reasoning

model-releasesarxiv-cs-cv

arXiv:2608.04424v1 Announce Type: new Abstract: Existing document understanding benchmarks have largely focused on locating page elements, yet real-world document intelligence requires models to reaso

TopoChunker: Topology-Aware Agentic Document Chunking Framework

arXiv:2603.18409v2 Announce Type: replace Abstract: Current document chunking methods for Retrieval-Augmented Generation (RAG) typically linearize text. This forced linearization strips away intrinsic

agentsarxiv-cs-cl

Towards Trustworthy Hypergraph Neural Networks under Label Noise

arXiv:2608.04377v1 Announce Type: cross Abstract: Hypergraph neural networks (HGNNs) have demonstrated remarkable capabilities in processing complex higher-order relationships. However, their performa

Trace, Verify, and Correct: A Training-Free Framework for Spatial Reasoning in Multimodal LLMs

arXiv:2608.04759v1 Announce Type: cross Abstract: Although Multimodal Large Language Models (MLLMs) have made substantial progress, their spatial reasoning may still produce intermediate judgments inc

local-aiarxiv-cs-cl

Traceable LLM-Generated Hazard Scenarios for Operational Safety Analysis of Aviation Systems Using ASRS Reports

arXiv:2608.04697v1 Announce Type: new Abstract: Operational hazard analysis of aviation system operations must consider interactions among weather, ATC actions, airspace constraints, aircraft operatio

Transferable Dual-Stream Representations for Mesoscale-Preserving Sea Surface Temperature Downscaling

arXiv:2608.04230v1 Announce Type: cross Abstract: Deep learning models for scientific spatio-temporal downscaling often minimize reconstruction error while failing to preserve physically meaningful mu

TRCoRSurg: Temporal-Relational Co-Reasoning for Surgical Video Triplet Recognition

arXiv:2608.04606v1 Announce Type: new Abstract: Understanding complex surgical scenes requires recognizing multiple interdependent entities, such as instruments, actions, and targets, while maintainin

TriCLE: Tri-Modal Vision-Language Reasoning for Edge-Deployed Fine-Grained Clustering

arXiv:2608.04175v1 Announce Type: new Abstract: Edge platforms used for aerial observation must interpret aircraft imagery under limited memory, limited compute, and intermittent connectivity. This se

safetyarxiv-cs-cv

TS2TabPFN: Time Series Classification and Extrinsic Regression through Feature Extraction and a Tabular Foundation Model

arXiv:2608.04174v1 Announce Type: new Abstract: Time series data are ubiquitous in practical applications, where classification (TSC) and extrinsic regression (TSER) have emerged as essential tasks fo

researcharxiv-cs-lg

Understanding Fault Tolerance of Adversarially Robust Pruned Models

arXiv:2608.04173v1 Announce Type: new Abstract: Deep neural networks (DNNs) deployed on resource-constrained neuromorphic hardware face three concurrent challenges: the need for model compression thro

researcharxiv-cs-lg

VQ-VAD: Vector-quantized Motion Representation Learning for Human-centric Video Anomaly Detection

arXiv:2608.05069v1 Announce Type: cross Abstract: Video Anomaly Detection (VAD) is inherently challenging due to the scarcity of anomalies and the large visual variability in surveillance footage, inc

tutorialsarxiv-cs-ai

Zero-shot Sim2Real Transfer for Magnet-Based Tactile Sensor on Insertion Tasks

arXiv:2505.02915v2 Announce Type: replace Abstract: Tactile sensing is an important sensing modality for robot manipulation. Among different types of tactile sensors, magnet-based sensors, like u-skin

tutorialsarxiv-cs-ro

Hardware

A Deployment-Friendly Foundational Framework for Efficient Computational Pathology

arXiv:2602.14010v2 Announce Type: replace-cross Abstract: Pathology foundation models (PFMs) generalize well across computational pathology tasks but remain costly for gigapixel whole-slide image anal

hardwarearxiv-cs-ai

A Graph Signal Processing Perspective on Numerical Sequence Representations in LLM In-Context Learning

arXiv:2608.03015v1 Announce Type: cross Abstract: Pretrained large language models (LLMs) have demonstrated in-context learning (ICL) capabilities for numerical inference over sequences serialized as

local-aiarxiv-cs-ai

A Hierarchical Approach to Imitation Learning for Manipulation Tasks Requiring Time Varying Forces

arXiv:2608.03103v1 Announce Type: cross Abstract: Diffusion policies have shown strong performance in learning complex, multi-modal behaviors for robotic manipulation. However, their application to co

A Human-in-the-Loop Deep Learning Framework for Color Reconstruction of Lenticular Films

arXiv:2608.02835v1 Announce Type: new Abstract: Historical lenticular films, such as those created with the Kodacolor process, encode color information in a distinctive spatial format. This structure

A Physics-Informed Hybrid Neural Operator for Transient Magnetization Prediction in Power Magnetics

arXiv:2608.02965v1 Announce Type: new Abstract: Magnetic components in high-frequency, high-power-density converters are increasingly driven by non-sinusoidal flux-density waveforms with fast transiti

local-aiarxiv-cs-lg

A Wearable Stiffness-Rendering Haptic Device with a Honeycomb Jamming Mechanism for Bilateral Teleoperation

arXiv:2608.03002v1 Announce Type: new Abstract: This paper addresses the challenge of providing kinesthetic feedback in bilateral teleoperation by designing a wearable, lightweight (20 g), and compact

safetyarxiv-cs-ro

Active Stiffness Control of a Supportive Continuum Robot

arXiv:2608.03677v1 Announce Type: new Abstract: Supportive continuum robots (SCRs) enhance the load-bearing capability of an operative continuum robot by mechanically coupling it with a supportive arm

researcharxiv-cs-ro

Adaptive Sampling for Automated Post-Disaster Rapid Damage Assessment via Level-Set Cost-Aware Bayesian Optimization

arXiv:2608.02868v1 Announce Type: new Abstract: Natural disasters frequently inflict severe damage to the built environment, which demands a rapid, reliable, and cost-effective damage assessment for e

agentsarxiv-cs-lg

AgentPanel: Toward a New Paradigm for Human--AI Collaboration in Exploring Scientific Questions

arXiv:2608.03283v1 Announce Type: new Abstract: Identifying promising scientific ideas remains an important challenge in research practice. Researchers commonly rely on small-group discussions or one-

agentsarxiv-cs-ai

AI Sandbox: Technical Report

arXiv:2608.02679v1 Announce Type: cross Abstract: Collaborative AI experimentation across industry and academia requires platforms that enable rapid prototyping while preserving controlled access, ten

tutorialsarxiv-cs-ai

AI Security Leaderboard: Methodology, Results and Minimal Standard

arXiv:2608.03070v1 Announce Type: cross Abstract: Frontier AI model developers increasingly rely on layered safeguards to prevent catastrophic misuse, but little public evidence exists on how much pro

AI World Cup 2026: Benchmarking Large Language Models for End-to-End Football Tournament Prediction

arXiv:2608.03416v1 Announce Type: new Abstract: Large language models (LLMs) are now regularly asked to forecast real-world events, but comparisons are often difficult because models receive different

Ai2 expands collaboration with Hugging Face to accelerate open science

Ai2 is expanding its partnership with Hugging Face to give its growing portfolio of fully open models, datasets, benchmarks, and applications the storage, bandwidth, and integrations needed to reach m

researchai2

AIDE: Automated Instruction via Distilled Expertise for Reference-Free Motor Skill Coaching

arXiv:2608.03047v1 Announce Type: new Abstract: Generating natural-language coaching feedback on motor skills can accelerate learning, yet expert coaches are scarce and expensive. Existing reference-b

Applications

Also I think AISI is a great model of a government agency tasked with AI security. They have open benchmarks, very fast testing, and clear c…

applicationsethan-mollick--x

Also I think AISI is a great model of a government agency tasked with AI security. They have open benchmarks, very fast testing, and clear communication about incidents that is neither hyped up nor hi

ANNOTARES: A Dataset for Extracting Logical Structures from German Statutory Texts

model-releasesarxiv-cs-cl

arXiv:2608.03898v1 Announce Type: new Abstract: The automatic structural analysis of legal texts is a cornerstone of legal technology, yet the extraction of their logical components remains a signific

ArtECulture: Benchmarking Culture-Conditioned Visual Emotion Understanding in Multimodal Large Language Models

model-releasesarxiv-cs-cl

arXiv:2608.03358v1 Announce Type: new Abstract: Existing visual emotion understanding methods typically ignore cultural variations in emotional perception. We introduce culture-conditioned visual emot

AS-FedBridge: Pseudo-Spike Bridge Distillation for Heterogeneous ANN-SNN Federated Learning

model-releasesarxiv-cs-lg

arXiv:2608.03324v1 Announce Type: new Abstract: Federated learning enables collaborative model training across distributed edge devices while strictly preserving data privacy. To facilitate practical

Asking Questions the Right Way: A Multi-Agent Conversational System for Prompt Formulation in Complex Task Resolution

arXiv:2608.01366v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are integral to complex intellectual tasks, yet output quality remains constrained by user-provided prompts. Iter

agentsarxiv-cs-ai

Attention is Case-Sensitive

arXiv:2608.03711v1 Announce Type: cross Abstract: In human visual perception, uppercase lettering serves as a natural salience cue that captures attention within lowercase text. In this paper, we pres

researcharxiv-cs-cl

Attribute-based Undetectable Watermarking for Generative AI Models

arXiv:2608.03174v1 Announce Type: cross Abstract: Generative AI systems increasingly produce content whose provenance is difficult to verify, motivating watermarking techniques for identifying model-g

Automatic Patient-Specific Microwave Ablation Planning Accelerated by a Physics-Guided Deep Learning Model

arXiv:2608.03086v1 Announce Type: cross Abstract: Microwave ablation (MWA) is a promising minimally invasive treatment for liver tumors, but its therapeutic outcome strongly depends on patient-specifi

researcharxiv-cs-lg

Behaviorally Adaptive Visual Diversion for Inclusive and Resilient Digital Assessment Delivery

arXiv:2608.03531v1 Announce Type: new Abstract: Institutions increasingly rely on browser lockdown, webcam monitoring, and behavioral analytics to secure high-stakes digital assessments, yet these mec

researcharxiv-cs-ai

Applications

Benchmarking the Benchmarks: Testing the Predictive Validity of Commonsense Benchmarks

arXiv:2608.03340v1 Announce Type: new Abstract: Predicting LLM's capabilities on real-world tasks is essential, yet the extent to which performance on commonsense benchmarks predicts downstream perfor

applicationsarxiv-cs-cl