Search: “evaluation”

Instance-dependent Stochastic Lipschitz bandit

arXiv:2605.29748v1 Announce Type: cross Abstract: We study the Lipschitz bandit problem, where a learner sequentially maximizes an unknown Lipschitz function f over a domain X subset [0,1]^d using noi

Interactive In-Meeting Speaker Correction with Human Feedback

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2509.18377v2 Announce Type: replace Abstract: Most automatic speech processing systems operate in ``open loop'' mode without user feedback about who said what, yet human-in-the-loop workflows ca

researcharxiv-cs-cl

29 May 2026

It’s a good day when the Pope vouches for your recent comment in Nature.

It’s a good day when the Pope vouches for your recent comment in Nature. The Pope is making exactly our point. LLMs “may imitate or even simulate, but they do not understand.” This is the core epistem

safetygary-marcus--x

Jailbreaking and Mitigation of Vulnerabilities in Large Language Models

arXiv:2410.15236v4 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have transformed artificial intelligence by advancing natural language understanding and generation, enabling app

K-FinHallu: A Hallucination Detection Benchmark for Multi-Turn RAG in Korean Finance

model-releasesarxiv-cs-lg

arXiv:2605.29523v1 Announce Type: new Abstract: Large Language Models (LLMs) have advanced financial automation through Retrieval-Augmented Generation (RAG), yet hallucinations remain a critical barri

Label-Free Reinforcement Learning via Cross-Model Entropy

arXiv:2605.29009v1 Announce Type: cross Abstract: Post-training large language models with reinforcement learning is bottlenecked by the reward signal. Existing approaches require either ground-truth

LaRA: Layer-wise Representation Analysis for Detecting Data Contamination in RL Post-Training

arXiv:2605.29888v1 Announce Type: cross Abstract: Reinforcement learning (RL) post-training has shown to improve reasoning in large language models (LLMs). However, there has been little exploration o

Tutorials

Learnable Assessment Skills for LLM-based Automated Scoring: Rubric Construction via Iterative Optimization

arXiv:2605.29274v1 Announce Type: new Abstract: LLM-based automated scoring approaches near-human performance, but scaling to new tasks remains bottlenecked by the per-item human configuration of upst

tutorialsarxiv-cs-cl

Learning Design Skills as Memory Policies for Agentic Photonic Inverse Design

model-releasesarxiv-cs-cl

arXiv:2605.29421v1 Announce Type: new Abstract: Photonic crystal fiber (PCF) inverse design remains challenging because candidate geometries must satisfy coupled optical targets under expensive electr

Learning to Choose: An Empowerment-Guided Multi-Agent System with semantic communication for Adaptive Method Selection

arXiv:2605.30042v1 Announce Type: new Abstract: Automating scientific computing workflows requires more than generating executable code: autonomous systems must also select appropriate computational s

LiveSVG: Zero-Shot SVG Animation via Video Generation

model-releasesarxiv-cs-cv

arXiv:2605.30174v1 Announce Type: new Abstract: We introduce LiveSVG, a zero-shot approach for generating Scalable Vector Graphics (SVG) animations using video diffusion models. Current SVG animation

MarginGate: Sparse Margin-Triggered Verification for Batch-Invariant LLM Inference

model-releasesarxiv-cs-lg

arXiv:2605.30218v1 Announce Type: new Abstract: Temperature-zero BF16 LLM inference is often treated as reproducible, yet the same request can emit different tokens when decoded alone or inside a larg

MechELK: A Mechanistic Interpretability Framework for Eliciting Latent Knowledge in Large Language Models

model-releasesarxiv-cs-cl

arXiv:2605.28825v1 Announce Type: new Abstract: Large language models (LLMs) frequently encode factual and reasoning knowledge in their internal representations that is not faithfully reflected in the

Tutorials

MEMENTO: Leveraging Web as a Learning Signal for Low-Data Domains

arXiv:2605.29795v1 Announce Type: new Abstract: Real-world tasks often lack large labeled datasets, motivating extensive work on learning in low-data regimes. However, existing approaches such as few-

tutorialsarxiv-cs-ai

Mind Your Tone: Does Tone Alter LLM Performance?

arXiv:2605.29027v1 Announce Type: new Abstract: The use of Large Language Models (LLMs) is proliferating, yet their performance is observed to vary based on prompting styles and tones. In this study,

Mindscape-Aware Retrieval Augmented Generation for Improved Long Context Understanding

arXiv:2512.17220v2 Announce Type: replace Abstract: Humans understand long and complex texts by relying on a holistic semantic representation of the content. This global view helps organize prior know

researcharxiv-cs-cl

MIRA: Mid-training Rubric Anchoring for Source-Aware Data Selection

arXiv:2605.30288v1 Announce Type: new Abstract: Mid-training has become an important stage in modern LLM development, using large-scale curated mixtures to strengthen capabilities before final post-tr

Mitigating Stethoscope-Induced Shortcuts in Respiratory Sound Classification under Federated Domain Generalization with Causality-Inspired Interventions

arXiv:2605.29862v1 Announce Type: cross Abstract: AI-driven respiratory sound classification (RSC) is promising for automated pulmonary disease detection, yet multi-site deployment is hindered by inte

Mixing Vector Model for Copolymer Inference via Mixed Integer Linear Programming

arXiv:2605.29329v1 Announce Type: cross Abstract: A novel two-phase molecule inference framework, mol-infer, has recently been developed to infer chemical graphs with prescribed abstract structures an

Momentum Based Reward Design for Low Emission Traffic Signal Control

arXiv:2605.29693v1 Announce Type: new Abstract: Urban traffic congestion is a growing global issue contributing significantly to long commute times and environmental pollution. Traditional traffic sig

Tutorials

MonoDuo: Using One Robot Arm to Learn Bimanual Policies

arXiv:2605.29298v1 Announce Type: new Abstract: Bimanual coordination is essential for many real-world manipulation tasks, yet learning bimanual robot policies is limited by the scarcity of bimanual r

tutorialsarxiv-cs-ro

MonoPhysics: Estimating Geometry, Appearance, and Physical Parameters from Monocular Videos

arXiv:2605.30320v1 Announce Type: new Abstract: Existing inverse physics methods recover physical parameters from multi-view videos, where geometric constraints across views resolve scale and 3D struc

safetyarxiv-cs-cv

Agents

MOOSE-Copilot: A Web-Based Interactive Assistant for Unified Exploratory and Fine-Grained Scientific Hypothesis Discovery

arXiv:2605.29475v1 Announce Type: cross Abstract: Large language models (LLMs) show remarkable potential in scientific hypothesis discovery. However, existing approaches face two critical limitations:

agentsarxiv-cs-ai

Motion-guided sparse correction enables expert-quality point tracking across diverse microscopy regimes

arXiv:2605.29220v1 Announce Type: new Abstract: Tracking the dynamics of non-canonical biological systems in microscopy videos remains a persistent challenge. Both classical and learning-based tracker

applicationsarxiv-cs-cv

Multi-Resolution End-to-End Deep Neural Network for Optimizing Latency-Accuracy Tradeoff in Autonomous Driving

arXiv:2605.29138v1 Announce Type: cross Abstract: Latency-accuracy tradeoffs are fundamental in real-time applications of deep neural networks (DNNs) for cyber-physical systems. In autonomous driving,

Multifingered force-aware control for humanoid robots

arXiv:2603.08142v2 Announce Type: replace Abstract: In this paper, we address force-aware control and force distribution in robotic platforms with multi-fingered hands. Given a target goal and force e

researcharxiv-cs-ro

MuPHI: Learning Implicit Multimodal Harm Reasoning via Semantically Grounded Reward Optimization

arXiv:2605.29951v1 Announce Type: new Abstract: Understanding how harm emerges from interaction between otherwise benign image-text pairs requires intent-aware cross-modal reasoning beyond surface-lev

MusTBENCH: Benchmarking and Advancing Temporal Grounding in Music LLMs

arXiv:2605.29300v1 Announce Type: cross Abstract: Recent Large Audio-Language Models (LALMs) have demonstrated promising abilities in understanding musical content. However, whether their responses ar

Noise-Aware Differentially Private Variational Inference

arXiv:2410.19371v3 Announce Type: replace-cross Abstract: Differential privacy (DP) provides robust privacy guarantees for statistical inference, but this can lead to unreliable results and biases in

OccamToken: Efficient VLM Inference with Training-Free and Budget-Adaptive Token Pruning

arXiv:2605.29657v1 Announce Type: cross Abstract: Vision-language models (VLMs) rely on long visual token sequences for visual understanding, making the prefill stage expensive in both computation and

Agents

Offloading Score: Measuring AI Reliance Through Counterfactual Workflows

arXiv:2605.29392v1 Announce Type: cross Abstract: AI tools are increasingly integrated into real-world workflows. However, existing measures of reliance on these tools focus on AI output adoption or o

agentsarxiv-cs-cl

OmniMatBench: A Human-Calibrated Multimodal Reasoning Benchmark Across 19 Materials Science Subfields

arXiv:2605.29833v1 Announce Type: new Abstract: As multimodal language models play an increasingly important role in scientific research, materials science offers a critical testbed due to its interdi

OpenClawBench: Benchmarking Process-side Anomalies in Real-world Agent Execution Trajectories

arXiv:2605.29253v1 Announce Type: new Abstract: Task success can hide process anomalies in real-world agent executions. An agent may pass the final task oracle while still accumulating unresolved ambi

Opir: Efficient Multi-Task Safety Classification for Toxicity, Jailbreaks, Hate Speech, and Harmful Content

arXiv:2605.29659v1 Announce Type: cross Abstract: Real-time safety filtering for large language model (LLM) applications requires classifiers that can detect unsafe prompts, toxic language, jailbreak

Opt-Verifier: Unleashing the Power of LLMs for Optimization Modeling via Dual-Side Verification

arXiv:2605.29556v1 Announce Type: new Abstract: Building mathematical optimization models is critical in operations research (OR), while it requires substantial human expertise. Recent advancements ha

Optimization and Generation in Aerodynamics Inverse Design

arXiv:2602.03582v3 Announce Type: replace Abstract: Aerodynamic inverse design can improve vehicle and aircraft efficiency, but practical design rarely seeks performance alone: vehicle refinement must

Orthogonal Negative Guidance in Attention Feature Space for Text-to-Image Generation

arXiv:2605.29390v1 Announce Type: new Abstract: Text-to-image (T2I) models have become increasingly capable of generating high-quality images. Yet, enforcing the explicit absence of a specified object

safetyarxiv-cs-cv

OVA-IB: One vs All Information Bottleneck for Multi-Modal Alignment

model-releasesarxiv-cs-lg

arXiv:2605.29900v1 Announce Type: new Abstract: Contrastive learning is effective for aligning paired views or modalities, but alignment beyond two modalities remains non-trivial and comparatively und

PARCEL: Pool-Anchored Resampling with Conditioned Elastic Queries for Efficient Vision-Language Understanding

arXiv:2605.30126v1 Announce Type: cross Abstract: Large Vision-Language Models (LVLMs) map visual inputs into dense token sequences, imposing a quadratic computational bottleneck for inference. Elasti

applicationsarxiv-cs-ai

ParCo-SDF: Learning Prior-Free Partial-to-Complete Signed Distance Fields of Deformable Objects

arXiv:2605.29417v1 Announce Type: new Abstract: This study addresses the partial-to-complete geometry reconstruction of deformable objects (DOs) from point-cloud observations toward precise DO manipul

researcharxiv-cs-cv

PassNet: Scaling Large Language Models for Graph Compiler Pass Generation

arXiv:2605.29357v1 Announce Type: new Abstract: Modern tensor compilers such as TorchInductor deliver substantial speedups on mainstream models, yet face a systematic performance ceiling on long-tail

applicationsarxiv-cs-ai

Path-Space Mirror Descent for On-Policy Reinforcement Learning under the Generalized Schrodinger Bridge

arXiv:2603.21621v2 Announce Type: replace Abstract: Classical on-policy algorithms such as PPO and mirror descent policy optimization provide stable proximal policy updates through tractable action li

safetyarxiv-cs-lg

PEARL: Training Socratic Tutors with Pedagogically Aligned Reinforcement Learning

arXiv:2605.29582v1 Announce Type: cross Abstract: Large Language Models (LLMs) have shown promise as educational tutors, yet effective tutoring requires more than solving problems: it must provide pro

safetyarxiv-cs-cl

PersonaAgent: Bridging Memory and Action for Personalized LLM Agents

arXiv:2506.06254v2 Announce Type: replace Abstract: Large Language Model (LLM) empowered agents have recently emerged as advanced paradigms that exhibit impressive capabilities in a wide range of doma

Physics Is All You Need? A Case Study in Physicist-Supervised AI Development of Scientific Software

arXiv:2605.30353v1 Announce Type: new Abstract: Are AI agents tools, co-authors, or researchers? We present a quantified case study (N=1): a physicist supervising an AI coding agent (Claude Code, Sonn

Position: Text Embeddings Should Capture Implicit Semantics, Not Just Surface Meaning

arXiv:2506.08354v2 Announce Type: replace-cross Abstract: This position paper argues that text embedding research should move beyond surface meaning and embrace implicit semantics as a central modelin

applicationsarxiv-cs-ai

Practitioner Beliefs and Behaviors in AI-Enhanced Education: DOT Framework Survey Evidence

arXiv:2605.29041v1 Announce Type: new Abstract: This study reports findings from a cross-sectional survey (n = 72) of higher education practitioners examining beliefs, behaviors, and institutional con

PRAIB: Peer Review AI Benchmark of Behaviour of LLM-Assisted Reviewing

arXiv:2605.29815v1 Announce Type: new Abstract: The growing number of submitted papers has motivated the exploration of Large Language Models (LLMs) as a means to support and augment the peer review p