Search: “evaluation”

RAG-based EEG-to-Text Translation Using Deep Learning and LLMs

arXiv:2605.17503v1 Announce Type: new Abstract: The decoding of linguistic information from electroencephalography (EEG) signals remains an extremely challenging problem in brain-computer interface (B

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Reducing Hallucination in Vision-Language Models via Stage-wise Preference Optimization under Distribution Shift

DGX agent

arXiv:2605.16411v1 Announce Type: cross Abstract: Hallucination remains a fundamental challenge in vision-language models (VLMs), where autoregressive generation may produce linguistically plausible y

applicationsarxiv-cs-ai

19 May 2026

Local Ai

Robo-Cortex: A Self-Evolving Embodied Agent via Dual-Grain Cognitive Memory and Autonomous Knowledge Induction

arXiv:2605.18729v1 Announce Type: cross Abstract: The ability to navigate and interact with complex environments is central to real-world embodied agents, yet navigation in unseen environments remains

local-aiarxiv-cs-cv

Local Ai

SeamCam: Quantifying Seamless Camouflage via Multi-Cue Visual Detectability

arXiv:2605.16515v1 Announce Type: new Abstract: Animals are described as effectively camouflaged when they blend seamlessly with their surrounding, yet no standardized quantitative measure of this sea

local-aiarxiv-cs-cv

Sequential Structure in Intraday Futures Data: LSTM vs Gradient Boosting on MNQ

arXiv:2605.17724v1 Announce Type: cross Abstract: This paper compares gradient boosting and long short-term memory (LSTM) architectures for intraday directional prediction in Micro E-Mini Nasdaq 100 f

applicationsarxiv-cs-lg

Simple Approximation and Derivative Free Inference-Time Scaling for Diffusion Models via Sequential Monte Carlo on Path Measures

arXiv:2605.17850v1 Announce Type: cross Abstract: iffusion-based generative models increasingly rely on inference-time guidance, adding a drift term or reweighting mixture of experts, to improve sampl

safetyarxiv-cs-cv

Skills on the Fly: Test-Time Adaptive Skill Synthesis for LLM Agents

arXiv:2605.16986v1 Announce Type: cross Abstract: LLM agents benefit from reusable skills, yet test-time tasks often require guidance more specific than a static skill library can provide. We propose

SocialMemBench: Are AI Memory Systems Ready for Social Group Settings?

arXiv:2605.17789v1 Announce Type: cross Abstract: Memory systems for AI assistants were built for single-user dialogue and fail characteristically when applied to multi-party social group settings. Th

Stabilizing Temporal Inference Dynamics for Online Surgical Phase Recognition

arXiv:2605.16387v1 Announce Type: cross Abstract: Online Surgical Phase Recognition (SPR) models can reach high frame-wise accuracy, yet their predictions often lack temporal stability, fragmenting wo

StreamPro: From Reactive Perception to Proactive Decision-Making in Streaming Video

arXiv:2605.16381v1 Announce Type: cross Abstract: Proactive streaming video understanding requires models to continuously process video streams and decide when to respond, rather than merely what to r

Stress-Testing Neural Network Verifiers with Provably Robust Instances

arXiv:2605.17153v1 Announce Type: new Abstract: Neural network verifiers aim to provide formal guarantees on model behavior, but existing verification benchmarks are fundamentally limited by their lac

researcharxiv-cs-lg

StyleText: A Large-Scale Dataset and Benchmark for Stylized Scene Text Inpainting

arXiv:2605.17309v1 Announce Type: cross Abstract: We present StyleText, a large-scale dataset and benchmark for localized scene-text inpainting with style preservation. StyleText contains 28,518 image

SURGE: Approximation-free Training Free Particle Filter for Diffusion Surrogate

arXiv:2605.18745v1 Announce Type: cross Abstract: Diffusion-based generative models increasingly rely on inference-time guidance, adding a drift term or reweighting mixture of experts, to improve samp

safetyarxiv-cs-lg

TabH2O: A Unified Foundation Model for Tabular Prediction

model-releasesarxiv-cs-lg

arXiv:2605.18383v1 Announce Type: new Abstract: We present TabH2O, a foundation model for tabular data that performs classification and regression in a single forward pass via in-context learning. Tab

TaskGround: Structured Executable Task Inference for Full-Scene Household Reasoning

arXiv:2605.18109v1 Announce Type: new Abstract: In real home deployments, household agents must often operate from a complete household scene and a situated household request, rather than from a clean

Text2CAD-Bench: A Benchmark for LLM-based Text-to-Parametric CAD Generation

model-releasesarxiv-cs-lg

arXiv:2605.18430v1 Announce Type: new Abstract: Text-to-CAD generation aims to create parametric CAD models from natural language, enabling rapid prototyping and intuitive design workflows. However, e

The MixCount Dataset: Bridging the Data Gap for Open-Vocabulary Object Counting

arXiv:2605.18063v1 Announce Type: new Abstract: Object counting is a foundational vision task with over a decade of dedicated research, yet state-of-the-art models still fail systematically in the mix

TIGER-FG: Text-Guided Implicit Fine-Grained Grounding for E-commerce Retrieval

arXiv:2605.18434v1 Announce Type: cross Abstract: E-commerce image search often takes a cropped image as the query, while each candidate is represented by full item images and structured text. This im

Towards Robust Argumentative Essay Understanding via TIDE: An Interactive Framework with Trial and Debate

arXiv:2605.17247v1 Announce Type: new Abstract: Argumentative essays serve as a vital medium for assessing critical thinking and reasoning skills, yet there is limited works on accurately understandin

TRACE: Trajectory Correction from Cross-layer Evidence for Hallucination Reduction

arXiv:2605.18163v1 Announce Type: new Abstract: Hallucination correction is not a one-direction problem. We show that intermediate layers are neither uniformly more truthful than final layers nor unif

Trustworthiness in Retrieval-Augmented Generation Systems: A Survey

arXiv:2409.10102v2 Announce Type: replace-cross Abstract: Retrieval-Augmented Generation (RAG) has quickly grown into a pivotal paradigm in the development of Large Language Models (LLMs). Although ex

TusoAI: Agentic Optimization for Scientific Methods

arXiv:2509.23986v2 Announce Type: replace Abstract: Scientific discovery is often slowed by the manual development of computational tools needed to analyze complex experimental data. Building such too

UAVFF3D: A Geometry-Aware Benchmark for Feed-Forward UAV 3D Reconstruction

arXiv:2605.17942v1 Announce Type: new Abstract: Feed-forward 3D reconstruction has recently demonstrated strong generalization across diverse scenes, yet its performance in UAV imagery remains underex

UbuntuGuard: A Culturally-Grounded Policy Benchmark for Equitable AI Safety in African Languages

model-releasesarxiv-cs-cl

arXiv:2601.12696v2 Announce Type: replace Abstract: Current guardian models are predominantly Western-centric and optimized for high-resource languages, leaving low-resource African languages vulnerab

UniER: A Unified Benchmark for Item-level and Path-level Exercise Recommendation

arXiv:2605.16750v1 Announce Type: cross Abstract: Personalized exercise recommendation dynamically aligns pedagogical resources with individual knowledge mastery, which is crucial for satisfying stude

Unlearning Isn't Deletion: Investigating Reversibility of Machine Unlearning in LLMs

arXiv:2505.16831v3 Announce Type: replace-cross Abstract: Unlearning in large language models (LLMs) aims to remove specified data, but its efficacy is typically assessed with task-level metrics like

Unleashing the Potential of Diffusion Models for End-to-End Autonomous Driving

arXiv:2602.22801v2 Announce Type: replace-cross Abstract: Diffusion models have become a popular choice for decision-making tasks in robotics, and more recently, are also being considered for solving

Validate Your Authority: Benchmarking LLMs on Multi-Label Precedent Treatment Classification

arXiv:2605.17691v1 Announce Type: cross Abstract: Automating the classification of negative treatment in legal precedent is a critical yet nuanced NLP task where misclassification carries significant

Verifier-Guided Code Translation via Meta-Step Decoding

model-releasesarxiv-cs-lg

arXiv:2605.17626v1 Announce Type: new Abstract: Test-time scaling is an important mechanism for improving large language models, especially on tasks with deterministic verifiers. Code translation is a

What Matters for Grocery Product Retrieval with Open Source Vision Language Models

arXiv:2605.18029v1 Announce Type: new Abstract: Multimodal product retrieval (MPR) underpins checkout-free retail and automated inventory systems, yet it demands fine-grained SKU discrimination that s

researcharxiv-cs-cv

White-Box Sensitivity Auditing with Steering Vectors

arXiv:2601.16398v2 Announce Type: replace-cross Abstract: Algorithmic audits are essential tools for examining systems for properties required by regulators or desired by operators. Current audits of

safetyarxiv-cs-cl

WinDeskGround: A Benchmark for Robust GUI Grounding in Complex Multi-Window Desktop Environments

arXiv:2605.16402v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have revolutionized GUI automation, yet their efficacy is largely established on idealized, single-layer interf

World Model-Enabled Causal Digital Twins for Semantic Communications in Physical AI Systems

arXiv:2605.16547v1 Announce Type: new Abstract: Semantic communication has emerged as a promising paradigm for enabling goal-oriented networking. However, most existing semantic communication solution

safetyarxiv-cs-lg

Zero-Shot Faithful Textual Explanations via Directional-Derivative Influence on Predictions

arXiv:2605.16877v1 Announce Type: new Abstract: Zero-shot textual explanations aim to make image classifiers more transparent by probing their internal representations, without relying on task-specifi

3D Segmentation Using Viewpoint-Dependent Spatial Relationships

arXiv:2605.15708v1 Announce Type: new Abstract: Recent advances in 3D datasets and multimodal models have greatly improved natural language 3D scene understanding. However, most 3D referring segmentat

A QUBO Formulation Framework for Kinematic Structure-Based Robot Design Optimization: A Robotic Hand Case Study

arXiv:2605.15510v1 Announce Type: new Abstract: This paper presents a quadratic unconstrained binary optimization-based formulation framework for robot design optimization using kinematic structure-le

applicationsarxiv-cs-ro

Adesua: Development and Feasibility Study of an AI WhatsApp Bot for Science Learning in West Africa

arXiv:2605.15376v1 Announce Type: new Abstract: Sub-Saharan Africa faces persistently high student-teacher ratios and shortages of qualified teachers, limiting students' access to personalized learnin

applicationsarxiv-cs-cl

AirNav: A Large-Scale UAV Vision-and-Language Navigation Dataset with Natural and Diverse Instructions

model-releasesarxiv-cs-cl

arXiv:2601.03707v2 Announce Type: replace Abstract: Existing UAV vision-and-language navigation (VLN) benchmarks rarely provide realistic aerial scenes, natural process-level instructions, and suffici

ASRU: Activation Steering Meets Reinforcement Unlearning for Multimodal Large Language Models

arXiv:2605.15687v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) may memorize sensitive cross-modal information during pretraining, making machine unlearning (MU) crucial. Ex

Beyond Binary Rewards: Training LMs to Reason About Their Uncertainty

arXiv:2507.16806v2 Announce Type: replace-cross Abstract: When language models (LMs) are trained via reinforcement learning (RL) to generate natural language 'reasoning chains', their performance impr

Agents

Beyond Partner Diversity: An Influence-Based Team Steering Framework for Zero-Shot Human-Machine Teaming

arXiv:2605.15400v1 Announce Type: new Abstract: While AI agents are rapidly advancing from isolated tools to interactive collaborators, data-driven human-machine teaming (HMT) methods remain costly in

agentsarxiv-cs-ai

Beyond Performance Disparities: A Three-Level Audit of Representational Harm in CelebA

arXiv:2605.15312v1 Announce Type: cross Abstract: Large-scale facial datasets like CelebA are widely used in computer vision, yet the cultural biases embedded in their labels remain underexplored. Fai

safetyarxiv-cs-cv

Can Vision Language Models Be Adaptive in Mathematics Education? A Learner Model-based Rubric Study

arXiv:2605.16011v1 Announce Type: cross Abstract: Adaptive learning refers to educational technologies that track learners' learning progress and adapt the instructional process based on individual le

applicationsarxiv-cs-ai

CAX-Agent: A Lightweight Agent Harness for Reliable APDL Automation

arXiv:2605.15218v1 Announce Type: new Abstract: Large language models deployed for MAPDL finite-element simulation face practical reliability challenges: without structured execution control, tool enc

ChronoEarth-492K: A Large Scale and Long Horizon Spatiotemporal Hyperspectral Earth Observation Dataset and Benchmark

arXiv:2605.15666v1 Announce Type: new Abstract: Hyperspectral imaging (HSI) provides dense spectral information for the Earth's surface, enabling material-level understanding of land cover and ecosyst

CTF4Nuclear: Common Task Framework for Nuclear Fission and Fusion Models

arXiv:2605.15549v1 Announce Type: cross Abstract: The demand for clean energy is ever increasing, with new nuclear technologies presenting a complementary solution to renewable energies. However, desi

Few-Shot Large Language Models for Actionable Triage Categorization of Online Patient Inquiries

model-releasesarxiv-cs-cl

arXiv:2605.15680v1 Announce Type: new Abstract: Online patient inquiries are often informal, incomplete, and written before professional assessment, yet they must still be routed to an appropriate lev

Fluency and Faithfulness in Human and Machine Literary Translation

arXiv:2605.15282v1 Announce Type: new Abstract: Literary translation requires balancing target-language fluency with faithfulness to the source. Recent large language models (LLMs) often produce fluen

researcharxiv-cs-cl