Search: “evaluation”

LaV-CoT: Language-Aware Visual CoT with Multi-Aspect Reward Optimization for Real-World Multilingual VQA

model-releasesarxiv-cs-cv

arXiv:2509.10026v4 Announce Type: replace Abstract: As large vision language models (VLMs) advance, their capabilities in multilingual visual question answering (mVQA) have significantly improved. Cha

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Applications

LLM-Based Automated Diagnosis Of Integration Test Failures At Google

DGX agent

arXiv:2604.12108v1 Announce Type: cross Abstract: Integration testing is critical for the quality and reliability of complex software systems. However, diagnosing their failures presents significant c

applicationsarxiv-cs-ai

15 Apr 2026

LLM-Guided Prompt Evolution for Password Guessing

arXiv:2604.12601v1 Announce Type: cross Abstract: Passwords still remain a dominant authentication method, yet their security is routinely subverted by predictable user choices and large-scale credent

Tutorials

LLM-Guided Task- and Affordance-Level Exploration in Reinforcement Learning

arXiv:2509.16615v2 Announce Type: replace Abstract: Reinforcement learning (RL) is a promising approach for robotic manipulation, but it can suffer from low sample efficiency and requires extensive ex

tutorialsarxiv-cs-ro

LLMs Struggle with Abstract Meaning Comprehension More Than Expected

arXiv:2604.12018v1 Announce Type: cross Abstract: Understanding abstract meanings is crucial for advanced language comprehension. Despite extensive research, abstract words remain challenging due to t

Local-Splitter: A Measurement Study of Seven Tactics for Reducing Cloud LLM Token Usage on Coding-Agent Workloads

arXiv:2604.12301v1 Announce Type: cross Abstract: We present a systematic measurement study of seven tactics for reducing cloud LLM token usage when a small local model can act as a triage layer in fr

local-aiarxiv-cs-ai

Long-Horizon Plan Execution in Large Tool Spaces through Entropy-Guided Branching

arXiv:2604.12126v1 Announce Type: new Abstract: Large Language Models (LLMs) have significantly advanced tool-augmented agents, enabling autonomous reasoning via API interactions. However, executing m

Agents

Malice in Agentland: Down the Rabbit Hole of Backdoors in the AI Supply Chain

arXiv:2510.05159v4 Announce Type: replace-cross Abstract: While finetuning AI agents on interaction data -- such as web browsing or tool use -- improves their capabilities, it also introduces critical

agentsarxiv-cs-ai

Agents

Mathematics Teachers Interactions with a Multi-Agent System for Personalized Problem Generation

arXiv:2604.12066v1 Announce Type: new Abstract: Large language models can increasingly adapt educational tasks to learners characteristics. In the present study, we examine a multi-agent teacher-in-th

agentsarxiv-cs-ai

Meet Dynamic Individual Preferences: Resolving Conflicting Human Value with Paired Fine-Tuning

arXiv:2604.12479v1 Announce Type: new Abstract: Recent advances in large language models (LLMs) have significantly improved the alignment of models with general human preferences. However, a major cha

safetyarxiv-cs-cl

MISID: A Multimodal Multi-turn Dataset for Complex Intent Recognition in Strategic Deception Games

arXiv:2604.12700v1 Announce Type: new Abstract: Understanding human intent in complex multi-turn interactions remains a fundamental challenge in human-computer interaction and behavioral analysis. Whi

Mitigating Shortcut Learning via Feature Disentanglement in Medical Imaging: A Benchmark Study

model-releasesarxiv-cs-cv

arXiv:2602.18502v2 Announce Type: replace Abstract: Although deep learning models in medical imaging often achieve excellent classification performance, they can rely on shortcut learning, exploiting

Mixed-Integer vs. Continuous Model Predictive Control for Binary Thrusters: A Comparative Study

arXiv:2603.19796v3 Announce Type: replace-cross Abstract: Binary on/off thrusters are commonly used for spacecraft attitude and position control during proximity operations. However, their discrete na

researcharxiv-cs-ro

MolMem: Memory-Augmented Agentic Reinforcement Learning for Sample-Efficient Molecular Optimization

arXiv:2604.12237v1 Announce Type: cross Abstract: In drug discovery, molecular optimization aims to iteratively refine a lead compound to improve molecular properties while preserving structural simil

Multi-Head Residual-Gated DeepONet for Coherent Nonlinear Wave Dynamics

model-releasesarxiv-cs-lg

arXiv:2604.11972v1 Announce Type: new Abstract: Coherent nonlinear wave dynamics are often strongly shaped by a compact set of physically meaningful descriptors of the initial state. Traditional neura

Multilingual Multi-Label Emotion Classification at Scale with Synthetic Data

arXiv:2604.12633v1 Announce Type: new Abstract: Emotion classification in multilingual settings remains constrained by the scarcity of annotated data: existing corpora are predominantly English, singl

researcharxiv-cs-cl

Mutual Information Surprise: Rethinking Unexpectedness in Autonomous Systems

arXiv:2508.17403v3 Announce Type: replace Abstract: A community of researchers appears to think that a machine can be surprised and have introduced various surprise measures, principally the Shannon S

safetyarxiv-cs-lg

Narrative-Driven Paper-to-Slide Generation via ArcDeck

arXiv:2604.11969v1 Announce Type: new Abstract: We introduce ArcDeck, a multi-agent framework that formulates paper-to-slide generation as a structured narrative reconstruction task. Unlike existing m

Narrative over Numbers: The Identifiable Victim Effect and its Amplification Under Alignment and Reasoning in Large Language Models

arXiv:2604.12076v1 Announce Type: cross Abstract: The Identifiable Victim Effect (IVE) - the tendency to allocate greater resources to a specific, narratively described victim than to a statistically

NTIRE 2026 The 3rd Restore Any Image Model (RAIM) Challenge: Professional Image Quality Assessment (Track 1)

arXiv:2604.12512v1 Announce Type: cross Abstract: In this paper, we present an overview of the NTIRE 2026 challenge on the 3rd Restore Any Image Model in the Wild, specifically focusing on Track 1: Pr

NucleusAI/Nucleus-Image (Samples)

local-air-stablediffusion

The Reddit post about NucleusAI/Nucleus-Image appears to be a community showcase of sample outputs from a text-to-image generative AI model called Nucleus-Image, developed by NucleusAI. The post is sh

Observing the unobserved confounding through its effects: toward randomized trial-like estimates from real-world survival data

arXiv:2604.12137v1 Announce Type: cross Abstract: Background: Randomized controlled trials (RCTs) are costly, time-consuming, and often infeasible, while treatment-effect estimation from observational

OSC: Hardware Efficient W4A4 Quantization via Outlier Separation in Channel Dimension

arXiv:2604.12782v1 Announce Type: cross Abstract: While 4-bit quantization is essential for high-throughput deployment of Large Language Models, activation outliers often lead to significant accuracy

Parsing complex tables in PDFs is extremely challenging. Existing metrics for measuring table accuracy, like TEDS (tree edit distance simila…

model-releasesjerry-liu--x

Parsing complex tables in PDFs is extremely challenging. Existing metrics for measuring table accuracy, like TEDS (tree edit distance similarity), overweight exact table structure and underweight sema

PC-MIL: Decoupling Feature Resolution from Supervision Scale in Whole-Slide Learning

arXiv:2604.12100v1 Announce Type: new Abstract: Whole-slide image (WSI) classification in computational pathology is commonly formulated as slide-level Multiple Instance Learning (MIL) with a single g

local-aiarxiv-cs-cv

Physically Accurate Rigid-Body Dynamics in Particle-Based Simulation

model-releasesarxiv-cs-ro

arXiv:2603.14634v3 Announce Type: replace Abstract: Robotics demands simulation that can reason about the diversity of real-world physical interactions, from rigid to deformable objects and fluids. Cu

Pictorial and apictorial polygonal jigsaw puzzles from arbitrary number of crossing cuts

arXiv:2008.07644v3 Announce Type: replace-cross Abstract: Jigsaw puzzle solving, the problem of constructing a coherent whole from a set of non-overlapping unordered visual fragments, is fundamental t

Poisoning the Inner Prediction Logic of Graph Neural Networks for Clean-Label Backdoor Attacks

arXiv:2603.05004v2 Announce Type: replace-cross Abstract: Graph Neural Networks (GNNs) have achieved remarkable results in various tasks. Recent studies reveal that graph backdoor attacks can poison t

Policy-Invisible Violations in LLM-Based Agents

arXiv:2604.12177v1 Announce Type: new Abstract: LLM-based agents can execute actions that are syntactically valid, user-sanctioned, and semantically appropriate, yet still violate organizational polic

PolicyLLM: Towards Excellent Comprehension of Public Policy for Large Language Models

model-releasesarxiv-cs-cl

arXiv:2604.12995v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly integrated into real-world decision-making, including in the domain of public policy. Yet, their ability t

PR-MaGIC: Prompt Refinement Via Mask Decoder Gradient Flow For In-Context Segmentation

arXiv:2604.12113v1 Announce Type: cross Abstract: Visual Foundation Models (VFMs) such as the Segment Anything Model (SAM) have significantly advanced broad use of image segmentation. However, SAM and

PromptEcho: Annotation-Free Reward from Vision-Language Models for Text-to-Image Reinforcement Learning

arXiv:2604.12652v1 Announce Type: cross Abstract: Reinforcement learning (RL) can improve the prompt following capability of text-to-image (T2I) models, yet obtaining high-quality reward signals remai

Quantifying Cross-Modal Interactions in Multimodal Glioma Survival Prediction via InterSHAP: Evidence for Additive Signal Integration

arXiv:2603.29977v2 Announce Type: replace-cross Abstract: Multimodal deep learning for cancer prognosis is commonly assumed to benefit from synergistic cross-modal interactions, yet this assumption ha

RACF: A Resilient Autonomous Car Framework with Object Distance Correction

arXiv:2604.12418v1 Announce Type: cross Abstract: Autonomous vehicles are increasingly deployed in safety-critical applications, where sensing failures or cyberphysical attacks can lead to unsafe oper

RankOOD -- Class Ranking-based Out-of-Distribution Detection

model-releasesarxiv-cs-lg

arXiv:2511.19996v2 Announce Type: replace Abstract: We propose RankOOD, a rank-based Out-of-Distribution (OOD) detection approach based on training a model with the Placket-Luce loss, which is now ext

Reading Between the Pixels: Linking Text-Image Embedding Alignment to Typographic Attack Success on Vision-Language Models

model-releasesarxiv-cs-cv

arXiv:2604.12371v1 Announce Type: new Abstract: We study typographic prompt injection attacks on vision-language models (VLMs), where adversarial text is rendered as images to bypass safety mechanisms

Reasoning about Intent for Ambiguous Requests

arXiv:2511.10453v3 Announce Type: replace-cross Abstract: Large language models often respond to ambiguous requests by implicitly committing to one interpretation, frustrating users and creating safet

Redefining Quality Criteria and Distance-Aware Score Modeling for Image Editing Assessment

arXiv:2604.12175v1 Announce Type: new Abstract: Recent advances in image editing have heightened the need for reliable Image Editing Quality Assessment (IEQA). Unlike traditional methods, IEQA require

safetyarxiv-cs-cv

RegD: Hierarchical Embeddings via Dissimilarity between Arbitrary Euclidean Regions

arXiv:2501.17518v3 Announce Type: replace-cross Abstract: Hierarchical data is common in many domains like life sciences and e-commerce, and its embeddings often play a critical role. While hyperbolic

Replicable Reinforcement Learning with Linear Function Approximation

arXiv:2509.08660v3 Announce Type: replace Abstract: Replication of experimental results has been a challenge faced by many scientific disciplines, including the field of machine learning. Recent work

researcharxiv-cs-lg

Representing expertise accelerates learning from pedagogical interaction data

arXiv:2604.12195v1 Announce Type: new Abstract: Work in cognitive science and artificial intelligence has suggested that exposing learning agents to traces of interaction between multiple individuals

researcharxiv-cs-cl

Rethinking Satellite Image Restoration for Onboard AI: A Lightweight Learning-Based Approach

arXiv:2604.12807v1 Announce Type: cross Abstract: Satellite image restoration aims to improve image quality by compensating for degradations (e.g., noise and blur) introduced by the imaging system and

Revisiting the Reliability of Language Models in Instruction-Following

arXiv:2512.14754v2 Announce Type: replace-cross Abstract: Advanced LLMs have achieved near-ceiling instruction-following accuracy on benchmarks such as IFEval. However, these impressive scores do not

Agents

RFC: Solving the Metacognitive Deficit—A Modular Architecture for Self-Auditing and Live Weight-Correction in Agentic Systems

This Reddit post (r/ollama) proposes a community RFC (Request for Comments) discussing a modular architectural framework designed to address the 'metacognitive deficit' in agentic LLM systems — specif

agentsr-ollama

Ride the Wave: Precision-Allocated Sparse Attention for Smooth Video Generation

arXiv:2604.12219v1 Announce Type: cross Abstract: Video Diffusion Transformers have revolutionized high-fidelity video generation but suffer from the massive computational burden of self-attention. Wh

local-aiarxiv-cs-ai

RMGS-SLAM: Real-time Multi-sensor Gaussian Splatting SLAM

arXiv:2604.12942v1 Announce Type: new Abstract: Real-time 3D Gaussian splatting (3DGS)-based Simultaneous Localization and Mapping (SLAM) in large-scale real-world environments remains challenging, as

applicationsarxiv-cs-ro

Robust Explanations for User Trust in Enterprise NLP Systems

arXiv:2604.12069v1 Announce Type: cross Abstract: Robust explanations are increasingly required for user trust in enterprise NLP, yet pre-deployment validation is difficult in the common case of black

Robust Semi-Supervised Temporal Intrusion Detection for Adversarial Cloud Networks

arXiv:2604.12655v1 Announce Type: new Abstract: Cloud networks increasingly rely on machine learning based Network Intrusion Detection Systems to defend against evolving cyber threats. However, real-w

applicationsarxiv-cs-lg