Search: “evaluation”

A Scalable Tool for Measuring Manner and Result Verbs in Developmental Language Research

arXiv:2605.16654v1 Announce Type: cross Abstract: Manner and result verbs encode different aspects of event structure and have been discussed in developmental work as a potentially informative distinc

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

A2RBench: An Automatic Paradigm for Formally Verifiable Abstract Reasoning Benchmark Generation

DGX agent

arXiv:2605.17278v1 Announce Type: new Abstract: Abstract reasoning ability reflects the intelligence and generalization capacity of LLMs to extract and apply abstract rules. However, accurately measur

model-releasesarxiv-cs-ai

19 May 2026

Applications

An Analytical Multiple Criteria Framework for Temporal and Dynamic Business-to-Business Customer Segmentation in Manufacturing

arXiv:2605.17151v1 Announce Type: new Abstract: In sales and marketing, customer segmentation is an important tool for formulating strategies for customer treatment and supply chain management. Most s

applicationsarxiv-cs-lg

An Efficient Machine Learning-based Framework for Detection and Prevention of Frauds in Telecom Networks

arXiv:2605.17245v1 Announce Type: cross Abstract: Telecommunication fraud is an acute problem that leads to substantial material losses and compromises the reliability of telecom systems worldwide. On

researcharxiv-cs-lg

Are Sparse Autoencoder Benchmarks Reliable?

arXiv:2605.18229v1 Announce Type: cross Abstract: Sparse autoencoders (SAEs) are a core interpretability tool for large language models, and progress on SAE architectures depends on benchmarks that re

ArtifactLinker: Linking Scientific Artifacts for Automatic State-of-the-Art Discovery

model-releasesarxiv-cs-lg

arXiv:2605.16902v1 Announce Type: new Abstract: Scientific artifacts such as models and datasets are foundations for research. With the rapid growth of platforms like HuggingFace, researchers now have

Artificial Intelligence can Recognize Whether a Job Applicant is Selling and/or Lying According to Facial Expressions and Head Movements Much More Correctly Than Human Interviewers

arXiv:2605.17461v1 Announce Type: cross Abstract: Whether an interviewee's honest and deceptive responses can be detected by facial expression signals in videos has been debated and requires further r

Attention-Guided Fusion of 1D and 2D CNNs for Robust ECG-Based Biometric Recognition

arXiv:2605.17685v1 Announce Type: cross Abstract: Electrocardiogram (ECG)-based biometric recognition has emerged as a promising solution for secure authentication and liveness detection. However, mos

Tutorials

Automated Knowledge Component Generation for Interpretable Knowledge Tracing in Coding Problems

arXiv:2502.18632v4 Announce Type: replace Abstract: Knowledge components (KCs) mapped to problems help model student learning, tracking their mastery levels on fine-grained skills thereby facilitating

tutorialsarxiv-cs-ai

AutoRubric-T2I: Robust Rule-Based Reward Model for Text-to-Image Alignment

arXiv:2605.17602v1 Announce Type: new Abstract: Aligning Text-to-Image (T2I) generation models with human preferences increasingly relies on image reward models that score or rank generated images acc

Applications

Beyond Imperfect Alternatives with Rulemapping: A Neuro-Symbolic Case Study on Online Hate Speech

arXiv:2605.16280v1 Announce Type: cross Abstract: Automating legal reasoning forces a choice between imperfect alternatives: symbolic systems offer transparency but struggle with ambiguity, whereas ne

applicationsarxiv-cs-ai

Beyond Inference-Time Search: Reinforcement Learning Synthesizes Reusable Solvers

arXiv:2605.18374v1 Announce Type: cross Abstract: Large language models (LLMs) typically approach combinatorial optimization as an inference-time procedure, solving each instance separately through sa

Can LLMs Refuse Questions They Do Not Know? Measuring Knowledge-Aware Refusal in Factual Tasks

arXiv:2510.01782v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) should refuse to answer questions beyond their knowledge. This capability, which we term knowledge-aware refusal,

CatalyticMLLM: A Graph-Text Multimodal Large Language Model for Catalytic Materials

arXiv:2605.17254v1 Announce Type: new Abstract: Property prediction and inverse structural design of catalytic materials are typically modeled as two independent tasks: the former predicts target prop

Causely: A Causal Intelligence Layer for Enterprise AI A Benchmark Study on SRE and Reliability Workflows

arXiv:2605.18327v1 Announce Type: new Abstract: AI agents deployed into SRE workflows currently derive their understanding of environment state from raw observability telemetry at query time, paying a

Tutorials

CAVE: A Structured Credit Assignment Approach for Fragmented Visual Evidence Reasoning

arXiv:2605.16416v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) have achieved strong performance on general multimodal reasoning, yet remain challenged in integrating nonlocal visual i

tutorialsarxiv-cs-ai

ChemVA: Advancing Large Language Models on Chemical Reaction Diagrams Understanding

arXiv:2605.17214v1 Announce Type: new Abstract: While Large Language Models (LLMs) have revolutionized scientific text processing, they exhibit a significant capability gap when interpreting chemical

Compositional Adversarial Training for Robust Visual Watermarking

arXiv:2605.16720v1 Announce Type: new Abstract: Robust watermarking is typically trained with random post-processing augmentation, but random sampling under-covers the combinatorial space of realistic

Conservative AI for Safety-Sensitive Medical Image Restoration: Residual-Bounded CT-CTA Enhancement for Intracranial Aneurysm-Relevant Signal Recovery

arXiv:2605.16458v1 Announce Type: cross Abstract: Image restoration models are increasingly applied to degraded medical scans, but in safety-sensitive settings they must improve image quality without

Constrained Policy Optimization via Sampling-Based Weight-Space Projection

model-releasesarxiv-cs-lg

arXiv:2512.13788v2 Announce Type: replace Abstract: Safety-critical learning requires policies that improve performance without leaving the safe operating regime. We study constrained policy learning

Continual Learning for VLMs: A Survey and Taxonomy Beyond Forgetting

arXiv:2508.04227v2 Announce Type: replace Abstract: Vision-language models (VLMs) and the recent surge of Multimodal Large Language Models (MLLMs) have revolutionized artificial intelligence with unpr

CooT: Learning to Coordinate In-Context with Coordination Transformers

arXiv:2506.23549v3 Announce Type: replace Abstract: Effective coordination among unfamiliar partners remains a major challenge in multi-agent systems. Existing approaches, such as population-based met

DASH: A Meta-Attack Framework for Synthesizing Effective and Stealthy Adversarial Examples

arXiv:2508.13309v3 Announce Type: replace Abstract: Numerous techniques have been proposed for generating adversarial examples in white-box settings under strict Lp-norm constraints. However, such nor

Deep Learning for MRI Slice Interpolation: The Critical Role of Problem Formulation

arXiv:2605.16476v1 Announce Type: cross Abstract: Through-plane resolution in clinical MRI is typically much coarser than in-plane resolution, limiting diagnostic utility. This work investigates deep

DepthPolyp: Pseudo-Depth Guided Lightweight Segmentation for Real-Time Colonoscopy

arXiv:2605.16519v1 Announce Type: new Abstract: Accurate polyp segmentation in colonoscopy is essential for early colorectal cancer detection, yet real-world clinical environments pose persistent chal

DeTrack: A Benchmark and Altitude-Aware Dual World Model for Drone-embodied Tracking

arXiv:2605.17451v1 Announce Type: new Abstract: Aerial object tracking has broad applications in public safety, emergency rescue, wildlife monitoring, and related fields. However, existing aerial trac

DiRotQ: Rotation-Aware Quantization for 4-bit Diffusion Transformers

arXiv:2605.16732v1 Announce Type: new Abstract: Diffusion Transformers (DiTs) achieve state-of-the-art image generation quality but incur substantial memory and computational costs at inference. While

safetyarxiv-cs-cv

Dual-Rate Diffusion: Accelerating diffusion models with an interleaved heavy-light network

arXiv:2605.18190v1 Announce Type: cross Abstract: Diffusion models achieve state-of-the-art generative performance but suffer from high computational costs during inference due to the repeated evaluat

ECG-WM: A Physiology-Informed ECG World Model for Clinical Intervention Simulation

arXiv:2605.17580v1 Announce Type: new Abstract: Electrocardiogram (ECG)-based models have achieved strong performance in diagnostic tasks, yet they remain limited in modeling how cardiac dynamics evol

Edge-AI-Driven Learning-to-Rank for Decentralized Task Allocation in Circular Smart Manufacturing

arXiv:2605.16433v1 Announce Type: cross Abstract: Task allocation in smart manufacturing systems needs to operate under decentralized decision-making, dynamic workloads, and shared resource constraint

Efficient Lookahead Encoding and Abstracted Width for Learning General Policies in Classical Planning

arXiv:2605.18674v1 Announce Type: new Abstract: Generalized planning aims to learn policies that generalize across collections of instances within a classical planning domain. Recent Graph Neural Netw

EPIC-Bench: A Perception-Centric Benchmark for Fine-Grained Embodied Visual Grounding in Vision-Language Models

arXiv:2605.17070v1 Announce Type: new Abstract: While large vision-language models (VLMs) are increasingly adopted as the perceptual backbone for embodied agents, existing benchmarks often rely on que

Episodic-Semantic Memory Architecture for Long-Horizon Scientific Agents

arXiv:2605.17625v1 Announce Type: new Abstract: As Large Language Models (LLMs) evolve into persistent scientific collaborators, context window saturation has emerged as a critical bottleneck. Scienti

Applications

Exploring Lightweight Large Language Models for Court View Generation

arXiv:2605.16770v1 Announce Type: cross Abstract: Criminal Court View Generation (CVG) is a critical task in Legal Artificial Intelligence (Legal AI), involving the generation of court view based on c

applicationsarxiv-cs-ai

Extracting latent representations from X-ray spectra. Classification, regression, and accretion signatures of Chandra sources

arXiv:2510.14102v2 Announce Type: replace-cross Abstract: Spectral signatures are crucial in the era of large X-ray surveys. Automatic machine learning methods have proven useful in this respect, but

FinTagging: Benchmarking LLMs for Extracting and Structuring Financial Information

arXiv:2505.20650v5 Announce Type: replace-cross Abstract: Accurate interpretation of numerical data in financial reports is critical for markets and regulators. Although XBRL (eXtensible Business Repo

Forecasting Downstream Performance of LLMs With Proxy Metrics

arXiv:2605.18607v1 Announce Type: new Abstract: Progress in language model development is often driven by comparative decisions: which architecture to adopt, which pretraining corpus to use, or which

researcharxiv-cs-cl

FormuLLA: A Large Language Model Approach to Generating Novel 3D Printable Formulations

arXiv:2601.02071v3 Announce Type: replace Abstract: Pharmaceutical three-dimensional (3D) printing is an advanced fabrication technology with the potential to enable truly personalised dosage forms. R

From Imitation to Interaction: Mastering Game of Schnapsen with Shallow Reinforcement Learning

arXiv:2605.17162v1 Announce Type: new Abstract: This paper investigates whether shallow neural network agents can master the card game Schnapsen and challenge a strong search-based baseline, RdeepBot,

Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulation

arXiv:2602.20200v2 Announce Type: replace-cross Abstract: Hierarchical Vision-Language-Action (VLA) models have rapidly become a dominant paradigm for robotic manipulation. It typically comprising a V

Agents

GRASP: Graph Agentic Search over Propositions for Multi-hop Question Answering

arXiv:2605.16598v1 Announce Type: cross Abstract: Agentic retrieval improves multi-hop question answering by giving language models autonomy to iteratively gather evidence. Recent work augments these

agentsarxiv-cs-ai

Tutorials

GUIDE-VAE: Advancing Data Generation with User Information and Pattern Dictionaries

arXiv:2411.03936v2 Announce Type: replace Abstract: Generative modelling of multi-user datasets has become prominent in science and engineering. Generating a data point for a given user requires emplo

tutorialsarxiv-cs-lg

Haptic Rendering of Fractional-Order Viscoelasticity: Passivity and Rendering Fidelity

arXiv:2605.16389v1 Announce Type: cross Abstract: Haptic rendering of viscoelastic materials that exhibit creep and stress relaxation is crucial for many applications, such as medical training with re

Helpful to a Fault: Measuring Illicit Assistance in Multi-Turn, Multilingual LLM Agents

arXiv:2602.16346v3 Announce Type: replace Abstract: LLM-based agents execute real-world workflows via tools and memory. These affordances enable ill-intended adversaries to also use these agents to ca

safetyarxiv-cs-cl

Helping Customers in Distress: An LLM-powered Agent that Converses, Probes, and Routes

arXiv:2605.16268v1 Announce Type: cross Abstract: Banks receive millions of reports of fraud, scams, and disputed transactions every year, making it challenging to accurately direct customers to the a

HexagonalWarriorMamba: Superior Threshold-Dependent Multi-label Classification of 12-Lead ECG Cardiac Abnormalities

arXiv:2605.17875v1 Announce Type: new Abstract: The accurate automated diagnosis of cardiac abnormalities from 12-lead electrocardiograms (ECGs) is critical for managing cardiovascular disease. Howeve

How Good LLMs Are at Answering Bangla Medical Visual Questions? Dataset and Benchmarking

model-releasesarxiv-cs-cl

arXiv:2605.18111v1 Announce Type: new Abstract: Recent advancements in Large Language Models (LLMs) and Large Vision Language Models (LVLMs) have enabled general-purpose systems to demonstrate promisi

'I'm Not Mad, Just Focused'': Understanding Human Emotions in Human-Robot Collaboration

arXiv:2605.16816v1 Announce Type: new Abstract: Human-robot collaboration (HRC) can benefit from robots' abilities to interpret human emotional states. However, current emotion recognition (ER) models

safetyarxiv-cs-ro