Search: “evaluation”

arXiv:2604.22354v1 Announce Type: new Abstract: Each scanner possesses its unique characteristics and exhibits its distinct sampling error distribution. Training a network on a dataset that includes d

tutorialsarxiv-cs-cv

PermaFrost-Attack: Stealth Pretraining Seeding(SPS) for planting Logic Landmines During LLM Training

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2604.22117v1 Announce Type: cross Abstract: Aligned large language models(LLMs) remain vulnerable to adversarial manipulation, and their dependence on web-scale pretraining creates a subtle but

safetyarxiv-cs-ai

27 Apr 2026

PL-MTEB: Polish Massive Text Embedding Benchmark

arXiv:2405.10138v2 Announce Type: replace Abstract: In this paper, we introduce the Polish Massive Text Embedding Benchmark (PL-MTEB), a comprehensive benchmark for text embeddings in the Polish langu

Point & Grasp: Flexible Selection of Out-of-Reach Objects Through Probabilistic Cue Integration

arXiv:2604.22491v1 Announce Type: cross Abstract: Selecting out-of-reach objects is a fundamental task in mixed reality (MR). Existing methods rely on a single cue or deterministically fuse multiple c

researcharxiv-cs-ro

PSI: A Benchmark for Human Interpretation and Response in Traffic Interactions

arXiv:2112.02604v3 Announce Type: replace-cross Abstract: Accurately modeling pedestrian intention and understanding driver decision-making processes are critical for the development of safe and socia

Recognition Without Authorization: LLMs and the Moral Order of Online Advice

arXiv:2604.22143v1 Announce Type: cross Abstract: Large language models are increasingly used to mediate everyday interpersonal dilemmas, yet how their advisory defaults interact with the concentrated

Reliability Auditing for Downstream LLM tasks in Psychiatry: LLM-Generated Hospitalization Risk Scores

arXiv:2604.22063v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly utilized in clinical reasoning and risk assessment. However, their interpretive reliability in critical

Reliable Self-Harm Risk Screening via Adaptive Multi-Agent LLM Systems

arXiv:2604.22154v1 Announce Type: cross Abstract: Emerging AI systems in behavioral health and psychiatry use multi-step or multi-agent LLM pipelines for tasks like assessing self-harm risk and screen

safetyarxiv-cs-ai

Removing Sandbagging in LLMs by Training with Weak Supervision

arXiv:2604.22082v1 Announce Type: cross Abstract: As AI systems begin to automate complex tasks, supervision increasingly relies on weaker models or limited human oversight that cannot fully verify ou

researcharxiv-cs-ai

Applications

Segment Any-Quality Images with Generative Latent Space Enhancement

arXiv:2503.12507v3 Announce Type: replace Abstract: Despite their success, Segment Anything Models (SAMs) experience significant performance drops on severely degraded, low-quality images, limiting th

applicationsarxiv-cs-cv

SHAPE: Unifying Safety, Helpfulness and Pedagogy for Educational LLMs

arXiv:2604.22134v1 Announce Type: new Abstract: Large Language Models (LLMs) have been widely explored in educational scenarios. We identify a critical vulnerability in current educational LLMs, pedag

Sum-of-Checks: Structured Reasoning for Surgical Safety with Large Vision-Language Models

model-releasesarxiv-cs-cv

arXiv:2604.22156v1 Announce Type: cross Abstract: Purpose: Accurate assessment of the Critical View of Safety (CVS) during laparoscopic cholecystectomy is essential to prevent bile duct injury, a comp

Survey Response Generation: Generating Closed-Ended Survey Responses In-Silico with Large Language Models

arXiv:2510.11586v2 Announce Type: replace Abstract: Many in-silico simulations of human survey responses with large language models (LLMs) focus on generating closed-ended survey responses, whereas LL

Test-Time Matching: Unlocking Compositional Reasoning in Multimodal Models

arXiv:2510.07632v2 Announce Type: replace Abstract: Frontier AI models have achieved remarkable progress, yet recent studies suggest they struggle with compositional reasoning, often performing at or

The Bitter Lesson of Diffusion Language Models for Agentic Workflows: A Comprehensive Reality Check

arXiv:2601.12979v3 Announce Type: replace Abstract: The pursuit of real-time agentic interaction has driven interest in Diffusion-based Large Language Models (dLLMs) as alternatives to auto-regressive

agentsarxiv-cs-cl

Transferable Physical-World Adversarial Patches Against Pedestrian Detection Models

arXiv:2604.22552v1 Announce Type: new Abstract: Physical adversarial patch attacks critically threaten pedestrian detection, causing surveillance and autonomous driving systems to miss pedestrians and

safetyarxiv-cs-cv

TTS-PRISM: A Perceptual Reasoning and Interpretable Speech Model for Fine-Grained Diagnosis

arXiv:2604.22225v1 Announce Type: new Abstract: While generative text-to-speech (TTS) models approach human-level quality, monolithic metrics fail to diagnose fine-grained acoustic artifacts or explai

Unified Taxonomy for Multivariate Time Series Anomaly Detection using Deep Learning

arXiv:2603.18941v2 Announce Type: replace-cross Abstract: The topic of Multivariate Time Series Anomaly Detection (MTSAD) has grown rapidly over the past years, with a steady rise in publications and

researcharxiv-cs-lg

UNIKIE-BENCH: Benchmarking Large Multimodal Models for Key Information Extraction in Visual Documents

arXiv:2602.07038v2 Announce Type: replace-cross Abstract: Key Information Extraction (KIE) from real-world documents remains challenging due to substantial variations in layout structures, visual qual

Tutorials

Useful nonrobust features are ubiquitous in biomedical images

arXiv:2604.22579v1 Announce Type: cross Abstract: We study whether deep networks for medical imaging learn useful nonrobust features - predictive input patterns that are not human interpretable and hi

tutorialsarxiv-cs-cv

Wiggle and Go! System Identification for Zero-Shot Dynamic Rope Manipulation

arXiv:2604.22102v1 Announce Type: cross Abstract: Many robotic tasks are unforgiving; a single mistake in a dynamic throw can lead to unacceptable delays or unrecoverable failure. To mitigate this, we

We need more evals for document understanding. ParseBench is a really great start. I respect @llama_index ‘s work on this. 📈

model-releasesjerry-liu--x

We need more evals for document understanding. ParseBench is a really great start. I respect @llama_index ‘s work on this. 📈 We benchmarked GPT-5.5 on document understanding 📄📊 We ran it through Parse

26 Apr 2026

A Green-Integral-Constrained Neural Solver with Stochastic Physics-Informed Regularization

model-releasesarxiv-cs-lg

arXiv:2604.21411v1 Announce Type: new Abstract: Standard physics-informed neural networks (PINNs) struggle to simulate highly oscillatory Helmholtz solutions in heterogeneous media because pointwise m

A-IC3: Learning-Guided Adaptive Inductive Generalization for Hardware Model Checking

model-releasesarxiv-cs-lg

arXiv:2604.21688v1 Announce Type: cross Abstract: The IC3 algorithm represents the state-of-the-art (SOTA) hardware model checking technique, owing to its robust performance and scalability. A signifi

Applications

A Probabilistic Framework for Improving Dense Object Detection in Underwater Image Data via Annealing-Based Data Augmentation

arXiv:2604.21198v1 Announce Type: new Abstract: Object detection models typically perform well on images captured in controlled environments with stable lighting, water clarity, and viewpoint, but the

applicationsarxiv-cs-cv

A Replicable Robotics Awareness Method Using LLM-Enabled Robotics Interaction: Evidence from a Corporate Challenge

arXiv:2604.21377v1 Announce Type: new Abstract: Large language models are increasingly being explored as interfaces between humans and robotic systems, yet there remains limited evidence on how such t

researcharxiv-cs-ro

AFRILANGTUTOR: Advancing Language Tutoring and Culture Education in Low-Resource Languages with Large Language Models

arXiv:2604.20996v1 Announce Type: new Abstract: How can language learning systems be developed for languages that lack sufficient training resources? This challenge is increasingly faced by developers

AI for software engineering: from probable to provable

arXiv:2511.23159v2 Announce Type: replace-cross Abstract: Vibe coding, the much-touted use of AI techniques for programming, faces two overwhelming obstacles: the difficulty of specifying goals ('prom

researcharxiv-cs-ai

ARFBench: Benchmarking Time Series Question Answering Ability for Software Incident Response

model-releasesarxiv-cs-cv

arXiv:2604.21199v1 Announce Type: cross Abstract: Time series question-answering (TSQA), in which we ask natural language questions to infer and reason about properties of time series, is a promising

Breaking MCP with Function Hijacking Attacks: Novel Threats for Function Calling and Agentic Models

arXiv:2604.20994v1 Announce Type: cross Abstract: The growth of agentic AI has drawn significant attention to function calling Large Language Models (LLMs), which are designed to extend the capabiliti

agentsarxiv-cs-ai

CARE: Counselor-Aligned Response Engine for Online Mental-Health Support

arXiv:2604.21352v1 Announce Type: new Abstract: Mental health challenges are increasing worldwide, straining emotional support services and leading to counselor overload. This can result in delayed re

Certified Coil Geometry Learning for Short-Range Magnetic Actuation and Spacecraft Docking Application

arXiv:2507.03806v3 Announce Type: replace-cross Abstract: This paper presents a learning-based framework for approximating an exact magnetic-field interaction model, supported by both numerical and ex

researcharxiv-cs-lg

CHRep: Cross-modal Histology Representation and Post-hoc Calibration for Spatial Gene Expression Prediction

arXiv:2604.21573v1 Announce Type: new Abstract: Spatial transcriptomics (ST) enables spatially resolved gene profiling but remains expensive and low-throughput, limiting large-cohort studies and routi

safetyarxiv-cs-cv

CI-Work: Benchmarking Contextual Integrity in Enterprise LLM Agents

arXiv:2604.21308v1 Announce Type: cross Abstract: Enterprise LLM agents can dramatically improve workplace productivity, but their core capability, retrieving and using internal context to act on a us

CoFEE: Reasoning Control for LLM-Based Feature Discovery

arXiv:2604.21584v1 Announce Type: new Abstract: Feature discovery from complex unstructured data is fundamentally a reasoning problem: it requires identifying abstractions that are predictive of a tar

researcharxiv-cs-ai

Compose and Fuse: Revisiting the Foundational Bottlenecks in Multimodal Reasoning

arXiv:2509.23744v3 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) promise enhanced reasoning by integrating diverse inputs such as text, vision, and audio. Yet cross-m

safetyarxiv-cs-ai

Dementia classification from spontaneous speech using wrapper-based feature selection

arXiv:2502.03484v2 Announce Type: replace-cross Abstract: Dementia encompasses a group of syndromes that impair cognitive functions such as memory, reasoning, and the ability to perform daily activiti

researcharxiv-cs-lg

Do MLLMs Understand Pointing? Benchmarking and Enhancing Referential Reasoning in Egocentric Vision

model-releasesarxiv-cs-cv

arXiv:2604.21461v1 Announce Type: new Abstract: Egocentric AI agents, such as smart glasses, rely on pointing gestures to resolve referential ambiguities in natural language commands. However, despite

DryRUN: On the Role of Public Tests in LLM-Driven Code Generation

arXiv:2604.21598v1 Announce Type: cross Abstract: Multi-agent frameworks are widely used in autonomous code generation and have applications in complex algorithmic problem-solving. Recent work has add

agentsarxiv-cs-ai

Local Ai

DWTSumm: Discrete Wavelet Transform for Document Summarization

arXiv:2604.21070v1 Announce Type: new Abstract: Summarizing long, domain-specific documents with large language models (LLMs) remains challenging due to context limitations, information loss, and hall

local-aiarxiv-cs-cl

Effects of Swarm Size Variability on Operator Workload

arXiv:2604.21707v1 Announce Type: new Abstract: Real-world deployments of human--swarm teams depend on balancing operator workload to leverage human strengths without inducing overload. A key challeng

agentsarxiv-cs-ro

Enabling and Inhibitory Pathways of University Students' Willingness to Disclose AI Use: A Cognition-Affect-Conation Perspective

arXiv:2604.21733v1 Announce Type: new Abstract: The increasing integration of artificial intelligence (AI) in higher education has raised important questions regarding students' transparency in report

safetyarxiv-cs-ai

Local Ai

Frozen LLMs as Map-Aware Spatio-Temporal Reasoners for Vehicle Trajectory Prediction

arXiv:2604.21479v1 Announce Type: new Abstract: Large language models (LLMs) have recently demonstrated strong reasoning capabilities and attracted increasing research attention in the field of autono

local-aiarxiv-cs-cv

GerAV: Towards New Heights in German Authorship Verification using Fine-Tuned LLMs on a New Benchmark

arXiv:2601.13711v2 Announce Type: replace Abstract: Authorship verification (AV) is the task of determining whether two texts were written by the same author and has been studied extensively, predomin

GRISP: Guided Recurrent IRI Selection over SPARQL Skeletons

arXiv:2604.21133v1 Announce Type: new Abstract: We present GRISP (Guided Recurrent IRI Selection over SPARQL Skeletons), a novel SPARQL-based question-answering method over knowledge graphs based on f

researcharxiv-cs-cl

Local Ai

ImageHD: Energy-Efficient On-Device Continual Learning of Visual Representations via Hyperdimensional Computing

arXiv:2604.21280v1 Announce Type: new Abstract: On-device continual learning (CL) is critical for edge AI systems operating on non-stationary data streams, but most existing methods rely on backpropag

local-aiarxiv-cs-cv

Improving Clinical Diagnosis with Counterfactual Multi-Agent Reasoning

arXiv:2603.27820v2 Announce Type: replace Abstract: Clinical diagnosis is a complex reasoning process in which clinicians gather evidence, form hypotheses, and test them against alternative explanatio

agentsarxiv-cs-cl

Job Skill Extraction via LLM-Centric Multi-Module Framework

arXiv:2604.21525v1 Announce Type: new Abstract: Span-level skill extraction from job advertisements underpins candidate-job matching and labor-market analytics, yet generative large language models (L

researcharxiv-cs-cl