Search: “evaluation”

arXiv:2604.21950v1 Announce Type: cross Abstract: Small language models (1-3B) are practical to run locally, but individually limited on harder code generation tasks. We ask whether composing them int

local-aiarxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

FMSD-TTS: Few-shot Multi-Speaker Multi-Dialect Text-to-Speech Synthesis for U-Tsang, Amdo and Kham Speech Dataset Generation

DGX agent

arXiv:2505.14351v4 Announce Type: replace-cross Abstract: Tibetan is a low-resource language with minimal parallel speech corpora spanning its three major dialects-U-Tsang, Amdo, and Kham-limiting pro

researcharxiv-cs-ai

27 Apr 2026

From Skills to Talent: Organising Heterogeneous Agents as a Real-World Company

arXiv:2604.22446v1 Announce Type: new Abstract: Individual agent capabilities have advanced rapidly through modular skills and tool integrations, yet multi-agent systems remain constrained by fixed te

agentsarxiv-cs-ai

Graph-to-Vision: Multi-graph Understanding and Reasoning using Vision-Language Models

arXiv:2503.21435v3 Announce Type: replace Abstract: Recent advances in Vision-Language Models (VLMs) have shown promising capabilities in interpreting visualized graph data, offering a new perspective

How LLMs Detect and Correct Their Own Errors: The Role of Internal Confidence Signals

arXiv:2604.22271v1 Announce Type: new Abstract: Large language models can detect their own errors and sometimes correct them without external feedback, but the underlying mechanisms remain unknown. We

Improving Driver Drowsiness Detection via Personalized EAR/MAR Thresholds and CNN-Based Classification

arXiv:2604.22479v1 Announce Type: new Abstract: Driver drowsiness is a major cause of traffic accidents worldwide, posing a serious threat to public safety. Vision-based driver monitoring systems ofte

safetyarxiv-cs-cv

Inter-Stance: A Dyadic Multimodal Corpus for Conversational Stance Analysis

arXiv:2604.22739v1 Announce Type: new Abstract: Social interactions dominate our perceptions of the world and shape our daily behavior by attaching social meaning to acts as simple and spontaneous as

researcharxiv-cs-cv

Knowledge Visualization: A Benchmark and Method for Knowledge-Intensive Text-to-Image Generation

model-releasesarxiv-cs-cv

arXiv:2604.22302v1 Announce Type: new Abstract: Recent text-to-image (T2I) models have demonstrated impressive capabilities in photorealistic synthesis and instruction following. However, their reliab

Learning from Natural Language Feedback for Personalized Question Answering

arXiv:2508.10695v2 Announce Type: replace-cross Abstract: Personalization is crucial for enhancing both the effectiveness and user satisfaction of language technologies, particularly in information-se

Applications

LeHome: A Simulation Environment for Deformable Object Manipulation in Household Scenarios

arXiv:2604.22363v1 Announce Type: cross Abstract: Household environments present one of the most common, impactful yet challenging application domains for robotics. Within household scenarios, manipul

applicationsarxiv-cs-ai

MacrOData: New Benchmarks of Thousands of Datasets for Tabular Outlier Detection

arXiv:2602.09329v2 Announce Type: replace Abstract: Quality benchmarks are essential for fairly and accurately tracking scientific progress and enabling practitioners to make informed methodological c

Math Takes Two: A test for emergent mathematical reasoning in communication

arXiv:2604.21935v1 Announce Type: new Abstract: Although language models demonstrate remarkable proficiency on mathematical benchmarks, it remains unclear whether this reflects true mathematical reaso

Memanto: Typed Semantic Memory with Information-Theoretic Retrieval for Long-Horizon Agents

arXiv:2604.22085v1 Announce Type: new Abstract: The transition from stateless language model inference to persistent, multi session autonomous agents has revealed memory to be a primary architectural

agentsarxiv-cs-ai

Hardware

Multimodal Neural Operators for Real-Time Biomechanical Modelling of Traumatic Brain Injury

arXiv:2510.03248v3 Announce Type: replace-cross Abstract: Background: Traumatic brain injury modeling requires integrating volumetric neuroimaging, demographic parameters, and acquisition metadata. Fi

hardwarearxiv-cs-ai

NiuTrans.LMT: Toward Inclusive and Scalable Multilingual Machine Translation with LLMs

arXiv:2511.07003v2 Announce Type: replace Abstract: Large language models have significantly advanced Multilingual Machine Translation (MMT), yet scaling to many languages while keeping quality robust

researcharxiv-cs-cl

Non-Minimal Sampling and Consensus for Prohibitively Large Datasets

arXiv:2604.22518v1 Announce Type: new Abstract: We introduce NONSAC (Non-Minimal Sampling and Consensus), a general framework for robust and scalable model estimation from arbitrarily large datasets c

researcharxiv-cs-cv

Tutorials

One Shot Learning for Edge Detection on Point Clouds

arXiv:2604.22354v1 Announce Type: new Abstract: Each scanner possesses its unique characteristics and exhibits its distinct sampling error distribution. Training a network on a dataset that includes d

tutorialsarxiv-cs-cv

PermaFrost-Attack: Stealth Pretraining Seeding(SPS) for planting Logic Landmines During LLM Training

arXiv:2604.22117v1 Announce Type: cross Abstract: Aligned large language models(LLMs) remain vulnerable to adversarial manipulation, and their dependence on web-scale pretraining creates a subtle but

safetyarxiv-cs-ai

PL-MTEB: Polish Massive Text Embedding Benchmark

arXiv:2405.10138v2 Announce Type: replace Abstract: In this paper, we introduce the Polish Massive Text Embedding Benchmark (PL-MTEB), a comprehensive benchmark for text embeddings in the Polish langu

Point & Grasp: Flexible Selection of Out-of-Reach Objects Through Probabilistic Cue Integration

arXiv:2604.22491v1 Announce Type: cross Abstract: Selecting out-of-reach objects is a fundamental task in mixed reality (MR). Existing methods rely on a single cue or deterministically fuse multiple c

researcharxiv-cs-ro

PSI: A Benchmark for Human Interpretation and Response in Traffic Interactions

arXiv:2112.02604v3 Announce Type: replace-cross Abstract: Accurately modeling pedestrian intention and understanding driver decision-making processes are critical for the development of safe and socia

Recognition Without Authorization: LLMs and the Moral Order of Online Advice

arXiv:2604.22143v1 Announce Type: cross Abstract: Large language models are increasingly used to mediate everyday interpersonal dilemmas, yet how their advisory defaults interact with the concentrated

Reliability Auditing for Downstream LLM tasks in Psychiatry: LLM-Generated Hospitalization Risk Scores

arXiv:2604.22063v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly utilized in clinical reasoning and risk assessment. However, their interpretive reliability in critical

Reliable Self-Harm Risk Screening via Adaptive Multi-Agent LLM Systems

arXiv:2604.22154v1 Announce Type: cross Abstract: Emerging AI systems in behavioral health and psychiatry use multi-step or multi-agent LLM pipelines for tasks like assessing self-harm risk and screen

safetyarxiv-cs-ai

Removing Sandbagging in LLMs by Training with Weak Supervision

arXiv:2604.22082v1 Announce Type: cross Abstract: As AI systems begin to automate complex tasks, supervision increasingly relies on weaker models or limited human oversight that cannot fully verify ou

researcharxiv-cs-ai

Applications

Segment Any-Quality Images with Generative Latent Space Enhancement

arXiv:2503.12507v3 Announce Type: replace Abstract: Despite their success, Segment Anything Models (SAMs) experience significant performance drops on severely degraded, low-quality images, limiting th

applicationsarxiv-cs-cv

SHAPE: Unifying Safety, Helpfulness and Pedagogy for Educational LLMs

arXiv:2604.22134v1 Announce Type: new Abstract: Large Language Models (LLMs) have been widely explored in educational scenarios. We identify a critical vulnerability in current educational LLMs, pedag

Sum-of-Checks: Structured Reasoning for Surgical Safety with Large Vision-Language Models

model-releasesarxiv-cs-cv

arXiv:2604.22156v1 Announce Type: cross Abstract: Purpose: Accurate assessment of the Critical View of Safety (CVS) during laparoscopic cholecystectomy is essential to prevent bile duct injury, a comp

Survey Response Generation: Generating Closed-Ended Survey Responses In-Silico with Large Language Models

arXiv:2510.11586v2 Announce Type: replace Abstract: Many in-silico simulations of human survey responses with large language models (LLMs) focus on generating closed-ended survey responses, whereas LL

Test-Time Matching: Unlocking Compositional Reasoning in Multimodal Models

arXiv:2510.07632v2 Announce Type: replace Abstract: Frontier AI models have achieved remarkable progress, yet recent studies suggest they struggle with compositional reasoning, often performing at or

The Bitter Lesson of Diffusion Language Models for Agentic Workflows: A Comprehensive Reality Check

arXiv:2601.12979v3 Announce Type: replace Abstract: The pursuit of real-time agentic interaction has driven interest in Diffusion-based Large Language Models (dLLMs) as alternatives to auto-regressive

agentsarxiv-cs-cl

Transferable Physical-World Adversarial Patches Against Pedestrian Detection Models

arXiv:2604.22552v1 Announce Type: new Abstract: Physical adversarial patch attacks critically threaten pedestrian detection, causing surveillance and autonomous driving systems to miss pedestrians and

safetyarxiv-cs-cv

TTS-PRISM: A Perceptual Reasoning and Interpretable Speech Model for Fine-Grained Diagnosis

arXiv:2604.22225v1 Announce Type: new Abstract: While generative text-to-speech (TTS) models approach human-level quality, monolithic metrics fail to diagnose fine-grained acoustic artifacts or explai

Unified Taxonomy for Multivariate Time Series Anomaly Detection using Deep Learning

arXiv:2603.18941v2 Announce Type: replace-cross Abstract: The topic of Multivariate Time Series Anomaly Detection (MTSAD) has grown rapidly over the past years, with a steady rise in publications and

researcharxiv-cs-lg

UNIKIE-BENCH: Benchmarking Large Multimodal Models for Key Information Extraction in Visual Documents

arXiv:2602.07038v2 Announce Type: replace-cross Abstract: Key Information Extraction (KIE) from real-world documents remains challenging due to substantial variations in layout structures, visual qual

Tutorials

Useful nonrobust features are ubiquitous in biomedical images

arXiv:2604.22579v1 Announce Type: cross Abstract: We study whether deep networks for medical imaging learn useful nonrobust features - predictive input patterns that are not human interpretable and hi

tutorialsarxiv-cs-cv

Wiggle and Go! System Identification for Zero-Shot Dynamic Rope Manipulation

arXiv:2604.22102v1 Announce Type: cross Abstract: Many robotic tasks are unforgiving; a single mistake in a dynamic throw can lead to unacceptable delays or unrecoverable failure. To mitigate this, we

A Green-Integral-Constrained Neural Solver with Stochastic Physics-Informed Regularization

arXiv:2604.21411v1 Announce Type: new Abstract: Standard physics-informed neural networks (PINNs) struggle to simulate highly oscillatory Helmholtz solutions in heterogeneous media because pointwise m

A-IC3: Learning-Guided Adaptive Inductive Generalization for Hardware Model Checking

arXiv:2604.21688v1 Announce Type: cross Abstract: The IC3 algorithm represents the state-of-the-art (SOTA) hardware model checking technique, owing to its robust performance and scalability. A signifi

Applications

A Probabilistic Framework for Improving Dense Object Detection in Underwater Image Data via Annealing-Based Data Augmentation

arXiv:2604.21198v1 Announce Type: new Abstract: Object detection models typically perform well on images captured in controlled environments with stable lighting, water clarity, and viewpoint, but the

applicationsarxiv-cs-cv

A Replicable Robotics Awareness Method Using LLM-Enabled Robotics Interaction: Evidence from a Corporate Challenge

arXiv:2604.21377v1 Announce Type: new Abstract: Large language models are increasingly being explored as interfaces between humans and robotic systems, yet there remains limited evidence on how such t

researcharxiv-cs-ro

AFRILANGTUTOR: Advancing Language Tutoring and Culture Education in Low-Resource Languages with Large Language Models

arXiv:2604.20996v1 Announce Type: new Abstract: How can language learning systems be developed for languages that lack sufficient training resources? This challenge is increasingly faced by developers

AI for software engineering: from probable to provable

arXiv:2511.23159v2 Announce Type: replace-cross Abstract: Vibe coding, the much-touted use of AI techniques for programming, faces two overwhelming obstacles: the difficulty of specifying goals ('prom

researcharxiv-cs-ai

ARFBench: Benchmarking Time Series Question Answering Ability for Software Incident Response

model-releasesarxiv-cs-cv

arXiv:2604.21199v1 Announce Type: cross Abstract: Time series question-answering (TSQA), in which we ask natural language questions to infer and reason about properties of time series, is a promising

Breaking MCP with Function Hijacking Attacks: Novel Threats for Function Calling and Agentic Models

arXiv:2604.20994v1 Announce Type: cross Abstract: The growth of agentic AI has drawn significant attention to function calling Large Language Models (LLMs), which are designed to extend the capabiliti

agentsarxiv-cs-ai

CARE: Counselor-Aligned Response Engine for Online Mental-Health Support

arXiv:2604.21352v1 Announce Type: new Abstract: Mental health challenges are increasing worldwide, straining emotional support services and leading to counselor overload. This can result in delayed re

Certified Coil Geometry Learning for Short-Range Magnetic Actuation and Spacecraft Docking Application

arXiv:2507.03806v3 Announce Type: replace-cross Abstract: This paper presents a learning-based framework for approximating an exact magnetic-field interaction model, supported by both numerical and ex

researcharxiv-cs-lg

CHRep: Cross-modal Histology Representation and Post-hoc Calibration for Spatial Gene Expression Prediction

arXiv:2604.21573v1 Announce Type: new Abstract: Spatial transcriptomics (ST) enables spatially resolved gene profiling but remains expensive and low-throughput, limiting large-cohort studies and routi

safetyarxiv-cs-cv