Search: “evaluation”

MoMHa: Multi-Objective Optimization of LLM Harnesses over Accuracy, Safety, and Tokens

arXiv:2609.30967v1 Announce Type: new Abstract: Most work on improving large language models treats accuracy as the sole objective. We argue that the harness, the Python code surrounding the model tha

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Muslim: A Deployed Arabic Voice AI Platform for Grounded Islamic Knowledge

DGX agent

arXiv:2609.31511v1 Announce Type: new Abstract: We present Muslim, a production Arabic voice AI platform serving grounded, sourced Islamic knowledge to real users. Beyond a real-time voice pipeline (N

model-releasesarxiv-cs-cl

28 Sept 2026

Applications

NavGen: Visual Generative Models as a Scalable Data Engine for Embodied 3D Navigation

arXiv:2609.30770v1 Announce Type: cross Abstract: General-purpose robot models increasingly rely on large and diverse datasets. For embodied 3D navigation, however, existing data sources face a fundam

applicationsarxiv-cs-ai

NEMSim: Learning Control-Conditioned Multi-Event Physical Dynamics via Executable Event-Mechanism Priors

model-releasesarxiv-cs-lg

arXiv:2609.30718v1 Announce Type: new Abstract: High-fidelity simulation of control-conditioned multi-event physical systems is computationally expensive, especially across broad control spaces and lo

Neural State Prediction: Obstructing Shortcut Learning in EEG Foundation Models

arXiv:2609.31167v1 Announce Type: new Abstract: EEG foundation models increasingly use masked prediction to learn from unlabeled recordings, but optimizing this objective does not ensure transferable

Open Vocabulary Domain Unlearning

arXiv:2609.31356v1 Announce Type: new Abstract: Vision-Language Models (VLMs) exhibit remarkable zero-shot generalization, yet they often encode unwanted or hazardous stylistic domains such as idealiz

OpenHail: An Event-Driven Gymnasium Environment for Electric Ride-Hailing Fleet Control

arXiv:2609.30628v1 Announce Type: new Abstract: Machine-learning policies have attracted increasing interest for ride-hailing fleet control in recent years. Reinforcement learning, in particular, requ

safetyarxiv-cs-lg

Privacy-Preserving Prompted Policy Search for Robotic Control

arXiv:2609.30554v1 Announce Type: new Abstract: Large language models (LLMs) have recently demonstrated promising capabilities as in-context policy optimizers for Reinforcement Learning (RL), enabling

safetyarxiv-cs-ro

Quantum Diffusion Models for Medical Image Analysis

arXiv:2609.31070v1 Announce Type: cross Abstract: Quantum Machine Learning is a novel field of research aimed at devising machine learning approaches exploiting principles of quantum mechanics, such a

Query-Conditioned Prototype Adaptation for Cross-Domain Few-Shot Learning: Single-Query Inference, Controlled Comparisons, and Failure Modes

arXiv:2609.30769v1 Announce Type: new Abstract: Cross-domain few-shot learning requires adapting a classifier to a new visual domain from very few labelled examples without target-time parameter updat

RefRef: A Dataset and Benchmark for Reconstructing Refractive and Reflective Objects

arXiv:2505.05848v3 Announce Type: replace Abstract: Modern 3D reconstruction and novel view synthesis approaches have demonstrated strong performance on scenes with opaque, non-refractive objects. How

ScopeBench: Do Agents Preserve Engagement Boundaries Under Goal Pressure?

arXiv:2609.30325v1 Announce Type: new Abstract: Agents are increasingly deployed with real autonomy in web application and network penetration testing, where a single out-of-scope action can breach a

SignTrace: Describe a Sign, Find the Word

arXiv:2609.30295v1 Announce Type: cross Abstract: Identifying an unfamiliar sign is difficult when a learner remembers its movement but does not know its meaning or formal feature codes. SignTrace add

Sorry Robot, Happy Human: Vision-Language Models Read Only One of Two Legible Typographic Layers

arXiv:2609.31403v1 Announce Type: cross Abstract: Vision-language models (VLMs), despite their success in optical character recognition (OCR) tasks, are vulnerable to typographic attacks and have a fr

TempQ-Jail: Query-Constrained Candidate Ranking for Text-to-Video Jailbreak Attacks

arXiv:2609.31032v1 Announce Type: cross Abstract: Existing text-to-video (T2V) jailbreak methods mainly seek more effective or stealthier attack candidates. In guarded T2V systems, however, video gene

safetyarxiv-cs-cv

The Price of Thought: Does Test-Time Reasoning Pay in LLM Trading?

arXiv:2609.30705v1 Announce Type: new Abstract: While inference-time reasoning in large language models (LLMs) promises better decision making, its higher computational cost may not yield better econo

The Right Information Extraction Pipeline Depends on the Document: Accuracy-Energy Trade-offs for Small, Local Models

arXiv:2609.31341v1 Announce Type: new Abstract: Whether an information extraction pipeline should process page images or parsed text depends on the document, and the answer flips across the layout spe

Timo: extbf{T}aming Multextbf{i}modal Diffusion Transformer for Human extbf{Mo}tion Generation

arXiv:2609.30761v1 Announce Type: new Abstract: Most existing human motion generation (HMG) methods use cross-attention modules to inject text semantics, but ignore the importance of bidirectional mod

Toward AI-Augmented Cooperative Engineering Workflows: Requirements and Architecture the European Rover Challenge

arXiv:2609.31136v1 Announce Type: new Abstract: The growing availability of Artificial Intelligence (AI) tools creates new opportunities to support engineering design processes, yet their current use

Training-Free Pronunciation Transcription via Text-Constrained Acoustic Rescoring

arXiv:2609.30924v1 Announce Type: new Abstract: Accurate and efficient pronunciation transcription is essential for preparing text-to-speech training data at scale. Existing approaches have different

researcharxiv-cs-cl

UltraG-Bench: A Multi-task Benchmark for assessing Large Vision-Language Models on Pixel-level Evidence Grounding in Ultrasound

arXiv:2609.30928v1 Announce Type: cross Abstract: Ultrasound is one of the most widely used medical imaging modalities, and recent large vision-language models(VLMs) have shown increasing capabilities

WeaveAgent: A Two-Stage Tool-Routing Agent for Ultra-High-Resolution Remote Sensing Imagery

arXiv:2609.31234v1 Announce Type: new Abstract: Problem. Ultra-high-resolution (UHR) remote sensing with vague user intents has two bottlenecks: visual tokens are expensive, and tool calling must be f

Applications

What Will Remain Human in Software Architecture? A Focus Group Report

arXiv:2609.30334v1 Announce Type: cross Abstract: AI development agents are increasingly used to support and partially automate software architecture tasks. To explore how practitioners perceive this

applicationsarxiv-cs-ai

A Probabilistic Approach for Model Alignment with Human Comparisons

arXiv:2403.10771v3 Announce Type: replace Abstract: A growing trend involves integrating human knowledge into learning frameworks, leveraging subtle human feedback to refine AI models. While these app

safetyarxiv-cs-lg

Local Ai

A Rapid Pipeline for Training and Deploying ML Models on WeBe Band

arXiv:2609.29084v1 Announce Type: new Abstract: Developing optimized machine-learning algorithms for edge devices with limited computational and memory resources is challenging, time-consuming, and hi

local-aiarxiv-cs-ai

AdaPilot: Towards Scene-Adaptive Policy Learning for Cross-Generator Text-to-Image Quality Optimization

arXiv:2609.29517v1 Announce Type: new Abstract: Existing methods for improving text-to-image generation quality have progressed from generator fine-tuning and prompt optimization to reinforcement lear

safetyarxiv-cs-cv

Adaptive Fisher-Whitened Cross-Covariance for Low-Resource Speech Recognition

model-releasesarxiv-cs-cl

arXiv:2609.29800v1 Announce Type: new Abstract: Adapting multilingual speech foundation models to low-resource languages remains difficult, especially for languages that are poorly represented during

Adaptive Tiling for Least-Squares Phase Unwrapping: Runtime and Accuracy

arXiv:2609.28541v1 Announce Type: cross Abstract: Phase unwrapping estimates the missing multiples of 2pi in measured phase images. For large images, tiling limits the size of local reconstruction pro

researcharxiv-cs-cv

Hardware

Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edge

arXiv:2609.29648v1 Announce Type: new Abstract: Video object detection on edge devices runs computationally expensive detectors over long frame streams, causing high energy consumption and sustained G

hardwarearxiv-cs-cv

An auditable conditional-strategy framework for open-ended decision-making in complex lung cancer

arXiv:2609.29381v1 Announce Type: new Abstract: Complex lung cancer decisions can involve several defensible pathways whose eligibility, sequencing and safety depend on unresolved information. Effecti

safetyarxiv-cs-ai

ArGuard Shared Task: Harmful Content Detection in Arabic Memes and LLM Prompts

arXiv:2609.29349v1 Announce Type: cross Abstract: ArGuard is a shared task on harmful content detection in Arabic memes and LLM prompts. It includes two tracks: Track A focuses on multimodal hate dete

safetyarxiv-cs-ai

Assessing the Impact of Fleet Size on Crowdsourced Mapping Using a Dissimilarity Measure

arXiv:2609.29198v1 Announce Type: new Abstract: Accurate digital maps are essential for Advanced Driver Assistance Systems (ADAS) or Autonomous Driving (AD), providing critical information such as roa

safetyarxiv-cs-ro

Benchmarking and Domain Adaptation of Automatic Speech Recognition (ASR) for Adolescent Health Communication in Ghanaian Languages

arXiv:2609.29798v1 Announce Type: cross Abstract: This paper presents an end-to-end study of automatic speech recognition (ASR) for adolescent health communication in three Ghanaian languages (Twi, Da

Beyond Static Graph World Models: Learning Stochastic Latent Dynamics over Evolving Topologies

arXiv:2609.28670v1 Announce Type: cross Abstract: Graph-based world models have recently emerged as a means of learning transitions over relational state representations. However, existing approaches

Broadening Uncertainty Estimation for Audio Question Answering Across Methods, Formats, and Inputs

arXiv:2609.28879v1 Announce Type: cross Abstract: Audio-language models can produce confident answers unsupported by the audio, motivating uncertainty estimates that identify unreliable responses. We

Local Ai

Canopy: Exploiting Piecewise Smooth Tree Priors for Multi-Fidelity Bandits

arXiv:2609.30017v1 Announce Type: cross Abstract: Many LLM inference problems, including model routing, prefix-cache management, prompt trimming, and test-time search, can be viewed as optimization ov

local-aiarxiv-cs-ai

CATCH: Counterfactual Anatomical Tissue Inpainting with Conditional Haar Diffusion

arXiv:2609.29591v1 Announce Type: cross Abstract: BraTS local synthesis replaces masked regions in T1-weighted brain MRI with plausible tumor-free tissue while preserving observed anatomy. We present

safetyarxiv-cs-ai

Context-aware Skin Cancer Epithelial Cell Classification with Scalable Graph Transformers

arXiv:2602.15783v2 Announce Type: replace Abstract: Whole-slide images (WSIs) from cancer patients contain rich information that can be used for medical diagnosis or to follow treatment progress. To a

researcharxiv-cs-cv

CRISS: A Retrieval-Augmented AI Chatbot for Assisting Cancer Registrars

arXiv:2609.29075v1 Announce Type: new Abstract: Cancer registrars, including Oncology Data Specialists (ODSs), must interpret complex and frequently updated coding and staging standards. We developed

Cultural Divergence Preservation: Diagnosing Flattening and Caricature in LLM-Simulated Survey Populations

arXiv:2609.29928v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used as synthetic survey respondents to estimate population response distributions. In cross-cultural su

Applications

DeltaWAM: Delta World Action Models for Bimanual Manipulation

arXiv:2609.28811v1 Announce Type: new Abstract: World-action models (WAMs) transfer visual and motion priors from pretrained video generators to robot control by jointly modeling visual dynamics and a

applicationsarxiv-cs-cv

Diverse Geometries, Frozen Weights: Robust Heterogeneous Treatment-Effect Estimation via Causal Expert Ensembles

model-releasesarxiv-cs-lg

arXiv:2609.29974v1 Announce Type: new Abstract: Estimating heterogeneous treatment effects from observational data is difficult because the most appropriate inductive bias varies with overlap, treatme

Local Ai

Efficient Continuous DEM Reconstruction under Limited Target-Resolution Supervision

arXiv:2609.29864v1 Announce Type: new Abstract: High-resolution digital elevation models (DEMs) support Earth observation applications, but paired training references are often available only at coars

local-aiarxiv-cs-cv

ELF-REG: Scaling Continuous Diffusion Language Models to Reasoning Tasks

arXiv:2609.29102v1 Announce Type: new Abstract: Fully continuous diffusion language models (dLMs) denoise continuous representations without intermediate discretization, then decode all response token

safetyarxiv-cs-cl

FluidRain: Incompressible Rain Flow as an Attention Bias for Loop-in-Loop Video Deraining

arXiv:2609.29006v1 Announce Type: new Abstract: Existing video deraining methods typically exploit neighboring frames through either explicit alignment or implicit spatiotemporal aggregation. Explicit

safetyarxiv-cs-cv

From Text Decisions to Pixels: An Study of Jev-Style Visual Choice Model

arXiv:2609.29283v1 Announce Type: new Abstract: Visual software often needs a decision over supplied alternatives rather than a generated explanation. We present PixelJev, a native-image decision inte

GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoning

arXiv:2609.29541v1 Announce Type: cross Abstract: Referring segmentation in overhead imagery is inherently relational: a query may ask for the buildings north of the road or the pond closest to a resi

Hardware

GHOST-Q: Towards Studying Grounding Hallucinations Overlooked Under Same-score TradeOffs in Quantized VLMS

arXiv:2609.29999v1 Announce Type: cross Abstract: Post-training quantization of vision--language models (VLMs) is typically assessed through aggregate task accuracy and memory savings, but preserving

hardwarearxiv-cs-ai