Search: “evaluation”

AdaptFuse: Training-Free Sequential Preference Inference via Externalized Bayesian Computation

arXiv:2604.03925v2 Announce Type: replace Abstract: Large language models (LLMs) struggle to accumulate evidence across multiple rounds of user interactions, failing to update their beliefs in a manne

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

AegisVox: Factorized Privacy and Clinical Preservation for Long-Form Speech

DGX agent

arXiv:2610.14643v1 Announce Type: new Abstract: Clinical speech reveals identity through both spoken identifiers and voice, yet its pauses, delivery, and speaker roles can also carry useful clinical e

safetyarxiv-cs-ai

15 Oct 2026

AgentStripes: An Evidence-Graded Maturity Model for AI Agents

arXiv:2610.18603v1 Announce Type: new Abstract: Benchmarks report what an Artificial Intelligence (AI) agent can do on a task suite, but not whether one released version has been engineered with the c

AM-Bench: Understanding Agents under Task Underspecification across Models and Harnesses

arXiv:2610.18090v1 Announce Type: new Abstract: Ambiguous or incomplete task specifications complicate both execution and clarification for language-model agents. Yet agents' responses to these inform

Annealed Levy Diffusion via Gaussian Surrogate Reverse Dynamics

arXiv:2610.19692v1 Announce Type: new Abstract: Gaussian diffusion models offer a practical framework for generative modeling. Denoising Levy Probabilistic Models (DLPM) introduce heavy-tailed perturb

Are Multimodal Benchmarks Really Useful? Item-Level Multimodal Benchmark Diagnosis via Structure-Response Co-Calibration

arXiv:2610.14542v1 Announce Type: new Abstract: Multimodal benchmarks are central to evaluating whether models can reason over information from multiple modalities. However, existing literature has re

Are We Overthinking One-Step Generation?

arXiv:2610.20331v1 Announce Type: new Abstract: Diffusion and flow matching are now dominant frameworks for generative modeling in continuous domains, but they typically require multiple network evalu

AtomSearch: Evidence-Grounded Tree Search for Agent Skill Optimization

arXiv:2610.19951v1 Announce Type: new Abstract: Agent skills adapt frozen models through editable external instructions. Revising several rules at once makes changes difficult to inspect, while judgin

Back-Translation Still Matters: Leveraging Monolingual Data for Low-Resource Machine Translation with LLMs

arXiv:2610.18818v2 Announce Type: cross Abstract: Pre-trained Large Language Model (LLMs) are effective on many tasks in zero-shot and few-shot settings. For machine translation of low-resource langua

researcharxiv-cs-ai

BANGLAPLAN: A Benchmark for Constraint-Based Planning and Decision-Making in Bangla

arXiv:2610.19704v1 Announce Type: new Abstract: Large language models (LLMs) increasingly help users arrange appointments, plan journeys, and allocate limited resources. These tasks require models to

BenchPreS: A Benchmark for Context-Aware Personalized Preference Selectivity of Persistent-Memory LLMs

arXiv:2603.16557v2 Announce Type: replace-cross Abstract: Large language models (LLMs) increasingly store user preferences in persistent memory to support personalization across interactions. However,

Continuous Risk-Based Scheduling for Food Safety Inspection: Integrating Historical Decay with Event-Driven Consumer Review Signals

arXiv:2610.15191v1 Announce Type: new Abstract: Batch risk-based inspection scheduling struggles to detect a critical failure class: food facilities with recent clean inspections that subsequently dev

Convergence Rates of Gaussian Process Thompson Sampling for Efficient Global Optimization

model-releasesarxiv-cs-lg

arXiv:2610.19925v1 Announce Type: cross Abstract: Efficient global optimization aims to identify a global optimum of an expensive black-box function within a limited evaluation budget N. We investigat

Coupled Harness--Model Evolution for Scientific Equation Discovery

arXiv:2610.17740v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used to discover scientific equations from experimental data. Such a discovery system has two parts that m

safetyarxiv-cs-ai

Cross-Lingual TTS for Indian Languages: A Benchmark and Inference-Time Duration Estimation Strategies

arXiv:2610.14826v1 Announce Type: cross Abstract: Recent alignment-free Text-to-Speech (TTS) models achieve high synthesis quality by removing explicit alignment modules and simplifying training. Howe

Cross-Modal Latent Influence: Patch-Level Training Sample Attribution for Vision-Language Models

arXiv:2610.14190v1 Announce Type: new Abstract: Explaining a vision--language model (VLM) prediction requires tracing training-example influence to the multimodal evidence that mediates it, yet existi

D2: High-Capability Full-Duplex Spoken Language Models from Half-Duplex Backbones

arXiv:2610.17124v1 Announce Type: cross Abstract: Full-duplex spoken language models (FD-SLMs) support simultaneous listening and speaking, but often lag behind half-duplex spoken language models (HD-

Diagnosing and Correcting Reward Hacking in Verifiable Instruction Following

arXiv:2610.19525v1 Announce Type: cross Abstract: Verifiable instruction-following benchmarks emphasize output-constraint satisfaction but can overlook whether responses meaningfully answer the underl

Does Machine Translation Retain Media Bias?

arXiv:2610.19945v1 Announce Type: new Abstract: Within the most recent two decades, machine translation (MT) has been advanced from a research area to a mature, deployed technology for prose text and

safetyarxiv-cs-cl

Does the Linguistic Register of Thinking Matter? Wenyan as a Compact Reasoning Register for Chinese LLMs

arXiv:2610.19741v1 Announce Type: new Abstract: Visible reasoning traces of Chinese reasoning-oriented LLMs are typically written in modern vernacular Chinese, which may be verbose under limited decod

EmoXpt: Analyzing Emotional Variances in Human Comments and LLM-Generated Responses

arXiv:2501.06597v1 Announce Type: cross Abstract: The widespread adoption of generative AI has generated diverse opinions, with individuals expressing both support and criticism of its applications. T

researcharxiv-cs-ai

Empirical Boundaries of Reservoir Computing for Few-Shot Sequence Pattern Tasks

arXiv:2610.19997v1 Announce Type: new Abstract: Efficient sequence modeling remains a fundamental challenge in machine learning. Despite the success of Transformers, recurrent neural networks (RNNs) h

EvoCowork: A Benchmark for Real-World Office Tasks

arXiv:2610.14828v1 Announce Type: new Abstract: Office workflows are a demanding testbed for self-improving agents because their deliverables must be correct, natively editable, and mutually consisten

FlowSep-RF: Rectified Flow Matching for Single-Channel Radio-Frequency Signal Separation

arXiv:2610.20269v1 Announce Type: cross Abstract: Single-channel radio-frequency (RF) signal separation is important for interference mitigation when a signal of interest overlaps with a co-channel in

From Efficiency to Sufficiency: The Cost-Aware Measurement Design Framework for Automated Essay Scoring

arXiv:2610.19287v1 Announce Type: cross Abstract: Compute cost in automated essay scoring (AES) is usually treated as a technical efficiency issue rather than a measurement design concern. Yet deploym

researcharxiv-cs-cl

From Unreliable to Usable: Decomposing Failure Modes and Confidence Signals in LLM Entity Extraction - Evidence from Cyber Threat Intelligence

arXiv:2610.20417v1 Announce Type: new Abstract: Audits of large language model (LLM) extraction from full-length documents report severe unreliability, leaving two questions open: what the failures ac

Game-Creation-Agents: Autonomous Game Production

arXiv:2610.16776v1 Announce Type: new Abstract: Game-Creation-Agents (GCA) turns a natural-language request into a runnable Phaser 4 browser game. The pipeline first builds a multimodal game design do

GDEPO: Group Dual-dynamic and Equal-right Advantage Policy Optimization for Sample-Efficient Reinforcement Learning

arXiv:2601.06795v4 Announce Type: replace Abstract: Automated Theorem Proving (ATP) is a fundamental AI challenge, requiring machine-verifiable proofs in formal languages like Lean to evaluate reasoni

safetyarxiv-cs-ai

GesBench: When and Where Do Multimodal Language Models Perceive Social Meaning?

arXiv:2610.15129v1 Announce Type: new Abstract: Human social perception is incremental: we infer intent before an utterance is complete, revise our interpretation as new cues arrive, and attend to spe

HGRP: Heterogeneous Graph Neural Network for Routability Prediction

arXiv:2610.20209v1 Announce Type: new Abstract: Routability prediction enables rapid evaluation of placement quality without routing, providing effective feedback for routability-driven placement opti

Historical-Feature Residual Adaptation for Sequential Screening

arXiv:2610.19315v1 Announce Type: new Abstract: Sequential screening policies must use acquired feedback effectively under a fixed experiment budget. We study acquisition-time residual adaptation: a s

safetyarxiv-cs-lg

Applications

Horizon Scans can be accelerated using novel information retrieval and artificial intelligence tools

arXiv:2504.01627v2 Announce Type: replace-cross Abstract: Introduction: Horizon scanning in healthcare assesses early signals of innovation, crucial for timely adoption. Current horizon scanning faces

applicationsarxiv-cs-ai

KoAGE: Do Large Language Models Know, Learn, and Coin Korean Neologisms?

arXiv:2610.19399v1 Announce Type: new Abstract: Korean neologisms arise through diverse mechanisms, a demanding test of language models beyond lexical memorization. To enable systematic evaluation, we

Last Secure Code Benchmark: Is the Code You Vibe Secure?

arXiv:2610.14766v1 Announce Type: cross Abstract: AI coding agents now write much of the code that ships, yet whether that code is secure remains unclear. We introduce the Last Secure Code Benchmark,

LifeSearch: Benchmarking Deep Research Agents for Real-World Life and Productivity

arXiv:2610.18092v1 Announce Type: new Abstract: Deep research (DR) agents address open-ended information needs through multi-step reasoning, long-horizon web search, and evidence synthesis. However, e

LLM-Based Policy Compliance Verification of Loan Applications

arXiv:2610.20155v1 Announce Type: cross Abstract: Banks rely on extensive internal policy frameworks to ensure that corporate lending decisions comply with regulatory requirements and internal risk st

safetyarxiv-cs-cl

LLM-jp-4 Technical Report

arXiv:2610.19331v1 Announce Type: new Abstract: This paper presents LLM-jp-4, a family of Japanese sovereign large language models (LLMs) developed with an emphasis on transparency, reproducibility, a

researcharxiv-cs-cl

LLMRec: Benchmarking Large Language Models on Recommendation Task

arXiv:2308.12241v2 Announce Type: replace-cross Abstract: Recently, the fast development of Large Language Models (LLMs) such as ChatGPT has significantly advanced NLP tasks by enhancing the capabilit

MagicGarment: Benchmarking Single-Image Standalone 3D Garment Reconstruction

model-releasesarxiv-cs-cv

arXiv:2610.19623v1 Announce Type: new Abstract: Single-image 3D reconstruction has advanced rapidly, yet standalone garments remain challenging due to thin-shell geometry, open boundaries, and layered

Model vs. User: Whose Values Prevail? Inference-Time Value Alignment in Multi-Turn Conversations

arXiv:2610.19817v1 Announce Type: new Abstract: Human values shape how we expect language models to behave. Dominant alignment approaches treat values as global objectives, although the appropriate va

safetyarxiv-cs-cl

Neural POS Tagging for the Low-Resource Saraiki

arXiv:2610.20279v1 Announce Type: new Abstract: Part-of-speech tagging is a fundamental sequence labeling task and an important component for many downstream natural language processing applications.

Paraphrase Consensus Is Not Self-Consistency: Instruction Reliance and Robustness in VLA Policies

arXiv:2610.19438v1 Announce Type: new Abstract: Vision-language-action (VLA) policies fine-tuned on LIBERO are trained and evaluated on the same ten instruction strings, and rewording the instruction

safetyarxiv-cs-ro

Passing Tests, Missing Semantics: Evidence of Interpretive Lock-In in Plan-Based DataFrame Code Generation

arXiv:2610.15797v1 Announce Type: new Abstract: Planning and revision are intended to bring generated code closer to the task specification. Yet a mistaken interpretation can persist across the plan,

PatientWM: Towards Generalizable Clinical World Models via Unified Patient States

arXiv:2610.17059v1 Announce Type: new Abstract: Clinical decisions depend on anticipating how a patient's condition will evolve as treatment is adjusted and new evidence becomes available. Existing me

researcharxiv-cs-ai

Quantifying privacy risks in foundation model representations of brain MRI

model-releasesarxiv-cs-cv

arXiv:2610.20494v1 Announce Type: new Abstract: Pretrained representations are increasingly used to share and reuse information from medical images without exposing the original scans, but it is uncle

RASSG: Repair-Aware Semantic Survival Gating for Streaming Tool Execution

arXiv:2610.14659v1 Announce Type: new Abstract: Streaming speech assistants can launch tools before users finish speaking, overlapping execution with incoming speech to reduce user waiting time. Howev

Read, Parse, Describe: Unified Document Parsing with Visual Element Description Generation

model-releasesarxiv-cs-cv

arXiv:2610.20335v1 Announce Type: new Abstract: Document understanding systems are typically evaluated as separate components via layout analysis, optical text recognition, reading-order prediction, a

Recursive Environment Scaling for General Long-Horizon Agents

arXiv:2610.16397v1 Announce Type: new Abstract: We study environment scaling as a way to increase agent-benchmark difficulty while holding core task objectives fixed. Our framework, Recursive Environm