Search: “evaluation”

Forecasting Corpus-Sampling Disagreement in Masked Text Reconstruction

arXiv:2610.12987v1 Announce Type: new Abstract: If a second text corpus were collected from the same population, how much would a predictor's outputs change? We study this question for masked-text rec

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

GIST: Generator-state-Informed Supervision for Tabular Foundation Models

DGX agent

arXiv:2610.12904v1 Announce Type: new Abstract: Tabular foundation models (TFMs) based on prior-data fitted networks typically use sampled hard query labels, leaving avoidable sampling variability in

researcharxiv-cs-lg

12 Oct 2026

GlucoPRISM: Protocol-Supervised Pretraining for Cross-Cohort Glucose Transfer

arXiv:2610.12528v1 Announce Type: new Abstract: Continuous glucose monitoring (CGM) foundation models encode each day as one vector that mixes who the person is, what happened that day and how the sen

researcharxiv-cs-lg

HorizonNav: Geometry-Guided Video Diffusion for Anticipatory 3D Robot Navigation

arXiv:2610.13849v1 Announce Type: new Abstract: We present HorizonNav, a video diffusion-based framework for anticipatory robot navigation that transforms a single RGB image and a text prompt into a g

safetyarxiv-cs-ro

Humanize Olympiad Agents: A Multi-Session Workflow for Olympiad Problem Solving with Solve, Review, Wiki, Verify

arXiv:2610.13632v1 Announce Type: new Abstract: Large language model (LLM) agents are rapidly improving on long-horizon scientific and olympiad tasks. Recent systems have produced a Lean-formalized re

Language Models Have Interpretable Narrative Mechanisms

arXiv:2610.12989v1 Announce Type: new Abstract: We investigate whether language models contain internal components that contribute to representing narrativity, the degree to which a text exhibits narr

Let Large Language Models Judge Each Other: Multi-Agent Peer-Reviewed Reasoning for Medical Question Answering

arXiv:2606.15419v2 Announce Type: replace-cross Abstract: Objective: To enhance the accuracy, interpretability, and robustness of large language models (LLMs) in medical question answering (MedQA). Me

MetaJoin: Adaptive Join Selections for Heterogeneous Tables

arXiv:2512.02444v2 Announce Type: replace-cross Abstract: Joining heterogeneous tables requires different forms of correspondence, including exact agreement, syntactic transformation, semantic similar

MolP2SBench: Do LLMs Really Reason from Molecular Properties to Structure?

arXiv:2610.12522v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used in molecular discovery and structure elucidation, where decisions depend on physical observations.

Monarch-MoE: Structured Experts for Multimodal Continual Instruction Tuning

arXiv:2610.13215v1 Announce Type: new Abstract: Learning new tasks in multimodal continual instruction tuning can cause catastrophic forgetting of previously acquired knowledge. Although multi-expert

researcharxiv-cs-lg

Not All Dimensions Are Equal: Outlier-Aware Attention Linearization with Grouped Quadratic Kernels

arXiv:2610.13674v1 Announce Type: cross Abstract: Linearizing softmax attention offers a route to efficient Transformer inference, but preserving pretrained attention remains challenging. We identify

Oido: Open-Vocabulary Speech Recognition on a $5 Microcontroller without a Neural Accelerator

arXiv:2610.13447v1 Announce Type: cross Abstract: Speech recognition on low-cost microcontrollers is, in practice, limited to keyword spotting or a fixed list of commands. We present Oido, an inferenc

OpenPA: Forced-alignment-free Multi-granular Pronunciation Assessment with Mixed-transcript Adaptation

arXiv:2610.13826v1 Announce Type: cross Abstract: Recent advances in automatic pronunciation assessment (APA) have driven a shift from scripted to free-form assessment. However, existing methods often

safetyarxiv-cs-cl

Provably Accurate Shapley Value Estimation via Leverage Score Sampling

arXiv:2410.01917v3 Announce Type: replace-cross Abstract: Originally introduced in game theory, Shapley values have emerged as a central tool in explainable machine learning, where they are used to at

Realism VS Accuracy: Event Sequence Forecasting from a Generative Modeling Perspective

arXiv:2610.12586v1 Announce Type: new Abstract: Event sequences are chains of random events, each described by heterogeneous (numerical and categorical) features. The problem of event sequence forecas

ReAT: Residual Action Tokenization for Autoregressive Robot Policies

arXiv:2610.13093v1 Announce Type: new Abstract: Autoregressive robot policies rely on action tokenizers to convert continuous action chunks into compact sequences of discrete prediction targets. Exist

safetyarxiv-cs-ro

Reflect-VLA: Internalizing Reflective Guidance via Dual-Path On-Policy Self-Distillation for Autonomous Driving

arXiv:2610.13453v1 Announce Type: new Abstract: Reinforcement Learning (RL) substantially improves planning performance in autonomous-driving Vision-Language-Action (VLA) models. However, existing RL

safetyarxiv-cs-ro

Agents

Reflective Prompt Optimization of a Deep-Research Agent: A Topic-Disjoint, Multi-Seed Protocol for Measuring Transferable Gains and Prompt-Level Overfitting

arXiv:2610.12601v1 Announce Type: new Abstract: Prompt optimization is an attractive alternative to reinforcement learning for adapting language-model agents, since it is cheap and produces human-read

agentsarxiv-cs-cl

RegulaTutor: A Theory-Informed Framework for Long-Term Personalized Learning

arXiv:2610.13399v1 Announce Type: new Abstract: Long-term personalized tutoring requires language models to translate a learner's evolving history into appropriate instructional support. Existing LLM-

applicationsarxiv-cs-ai

Revisiting Tabular Deep Regression: Objectives and the Limits of Global Early Stopping

arXiv:2610.13909v1 Announce Type: cross Abstract: While deep learning models for tabular data have recently received significant research attention, the choice of objective functions for regression ta

Same Query, Different Answer: Run-to-Run Variance in Semantic Query Processing

arXiv:2610.13823v1 Announce Type: cross Abstract: Semantic query engines ask a large language model (LLM) to judge individual rows, and benchmarks compare these engines on the quality of a few executi

Scaling RNA Foundation Models through Iterative Refinement

arXiv:2610.13106v1 Announce Type: new Abstract: Biological function in RNA is encoded across scales, from local sequence motifs to long-range structural dependencies. Conventional RNA foundation model

Scan-Parallel Variational Inference for event-driven Latent Jump Models

arXiv:2610.12986v1 Announce Type: cross Abstract: Continuous-time latent state-space models are widely used for irregularly observed time series, typically representing uncertainty through a random in

researcharxiv-cs-lg

SelectArena: A Modern Benchmark for Feature Selection on Real-world Tabular Data

arXiv:2610.13644v1 Announce Type: cross Abstract: Selecting a subset of features (columns) from a tabular dataset is a ubiquitous challenge in real-world applications. Industry experts seek to minimiz

State-OPD: State-Grounded On-Policy Distillation for Multi-Turn Agents

arXiv:2610.13238v1 Announce Type: new Abstract: On-Policy Distillation (OPD) has emerged as a powerful paradigm for transferring reasoning capabilities from frontier models to smaller models, while ex

safetyarxiv-cs-lg

Studying Comics at Scale with Artificial Intelligence: The PAGE Framework and Three Studies of American Comics and Japanese Manga

arXiv:2610.13840v1 Announce Type: new Abstract: Comics are one of the great visual records of the twentieth century: hundreds of thousands of pages in which a mass readership saw its leaders, its wars

TabMF: Learning Dataset Representations with Tabular Foundation Models

arXiv:2610.13818v1 Announce Type: new Abstract: Representations of supervised datasets support higher-level machine-learning tasks such as dataset retrieval and distribution-shift monitoring. However,

Tutorials

The Limits of Query Monitoring against Distributed Model Extraction

arXiv:2610.13083v1 Announce Type: cross Abstract: Model providers now face distillation campaigns run through thousands of accounts, each of which looks like an ordinary user. When network and payment

tutorialsarxiv-cs-lg

Unreliable Narrator Framing as a Cost-effective Mechanism for Satire Explanation of Australian and American Satirical News

arXiv:2610.12863v1 Announce Type: new Abstract: Satirical news is a unique form of misinformation: it is intended to be humorous by the original publication source but can be misinterpreted. Explanati

VETR: Execution-Grounded Self-Improving Agent for Symbolic Graphics Reasoning

arXiv:2610.13098v1 Announce Type: new Abstract: Visual agents for symbolic graphics reasoning depend on executable world representations, yet continued improvement remains bottlenecked by ambiguous su

Tutorials

When Generative Models Act as Simulators

arXiv:2610.12847v1 Announce Type: cross Abstract: A simulator summarizes an environment in a state that users can read and change. Generative models learn representations of the world without explicit

tutorialsarxiv-cs-ai

When LLMs Sit Above Diagnostic Tools: Unrealized Complementarity in Industrial Fault Diagnosis

arXiv:2610.05031v2 Announce Type: replace Abstract: Large language models are increasingly used as integration layers above specialized tools, but a stronger component does not necessarily produce a s

When VLMs Destroy What They Know: Spatial Representations Fall Below Lexical Priors

arXiv:2610.13910v1 Announce Type: new Abstract: Vision-Language Models (VLMs) increasingly analyze and reason about images, yet it remains unclear whether their internal representations faithfully enc

zip2zip++: Towards Inference-Time Token Compression with Minimal Quality Loss

arXiv:2610.13605v1 Announce Type: new Abstract: Dynamic vocabularies built on-the-fly via Lempel-Ziv-Welch (LZW) compression let a language model represent the same text in fewer tokens, but prior wor

A persistent accuracy ceiling in automated verbal deception detection

arXiv:2610.12118v1 Announce Type: new Abstract: Automated methods have been proposed to overcome the limitations of human verbal deception detection, but evidence remains fragmented across disciplines

A Survey on Industrial Anomaly Synthesis

arXiv:2502.16412v3 Announce Type: replace Abstract: This paper presents a comprehensive review of industrial anomaly synthesis (IAS). Existing surveys on industrial anomalies mainly focus on anomaly d

researcharxiv-cs-cv

A Survey on LLM-Integrated Hardware Design Verification

arXiv:2610.10580v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly being integrated into hardware verification to automate specification interpretation, verification-artif

Adaptive Multi-Discriminator WGAN Framework for Resource-Constrained Internet of Vehicles Using Reinforcement Learning and Game Theory

arXiv:2610.10926v1 Announce Type: new Abstract: Managing machine learning workloads as a network service introduces a resource-orchestration problem distinct from conventional model training; which no

applicationsarxiv-cs-lg

Addressing Overcommitment in the Reasoning of Gendered Economic Memes under Multimodal Ambiguity

arXiv:2610.11724v1 Announce Type: new Abstract: Multimodal meme understanding is increasingly used to analyze socially sensitive content, yet existing models often exhibit biased behavior when interpr

safetyarxiv-cs-lg

Agent4RE: A Self-Refining Multi-agent Framework for End-to-End Software Requirements Engineering and Benchmarking

arXiv:2610.10628v1 Announce Type: cross Abstract: Existing LLM-based approaches for software Requirements Engineering (RE) typically rely on basic prompting strategies or rudimentary agent collaborati

Agents

AgentEvolver: System-Wide Self-Evolution Through Task Execution

arXiv:2610.11613v1 Announce Type: new Abstract: An agent can complete a task without improving how it works. Turning task experience into reusable capability requires connecting the changed component

agentsarxiv-cs-ai

An Explainable Header-Centric Framework for Large-Scale Semantic Table Interpretation and Data Quality Assessment

arXiv:2610.10541v1 Announce Type: new Abstract: Knowledge Graph (KG) quality depends not only on downstream graph validation, but also on the quality of tabular metadata used before integration. In me

Tutorials

An Interpretable Approach to PDE Solution Discovery via Structural Experience Distillation

arXiv:2610.12003v1 Announce Type: new Abstract: PDE solution discovery aims to identify explicit symbolic expressions for unknown physical fields from observations under known physical constraints. Ex

tutorialsarxiv-cs-ai

An Investigation of Robustness of LLMs in Mathematical Reasoning: Benchmarking with Mathematically-Equivalent Transformation of Advanced Mathematical Problems

arXiv:2508.08833v4 Announce Type: replace-cross Abstract: Frontier large language models (LLMs) now reach near-ceiling accuracy on standard mathematical-reasoning benchmarks and gold-medal-level perfo

Arbiter: Detecting Interference in LLM Agent System Prompts

arXiv:2603.08993v2 Announce Type: replace-cross Abstract: System prompts for LLM-based coding agents are software artifacts that govern agent behavior, yet lack the testing infrastructure applied to c

Code Understanding is a Bottleneck for Coding Agents

arXiv:2610.10610v1 Announce Type: cross Abstract: Repository benchmarks (e.g., SWE-bench) for coding agents often assume that lines of code edited can predict task difficulty, but such datasets' poor

Coefficient Calibration as Selection Pressure in Symbolic Regression

arXiv:2610.10931v1 Announce Type: new Abstract: In memetic symbolic regression, candidate structures are compared after coefficient calibration, so the calibration protocol itself contributes to evolu

applicationsarxiv-cs-lg

Cognition-Oriented Emotion Tracing from Causes to Consequences in Real-World Social Scenes

arXiv:2610.11410v1 Announce Type: new Abstract: Affective computing has progressed from categorical emotion recognition to open-ended affective analysis with large multimodal models. Yet affective sci

applicationsarxiv-cs-ai