Search: “evaluation”

Commit-first LLM judging inherits the judge's own errors

arXiv:2609.00088v1 Announce Type: cross Abstract: LLM judges, models that score another system's output, can be gamed by the systems they score. Recent work identifies one defence that works: the judg

researcharxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

CRAD: Class-wise Reliability-Aware Distillation for Decentralized Heterogeneous Federated Learning

DGX agent

arXiv:2609.00446v1 Announce Type: cross Abstract: Conventional federated learning (FL) relies on parameter averaging, which forces clients to be doubly homogeneous: it demands an identical architectur

model-releasesarxiv-cs-cv

2 Sept 2026

Agents

Delegation Without Trust: An Empirical Gap Analysis of Identity, Authorization, and Runtime Governance in Multi-Agent LLM Systems

arXiv:2609.00267v1 Announce Type: cross Abstract: Autonomous LLM agents increasingly act on a user's behalf: they hold credentials, call tools and services, and spawn sub-agents that act further on th

agentsarxiv-cs-ai

Do General NLP Embeddings Capture Ontological Reasoning?

arXiv:2609.00177v1 Announce Type: cross Abstract: General-purpose NLP embedding models perform well on linguistic tasks, but their ability to capture symbolic ontological structure remains unclear. We

Do Satellites See Commuters? A Critical Benchmark of Vision Foundation Models

model-releasesarxiv-cs-cv

arXiv:2609.00661v1 Announce Type: new Abstract: Satellite foundation models offer a globally available alternative to census data for commuting origin-destination (OD) generation, yet no study has sys

Does This Moment Justify the Recommendation? Counterfactual Behavior-Grounded Evidence Retrieval for Personalized Video Recommendation

arXiv:2609.00996v1 Announce Type: new Abstract: Personalized video recommendation predicts user preference at the video level, while temporal video grounding localizes query-relevant moments. However,

local-aiarxiv-cs-cv

Dotting the Eye: An Intent-Driven Image Retouching Agent for Visual Focus Enhancement

arXiv:2609.01148v1 Announce Type: new Abstract: Image retouching is commonly formulated as enhancing overall visual quality through color adjustment, but in practice, it also serves to emphasize visua

local-aiarxiv-cs-cv

Drift-Aware LLM Routing with Sparse Contexts and Shared Budgets

arXiv:2609.00662v1 Announce Type: new Abstract: A multi-model language service must route each request while preserving workload-level budgets for compute, latency, memory, or monetary cost. Two featu

EGT-KG: Evidence-Grounded Typed KG Retrieval for Practical Scientific QA with Small Language Models

arXiv:2609.00479v1 Announce Type: new Abstract: For emerging scientific research domains, local Small Language Models (SLMs) are becoming more attractive, as they offer stronger privacy control and mo

Enoki: Efficient Multi-Level Hallucination Detection

arXiv:2609.00581v1 Announce Type: new Abstract: Ensuring factuality remains a critical challenge for deploying LLMs in high-stakes settings. Existing hallucination detectors usually operate at a singl

local-aiarxiv-cs-cl

ExBind: A Controlled Diagnostic Benchmark for Visual-to-Executable Correspondence

model-releasesarxiv-cs-cv

arXiv:2609.01344v1 Announce Type: new Abstract: Multimodal coding and editing systems must map a visible or semantic referent to the exact executable object that can be edited. A wrong reference may s

Exploring Nonlinear Body Oscillations for Natural Quadruped Gaits

arXiv:2609.00539v1 Announce Type: new Abstract: Animals' body morphology shapes the gait patterns they can perform, where mechanical resonance reduces the need for active control. By tuning posture an

researcharxiv-cs-ro

Exploring Sparse Autoencoders in Text-Based Causal Confounding Adjustment

arXiv:2609.01322v1 Announce Type: new Abstract: In many settings, studying causal questions based on text data requires adjusting for confounding information within texts. Yet there is a tradeoff in c

FoldingAgent: Inferring Parametric Origami Procedures from Demonstration Videos

arXiv:2609.00377v1 Announce Type: cross Abstract: We present FoldingAgent, an agentic framework for inferring explicit parametric folding programs directly from origami demonstration videos. Our frame

GRRM: Group Relative Reward Modeling for Machine Translation

arXiv:2602.14028v2 Announce Type: replace Abstract: While Group Relative Policy Optimization (GRPO) offers a powerful framework for LLM post-training, its effectiveness in open-ended domains like Mach

Human-AI Co-Interpretation for Responsible AI: A Hermeneutic Perspective

arXiv:2609.00334v1 Announce Type: new Abstract: Across law, education, policy analysis, and public moral argumentation, LLM outputs are being used often for work that requires interpretations to be ju

safetyarxiv-cs-ai

Incremental Risk Assessment of Progressive Elder Financial Scams via Instruction-Tuned Small Language Models

arXiv:2609.00005v1 Announce Type: new Abstract: Financial scams targeting older adults increasingly occur through text and voice channels such as email, SMS, and phone calls, unfolding over multiple c

Individualized Algorithmic Advice as a Strategic Signal on Competitive Markets

arXiv:2511.09454v2 Announce Type: replace-cross Abstract: As algorithms increasingly mediate competitive decision-making, their influence extends beyond individual outcomes to shaping strategic market

applicationsarxiv-cs-ai

InSight: A Benchmark for Agentic Claim Verification in Interactive Visualizations

arXiv:2609.01383v1 Announce Type: new Abstract: Vision Language Models have demonstrated remarkable proficiency in interpreting static visual artifacts, but modern data analysis is inherently dynamic,

Inspicio: Open-Vocabulary, LLM-Based Sense Retrieval for Historical Languages

arXiv:2609.00998v1 Announce Type: cross Abstract: Word Sense Disambiguation has advanced rapidly for English and a handful of well-resourced modern languages, but it continues to assume the existence

researcharxiv-cs-ai

Invalidation Contracts for Cross-Episode Agent Memory

arXiv:2609.00243v1 Announce Type: new Abstract: LLM agents that cache recovery suggestions from API errors can skip re-derivation in later episodes, spending fewer tokens and fewer model calls on cons

It Takes Two to Match: Co-Evolving Generative Retriever with Reinforcement Learning

arXiv:2609.00638v1 Announce Type: cross Abstract: Retrieval is the first stage of modern search and advertising systems, selecting a candidate set from a large item universe for downstream ranking and

Agents

Less Is More: Balancing Positive and Negative Space in Visual Concept Blending

arXiv:2609.00476v1 Announce Type: new Abstract: Graphic designers often blend visual concepts to communicate multiple ideas within a single image, leveraging positive and negative space to create bala

agentsarxiv-cs-cv

LLM-as-a-Demographic: Whom Sociodemographic Prompting Helps, and Whom It Hurts

arXiv:2609.00222v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as judges for subjective tasks, where annotators disagree and the relevant question is not only how a

LOOMSUM:Weaving Quantitative and Narrative Evidence for Faithful Long Text-Table Summarization

arXiv:2609.00241v1 Announce Type: new Abstract: Long documents often distribute important information across extensive narrative passages and multiple tables, making faithful summarization particularl

researcharxiv-cs-cl

Making Prospective Memory SLM-Shaped: Typed Intention Stores for Small-Model Agents

arXiv:2609.01272v1 Announce Type: new Abstract: Prospective memory means carrying out a deferred intention at the right future cue while other work continues. Benchmarks now isolate it as an agent ski

Tutorials

Manifold-Aware General Coded Computing for Straggler-Resilient Distributed Computing

arXiv:2609.00552v1 Announce Type: new Abstract: Existing coded-computing designs do not explicitly exploit the intrinsic structure of the input data. In communication systems, statistical structure an

tutorialsarxiv-cs-lg

Modeling Information Blackouts in Missing Not-At-Random Time Series Data

model-releasesarxiv-cs-lg

arXiv:2601.01480v3 Announce Type: replace-cross Abstract: Traffic forecasting systems rely on fixed sensor networks that frequently exhibit contiguous blackouts. Such outages are usually treated as ig

On Synthesis of Metric Interval Temporal Logics

arXiv:2609.01032v1 Announce Type: cross Abstract: Automated mining of formal specifications is vital for verifying real-time systems. However, existing passive learning approaches remain restricted to

researcharxiv-cs-ai

On the Reliability of Generative Augmentation: A Wasserstein-Based Theoretical and Empirical Study

arXiv:2609.01410v1 Announce Type: cross Abstract: Generative data augmentation is widely used to mitigate class imbalance, yet its theoretical effect on downstream generalization remains poorly unders

researcharxiv-cs-lg

Online Regime-aware Calibration for Black-box Social Simulators via Posterior-assisted Evolutionary Dynamic Optimization

model-releasesarxiv-cs-lg

arXiv:2601.19481v2 Announce Type: replace-cross Abstract: Evolutionary dynamic optimization (EDO) commonly assumes that environmental changes can be detected from fitness variations and handled throug

OpenAgentFlow: Enabling System-Wide Safety Boundaries for Heterogeneous AI Agent Fleets

arXiv:2609.00015v1 Announce Type: new Abstract: AI agents powered by large language models are evolving from isolated assistants into heterogeneous systems in which multiple agents, planners, controll

Parsing the Stream: A Live Trace Model for Long-Horizon Agents and Their Observers

arXiv:2609.01466v1 Announce Type: new Abstract: A long-horizon agent's trace outgrows both of its consumers: the human observer monitoring the run, and the agent itself, whose bounded context the trac

PersuaRL: Reinforcement Learning-Driven Multi-Expert Selection for Persuasive Dialogue Generation in Insurance

arXiv:2609.01188v1 Announce Type: new Abstract: Large Language Models (LLMs) are revolutionizing digital communication by powering conversational agents deployed across domains such as customer servic

Phrase-Localized Language-Contrastive Guidance: Training-Free Localized Accent Control for Code-Switching Text-to-Speech

arXiv:2609.01016v1 Announce Type: new Abstract: Current speech synthesis struggles with code-switching, which mixes a foreign language phrase into a primary language utterance, causing the phrase to b

local-aiarxiv-cs-cl

Polish ModernBERT: The Long and Short of Polish Language Understanding

arXiv:2609.01379v1 Announce Type: new Abstract: Encoder-only Transformers remain effective for discriminative and representation-learning tasks, yet Polish encoders still largely rely on BERT/RoBERTa-

Post-Training Science for Supervised Fine-Tuning

arXiv:2609.01244v1 Announce Type: cross Abstract: Every supervised fine-tuning run forces the same chain of decisions, such as learning rate, batch size, LoRA or full fine-tuning, how many epochs, whi

Predicting Subsurface Abnormalities Growth using Physics-Informed Neural Networks

arXiv:2609.01417v1 Announce Type: new Abstract: The research explores the pioneering integration of Physics-Informed Neural Networks (PINNs) into the domain of Ground-Penetrating Radar (GPR) data pred

researcharxiv-cs-lg

Provably Safe Sim-to-Real Transfer

arXiv:2609.01418v1 Announce Type: cross Abstract: To mitigate the sample complexity of real-world reinforcement learning (RL), a common practice is to first train a policy in a simulator, where sample

safetyarxiv-cs-ai

Ready to Speak: Aligning LLMs for TTS-Friendly Text Generation

arXiv:2609.01246v1 Announce Type: new Abstract: Current Large Language Models (LLMs) are primarily optimized for written text, often producing outputs that are grammatically correct and helpful yet po

ReDeck: Step-Level Render-Grounded Refinement for Document-to-Slide Generation

arXiv:2609.00194v1 Announce Type: new Abstract: Document-to-slide generation is challenging because slides are dense editable artifacts that require both faithful content selection and precise spatial

Removable and Irreducible: A Token-Cost Ledger for the Multilingual Tokenization Tax

arXiv:2609.00378v1 Announce Type: new Abstract: Large language models pay a well-documented tax on non-English text: the same content costs several times more tokens, and because attention is quadrati

applicationsarxiv-cs-cl

Rethinking Learnability in Offline Data-driven Optimization

arXiv:2609.01493v1 Announce Type: cross Abstract: Black-Box Optimization (BBO) has found broad applications, but evolutionary algorithms and Bayesian optimization face efficiency challenges as real-wo

applicationsarxiv-cs-ai

Retrieval, Scoring, and Decoding Shape Performance and Stability in LLM-based Conversational Recommendation

arXiv:2609.00086v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used as rerankers in conversational recommender systems, yet measured gains depend strongly on the retri

S^2Prune: Spatially Structured Visual Token Pruning for Multimodal Large Language Models

arXiv:2609.01224v1 Announce Type: new Abstract: Visual token pruning reduces the inference overhead of multimodal large language models (MLLMs) by retaining only a subset of visual tokens. Existing me

local-aiarxiv-cs-cv

Agents

Self-Reports Are Not Verification: Environment-Grounded Auditing of LLM Operators in Evolutionary Search

arXiv:2609.00652v1 Announce Type: new Abstract: Language model agents increasingly propose actions, observe external feedback, and explain their own behavior. Their confidence and rationales are conve

agentsarxiv-cs-ai

Separating Syntax from Language: A Mechanistic Account of Translation in Multilingual LLMs

arXiv:2609.01356v1 Announce Type: new Abstract: Multilingual large language models (mLLMs) achieve strong performance in machine translation, yet our understanding of the mechanisms by which they tran

applicationsarxiv-cs-cl

StudyBench: Can Self-Evolution Squeeze Textbooks for Olympiad Capability?

arXiv:2609.00787v1 Announce Type: new Abstract: Humans need to study only a handful of well-written textbooks to master a discipline and attempt its hardest problems. We argue that an ideal self-evolu