Search: “evaluation”

arXiv:2609.00572v1 Announce Type: cross Abstract: Enterprise artificial intelligence is increasingly embedded in decisions that must remain lawful, explainable, adaptable, and accountable despite pers

applicationsarxiv-cs-ai

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

AgentFactory: Towards Automated Agentic System Design and Optimization

DGX agent

arXiv:2609.01045v1 Announce Type: new Abstract: Large Language Models (LLMs) have demonstrated remarkable capabilities as powerful components in agentic systems, enabling sophisticated reasoning and c

agentsarxiv-cs-ai

2 Sept 2026

Aligned but Flattened: Analyzing the Trade-off between Cultural Alignment and Diversity in LLMs

arXiv:2609.00565v1 Announce Type: cross Abstract: Cultural fine-tuning has become the de facto paradigm for building culture-aware large language models (LLMs), yet existing optimization exclusively f

ARISE-RL: Agentic Rubric-Grounded Iterative Self-Evolution with Reinforcement Learning

arXiv:2609.01058v1 Announce Type: new Abstract: Training open-ended agents via reinforcement learning (RL) is hindered by the lack of verifiable gold answers and scalable rubrics. Moreover, even near

ASSERT: Adaptive Stochastic Sampling for Robust Diffusion Models on Analog Compute-in-Memory Hardware

arXiv:2609.00955v1 Announce Type: new Abstract: Diffusion models achieve strong image generation quality but incur high iterative denoising costs. Analog compute-in-memory (CIM) can accelerate matrix-

safetyarxiv-cs-cv

Automatic Item Generation for Personality Situational Judgment Tests with Large Language Models

arXiv:2412.12144v5 Announce Type: replace-cross Abstract: Personality assessment through situational judgment tests (SJTs) offers unique advantages over traditional Likert-type self-report scales, yet

Benchmarking Spatial, Spectral, and Self-Supervised Cues for Face Forgery Detection under Realistic Degradation

arXiv:2609.01511v1 Announce Type: new Abstract: Face forgery detectors often achieve strong results on controlled benchmarks, but their reliability under realistic image degradations remains limited.

Benchmarking Vision-Language Models for Automated Pathology Diagnosis and Report Generation

arXiv:2609.00866v1 Announce Type: cross Abstract: The rapid advancement of vision-language models (VLMs) has accelerated progress in computational pathology; however, whole-slide image (WSI)-based pat

Tutorials

Beyond Landmark Extraction: A Framework for Robust Geometric Feature Construction in Structured Image Classification

arXiv:2609.00634v1 Announce Type: new Abstract: Much of the literature on structured image recognition has disproportionately focused on the comparison of classification algorithms. Rather than invest

tutorialsarxiv-cs-cv

Beyond the Clock: Measuring the Value of Adaptive Revision

arXiv:2609.00874v1 Announce Type: new Abstract: As agentic systems become compound systems, increasingly important decisions move above task execution itself: when should a higher-level controller pre

safetyarxiv-cs-ai

BiasGym: A Simple and Generalizable Framework for Analyzing and Removing Biases through Injection

arXiv:2508.08855v5 Announce Type: replace-cross Abstract: Understanding biases and stereotypes encoded in the weights of Large Language Models (LLMs) is crucial for developing effective mitigation str

local-aiarxiv-cs-ai

Can Large Language Models Forecast What Researchers Study Next?

model-releasesarxiv-cs-cl

arXiv:2609.00747v1 Announce Type: new Abstract: Large language models increasingly generate research ideas, yet judging their novelty or feasibility at generation time does not establish whether they

Can machines think efficiently?

arXiv:2510.26954v3 Announce Type: replace-cross Abstract: The Turing Test is no longer adequate for distinguishing human and machine intelligence. With advanced artificial intelligence systems already

Applications

Cleaner Speech, Weaker Generalization: Revisiting Pitt-Derived Benchmarks for Alzheimer's Disease Detection

arXiv:2609.00276v1 Announce Type: cross Abstract: Speech-based Alzheimer's disease (AD) detection increasingly relies on speech-enhanced and curated versions of the Pitt Corpus, where speech enhanceme

applicationsarxiv-cs-ai

CMRVision: A Foundation Model for Cardiac MR Image Analysis

arXiv:2609.01308v1 Announce Type: new Abstract: Cardiac magnetic resonance (CMR) imaging provides complementary information on cardiac anatomy, function, and tissue characterization across multiple se

Commit-first LLM judging inherits the judge's own errors

arXiv:2609.00088v1 Announce Type: cross Abstract: LLM judges, models that score another system's output, can be gamed by the systems they score. Recent work identifies one defence that works: the judg

CRAD: Class-wise Reliability-Aware Distillation for Decentralized Heterogeneous Federated Learning

arXiv:2609.00446v1 Announce Type: cross Abstract: Conventional federated learning (FL) relies on parameter averaging, which forces clients to be doubly homogeneous: it demands an identical architectur

Delegation Without Trust: An Empirical Gap Analysis of Identity, Authorization, and Runtime Governance in Multi-Agent LLM Systems

arXiv:2609.00267v1 Announce Type: cross Abstract: Autonomous LLM agents increasingly act on a user's behalf: they hold credentials, call tools and services, and spawn sub-agents that act further on th

agentsarxiv-cs-ai

Do General NLP Embeddings Capture Ontological Reasoning?

arXiv:2609.00177v1 Announce Type: cross Abstract: General-purpose NLP embedding models perform well on linguistic tasks, but their ability to capture symbolic ontological structure remains unclear. We

Do Satellites See Commuters? A Critical Benchmark of Vision Foundation Models

arXiv:2609.00661v1 Announce Type: new Abstract: Satellite foundation models offer a globally available alternative to census data for commuting origin-destination (OD) generation, yet no study has sys

Does This Moment Justify the Recommendation? Counterfactual Behavior-Grounded Evidence Retrieval for Personalized Video Recommendation

arXiv:2609.00996v1 Announce Type: new Abstract: Personalized video recommendation predicts user preference at the video level, while temporal video grounding localizes query-relevant moments. However,

local-aiarxiv-cs-cv

Dotting the Eye: An Intent-Driven Image Retouching Agent for Visual Focus Enhancement

arXiv:2609.01148v1 Announce Type: new Abstract: Image retouching is commonly formulated as enhancing overall visual quality through color adjustment, but in practice, it also serves to emphasize visua

local-aiarxiv-cs-cv

Drift-Aware LLM Routing with Sparse Contexts and Shared Budgets

arXiv:2609.00662v1 Announce Type: new Abstract: A multi-model language service must route each request while preserving workload-level budgets for compute, latency, memory, or monetary cost. Two featu

EGT-KG: Evidence-Grounded Typed KG Retrieval for Practical Scientific QA with Small Language Models

arXiv:2609.00479v1 Announce Type: new Abstract: For emerging scientific research domains, local Small Language Models (SLMs) are becoming more attractive, as they offer stronger privacy control and mo

Enoki: Efficient Multi-Level Hallucination Detection

arXiv:2609.00581v1 Announce Type: new Abstract: Ensuring factuality remains a critical challenge for deploying LLMs in high-stakes settings. Existing hallucination detectors usually operate at a singl

local-aiarxiv-cs-cl

ExBind: A Controlled Diagnostic Benchmark for Visual-to-Executable Correspondence

arXiv:2609.01344v1 Announce Type: new Abstract: Multimodal coding and editing systems must map a visible or semantic referent to the exact executable object that can be edited. A wrong reference may s

Exploring Nonlinear Body Oscillations for Natural Quadruped Gaits

arXiv:2609.00539v1 Announce Type: new Abstract: Animals' body morphology shapes the gait patterns they can perform, where mechanical resonance reduces the need for active control. By tuning posture an

researcharxiv-cs-ro

Exploring Sparse Autoencoders in Text-Based Causal Confounding Adjustment

arXiv:2609.01322v1 Announce Type: new Abstract: In many settings, studying causal questions based on text data requires adjusting for confounding information within texts. Yet there is a tradeoff in c

FoldingAgent: Inferring Parametric Origami Procedures from Demonstration Videos

arXiv:2609.00377v1 Announce Type: cross Abstract: We present FoldingAgent, an agentic framework for inferring explicit parametric folding programs directly from origami demonstration videos. Our frame

GRRM: Group Relative Reward Modeling for Machine Translation

arXiv:2602.14028v2 Announce Type: replace Abstract: While Group Relative Policy Optimization (GRPO) offers a powerful framework for LLM post-training, its effectiveness in open-ended domains like Mach

How Coinbase Wallet built an agent-first product development lifecycle

By redesigning planning, validation, and risk review around AI agents, Coinbase Wallet dramatically shortened the path from product idea to working software. The post How Coinbase Wallet built an agen

agentsarize-ai

Human-AI Co-Interpretation for Responsible AI: A Hermeneutic Perspective

arXiv:2609.00334v1 Announce Type: new Abstract: Across law, education, policy analysis, and public moral argumentation, LLM outputs are being used often for work that requires interpretations to be ju

safetyarxiv-cs-ai

Incremental Risk Assessment of Progressive Elder Financial Scams via Instruction-Tuned Small Language Models

arXiv:2609.00005v1 Announce Type: new Abstract: Financial scams targeting older adults increasingly occur through text and voice channels such as email, SMS, and phone calls, unfolding over multiple c

Independent verifiers improve agent output - but frontier verifiers are expensive. So we trained our own. Results on @GoogleDeepMind's FACTS…

Independent verifiers improve agent output - but frontier verifiers are expensive. So we trained our own. Results on @GoogleDeepMind's FACTS-Search: > No verifier: 89.4 (previously published SOTA) > W

agentsai21-labs--x

Applications

Individualized Algorithmic Advice as a Strategic Signal on Competitive Markets

arXiv:2511.09454v2 Announce Type: replace-cross Abstract: As algorithms increasingly mediate competitive decision-making, their influence extends beyond individual outcomes to shaping strategic market

applicationsarxiv-cs-ai

InSight: A Benchmark for Agentic Claim Verification in Interactive Visualizations

model-releasesarxiv-cs-cl

arXiv:2609.01383v1 Announce Type: new Abstract: Vision Language Models have demonstrated remarkable proficiency in interpreting static visual artifacts, but modern data analysis is inherently dynamic,

Inspicio: Open-Vocabulary, LLM-Based Sense Retrieval for Historical Languages

arXiv:2609.00998v1 Announce Type: cross Abstract: Word Sense Disambiguation has advanced rapidly for English and a handful of well-resourced modern languages, but it continues to assume the existence

Invalidation Contracts for Cross-Episode Agent Memory

arXiv:2609.00243v1 Announce Type: new Abstract: LLM agents that cache recovery suggestions from API errors can skip re-derivation in later episodes, spending fewer tokens and fewer model calls on cons

It Takes Two to Match: Co-Evolving Generative Retriever with Reinforcement Learning

model-releasesarxiv-cs-cl

arXiv:2609.00638v1 Announce Type: cross Abstract: Retrieval is the first stage of modern search and advertising systems, selecting a candidate set from a large item universe for downstream ranking and

Less Is More: Balancing Positive and Negative Space in Visual Concept Blending

arXiv:2609.00476v1 Announce Type: new Abstract: Graphic designers often blend visual concepts to communicate multiple ideas within a single image, leveraging positive and negative space to create bala

agentsarxiv-cs-cv

LLM-as-a-Demographic: Whom Sociodemographic Prompting Helps, and Whom It Hurts

arXiv:2609.00222v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as judges for subjective tasks, where annotators disagree and the relevant question is not only how a

LOOMSUM:Weaving Quantitative and Narrative Evidence for Faithful Long Text-Table Summarization

arXiv:2609.00241v1 Announce Type: new Abstract: Long documents often distribute important information across extensive narrative passages and multiple tables, making faithful summarization particularl

researcharxiv-cs-cl

Making Prospective Memory SLM-Shaped: Typed Intention Stores for Small-Model Agents

arXiv:2609.01272v1 Announce Type: new Abstract: Prospective memory means carrying out a deferred intention at the right future cue while other work continues. Benchmarks now isolate it as an agent ski

Tutorials

Manifold-Aware General Coded Computing for Straggler-Resilient Distributed Computing

arXiv:2609.00552v1 Announce Type: new Abstract: Existing coded-computing designs do not explicitly exploit the intrinsic structure of the input data. In communication systems, statistical structure an

tutorialsarxiv-cs-lg

Modeling Information Blackouts in Missing Not-At-Random Time Series Data

model-releasesarxiv-cs-lg

arXiv:2601.01480v3 Announce Type: replace-cross Abstract: Traffic forecasting systems rely on fixed sensor networks that frequently exhibit contiguous blackouts. Such outages are usually treated as ig

On Synthesis of Metric Interval Temporal Logics

arXiv:2609.01032v1 Announce Type: cross Abstract: Automated mining of formal specifications is vital for verifying real-time systems. However, existing passive learning approaches remain restricted to

On the Reliability of Generative Augmentation: A Wasserstein-Based Theoretical and Empirical Study

arXiv:2609.01410v1 Announce Type: cross Abstract: Generative data augmentation is widely used to mitigate class imbalance, yet its theoretical effect on downstream generalization remains poorly unders

researcharxiv-cs-lg

Online Regime-aware Calibration for Black-box Social Simulators via Posterior-assisted Evolutionary Dynamic Optimization

model-releasesarxiv-cs-lg

arXiv:2601.19481v2 Announce Type: replace-cross Abstract: Evolutionary dynamic optimization (EDO) commonly assumes that environmental changes can be detected from fitness variations and handled throug