Search: “evaluation”

LLM-based Schema-Guided Extraction and Validation of Missing-Person Intelligence from Heterogeneous Data Sources

arXiv:2604.06571v1 Announce Type: cross Abstract: Missing-person and child-safety investigations rely on heterogeneous case documents, including structured forms, bulletin-style posters, and narrative

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

LPM 1.0: Video-based Character Performance Model

DGX agent

arXiv:2604.07823v1 Announce Type: new Abstract: Performance, the externalization of intent, emotion, and personality through visual, vocal, and temporal behavior, is what makes a character alive. Lear

model-releasesarxiv-cs-cv

10 Apr 2026

MSG Score: Automated Video Verification for Reliable Multi-Scene Generation

arXiv:2411.19121v2 Announce Type: replace-cross Abstract: While text-to-video diffusion models have advanced significantly, creating coherent long-form content remains unreliable due to stochastic sam

applicationsarxiv-cs-ai

NTIRE 2026 Challenge on Bitstream-Corrupted Video Restoration: Methods and Results

model-releasesarxiv-cs-cv

arXiv:2604.06945v2 Announce Type: replace Abstract: This paper reports on the NTIRE 2026 Challenge on Bitstream-Corrupted Video Restoration (BSCVR). The challenge aims to advance research on recoverin

On Emotion-Sensitive Decision Making of Small Language Model Agents

arXiv:2604.06562v1 Announce Type: new Abstract: Small language models (SLM) are increasingly used as interactive decision-making agents, yet most decision-oriented evaluations ignore emotion as a caus

Agents

OrgForge: A Multi-Agent Simulation Framework for Verifiable Synthetic Corporate Corpora

arXiv:2603.14997v2 Announce Type: replace Abstract: Building and evaluating enterprise AI systems requires synthetic organizational corpora that are internally consistent, temporally structured, and c

agentsarxiv-cs-cl

The End of the Foundation Model Era: Open-Weight Models, Sovereign AI, and Inference as Infrastructure

arXiv:2604.06217v1 Announce Type: cross Abstract: The foundation model era -- roughly 2020 to 2025 -- is over. The forces that defined it have inverted. Open source models have reached frontier perfor

The Persistence of Cultural Memory: Investigating Multimodal Iconicity in Diffusion Models

arXiv:2511.11435v3 Announce Type: replace Abstract: The ambiguity between generalization and memorization in TTI diffusion models becomes pronounced when prompts invoke culturally shared visual refere

ToxReason: A Benchmark for Mechanistic Chemical Toxicity Reasoning via Adverse Outcome Pathway

arXiv:2604.06264v1 Announce Type: cross Abstract: Recent advances in large language models (LLMs) have enabled molecular reasoning for property prediction. However, toxicity arises from complex biolog

When Personalization Tricks Detectors: The Feature-Inversion Trap in Machine-Generated Text Detection

model-releasesarxiv-cs-cl

arXiv:2510.12476v2 Announce Type: replace Abstract: Large language models (LLMs) have grown more powerful in language generation, producing fluent text and even imitating personal style. Yet, this abi

Why Are We Lonely? Leveraging LLMs to Measure and Understand Loneliness in Caregivers and Non-caregivers

model-releasesarxiv-cs-cl

arXiv:2604.07834v1 Announce Type: new Abstract: This paper presents an LLM-driven approach for constructing diverse social media datasets to measure and compare loneliness in the caregiver and non-car

WUTDet: A 100K-Scale Ship Detection Dataset and Benchmarks with Dense Small Objects

arXiv:2604.07759v1 Announce Type: new Abstract: Ship detection for navigation is a fundamental perception task in intelligent waterway transportation systems. However, existing public ship detection d

A Quantum Machine Learning Approach to Content-Based Media Recommendation

model-releasesarxiv-cs-lg

arXiv:2610.21562v1 Announce Type: new Abstract: We use quantum machine learning techniques to develop a content-based media recommender system and evaluate its performance on TV programmes using textu

A Response to the Reply Presented in 'A Fair Comparison of Sliding-Mode and Immersion-and-Invariance Observers'

arXiv:2610.20815v1 Announce Type: cross Abstract: In response to the reply presented in [Munoz-Vazquez and Sanchez-Torres(2026)], this technical report extends the experimental evaluation of position-

researcharxiv-cs-ro

Local Ai

Agent Skill Framework: Perspectives on the Potential of Small to Medium Language Models in Industrial Environments

arXiv:2602.16653v4 Announce Type: replace Abstract: Skills are getting increasingly used in recent agentic frameworks, performing robustly with proprietary LLMs. Yet, their effectiveness for small and

local-aiarxiv-cs-ai

Auditing Escalation Reliability in Healthcare LLM Agents: A Perturbation-Controlled Benchmark of Workflow-State Failures

arXiv:2610.21270v1 Announce Type: new Abstract: Trustworthy biomedical AI requires reliable action selection when evidence is missing, stale, conflicting, or late, not only accurate answers on static

BD-HazardVLM: Probing Vision-Language Models for Latent Defensive-Driving Hazards in Bangladesh Road Scenes

model-releasesarxiv-cs-cv

arXiv:2610.20627v1 Announce Type: new Abstract: Vision-language models are increasingly used for driving-scene understanding, yet their defensive reasoning under weakly structured Global South traffic

Agents

CARA: Causally Guided Retrieval Agent for Question Answering

arXiv:2610.22017v1 Announce Type: new Abstract: Retrieval-augmented generation over text-rich knowledge graphs requires identifying evidence that contributes to answering a question, rather than merel

agentsarxiv-cs-ai

Hardware

CertEx: Exact Visual Retrieval at Scale by Certified Exclusion

arXiv:2610.21325v1 Announce Type: new Abstract: Exact k-nearest-neighbor (kNN) search over image descriptors and embeddings underlies visual retrieval, near-duplicate detection, the evaluation of lear

hardwarearxiv-cs-cv

Data World: Scaling Data Environments from Scratch

arXiv:2610.21656v1 Announce Type: new Abstract: Data agents use code to process heterogeneous files and derive analytical insights. Scaling their training faces costly environment curation, privacy an

Evolving Together, Failing Apart: The Skill-Policy Co-evolution Trap in Self-Improving Agents

arXiv:2610.20845v1 Announce Type: new Abstract: Skill-policy co-evolution, in which an agent's policy model and its skill bank improve each other during training, is a promising paradigm for self-impr

Exploring the Design Space of Permutation Diffusion LLMs

arXiv:2610.20635v1 Announce Type: cross Abstract: Permutation generation with language models requires both text-conditioned ranking and a global one-to-one assignment between candidates and output po

researcharxiv-cs-ai

FlowBudget: Training-Free Sampling-Budget Estimation for Flow Matching Models

arXiv:2610.20636v1 Announce Type: cross Abstract: Sampling from continuous flow-based generators such as flow matching models requires numerical ODE or SDE integration, making inference cost depend on

IDfRA: Self-Verification for Iterative Design in Robotic Assembly

arXiv:2509.16998v2 Announce Type: replace Abstract: Design for Robotic Assembly (DfRA) remains largely dependent on manual planning and heuristic simulation, limiting scalability and robustness in com

applicationsarxiv-cs-ro

International Multi-Centre Validation of Unsupervised Domain Adaptation for Precise Discrimination between Normal and Abnormal Retinal Development

arXiv:2610.21719v1 Announce Type: new Abstract: Arrested retinal development can cause childhood visual impairment, but grading optical coherence tomography scans is difficult to standardise across de

Language Is a Security Surface for Agent Guards

arXiv:2610.22244v1 Announce Type: cross Abstract: Step-level guards decide, before each tool call, whether an agent's next action is safe given the user's request and the trajectory so far. Users writ

Local Ai

LICOA: Learning Instruction-Conditioned Optical Actions for Mobile Spatial Augmented Reality

arXiv:2610.21282v1 Announce Type: cross Abstract: Spatial augmented reality (SAR) augments physical environments with projected content, but most systems assume that the projector pose, target region,

local-aiarxiv-cs-cv

Momentum, Commentary Tone, and Earnings Surprise in LLM Financial Forecasts

arXiv:2610.22043v1 Announce Type: cross Abstract: Which inputs drive a language model's financial forecast? We construct synthetic earnings announcements that independently reverse 20-day momentum, no

NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness

arXiv:2609.08183v2 Announce Type: replace Abstract: Recursive self-improvement (RSI) requires a concrete mechanism through which an AI system observes its capabilities and converts that evidence into

safetyarxiv-cs-cl

No Single Tokenizer Feature Reliably Predicts Downstream Language Model Performance

arXiv:2610.21679v1 Announce Type: new Abstract: Tokenization is a critical component of the language modeling pipeline, but it is poorly understood. Tokenizers can impact downstream performance, but t

researcharxiv-cs-cl

OmicsBench: a long-horizon multi-turn benchmark of AI agents on research-study-scale bioinformatics

arXiv:2610.21074v1 Announce Type: new Abstract: Computational biologists increasingly delegate substantial analyses to AI agents in long-horizon, multi-turn sessions, yet most benchmarks of agents' bi

Perceptual Comparisons of Viscoelastic Renderings: Fractional- vs Integer-Order Models

model-releasesarxiv-cs-ro

arXiv:2610.21965v1 Announce Type: new Abstract: Realistic haptic rendering of viscoelastic materials requires reproducing time-dependent behaviors such as creep and stress relaxation, which arise from

Policy-Aligned Predictive Verification for Adaptive VLA Action-Chunk Execution

arXiv:2610.21434v1 Announce Type: cross Abstract: Vision-language-action (VLA) policies generate action sequences that reduce repeated inference, but deciding how much of each sequence to execute is c

safetyarxiv-cs-lg

PriorityFEC: Deadline-Aware Streaming FEC for KV-Cache Handoff in Edge Multi-Agent Systems

arXiv:2610.21390v1 Announce Type: cross Abstract: Multi-agent large language model (LLM) systems are increasingly deployed at the edge to support complex tasks that require collaboration and informati

Representation Redistribution in Sparse Autoencoders

arXiv:2610.21240v1 Announce Type: cross Abstract: Sparse autoencoders (SAEs) decompose language model activations into sparse features, but prompt transformations designed to preserve the underlying r

Retrieved but Not Read: Understanding Why Search-Augmented LLMs Fail to Use Available Evidence

arXiv:2610.21731v1 Announce Type: cross Abstract: Web search allows LLMs to access up-to-date information, but it remains unclear why they sometimes produce outdated answers even when relevant evidenc

researcharxiv-cs-ai

Sign Betting for Misspecified Regression: Variance Adaptivity and Optimal Approximation

arXiv:2610.20903v1 Announce Type: new Abstract: We study bounded regression under model misspecification, evaluating a function f by its L_1(P_X) distance to the conditional mean eta(x)=E[Ymid X=x], r

applicationsarxiv-cs-lg

SWE-Nexus: Automated Composition of Software Engineering Tasks from Test Execution

arXiv:2610.20038v2 Announce Type: replace-cross Abstract: Historical code changes provide convenient task boundaries, but do not identify which production functions selected tests exercise or support

Tool-Augmented Large Language Models for Reliable Medical Calculation from Patient Notes

arXiv:2610.21477v1 Announce Type: new Abstract: Medical calculators translate raw patient observations into clinically actionable values and scores. However, applying these calculators directly to fre

VELD-QA: A Large-Scale Dataset for Visual Evidence Grounding and Question Answering in Long Documents

model-releasesarxiv-cs-cl

arXiv:2610.20964v1 Announce Type: cross Abstract: Existing long-document QA benchmarks rarely combine large-scale human-authored questions with detailed visual evidence annotations, limiting diagnosis

Agents

What Does History Add? Calendar Controls and Information-Timing Audits for University Trajectory Forecasting

arXiv:2610.21419v1 Announce Type: new Abstract: We audit the predictive value of historical summaries in a rule-based university trajectory simulator. Seventeen ridge specifications and persistence se

agentsarxiv-cs-lg

When Correctness Feedback Erases Evidence: Phase-Separated Completeness Auditing in Verus

arXiv:2610.20676v1 Announce Type: new Abstract: Correctness feedback suppresses the very evidence that specification-completeness auditing is designed to uncover: programs that satisfy a written contr

researcharxiv-cs-ai

When do quantum views help? Complementary classical-quantum representations in multi-view fusion

arXiv:2610.21395v1 Announce Type: cross Abstract: Recent studies have reported promising results from quantum machine learning in drug discovery, healthcare, materials science and cybersecurity. Resea

When Models Misread Ink: Auditing VLMs for Arabic Calligraphy Recognition

model-releasesarxiv-cs-cv

arXiv:2610.22018v1 Announce Type: new Abstract: Arabic calligraphy is a high-stakes cultural visual domain for Muslim communities, yet VLM evaluations rarely test its fine-grained script traditions. W

Local Ai

Wolof-Adapted Industry-Ready Open-Weight Language Models

arXiv:2610.20824v1 Announce Type: cross Abstract: Wolof is spoken by 23M people, mostly in Senegal, but remains weakly supported by open-weight language models, while API models raise cost, governance

local-aiarxiv-cs-ai

WorldCast: Exploring Intelligent Visual Generation in World State Prediction

arXiv:2610.20731v1 Announce Type: cross Abstract: Humans interpret multimodal observations of the world and forecast how it will evolve. Recent multimodal generative systems have demonstrated similar

A Graph-Based Analysis of Comparability, Scale, and Attribution in Private Transformer Inference

arXiv:2610.19607v1 Announce Type: cross Abstract: Rising privacy concerns around large language models have accelerated research in private Transformer inference (PTI). Synthesizing the empirical clai

applicationsarxiv-cs-lg

15 Oct 2026

A large-scale pipeline for LLM-assisted corpus annotation: variation and change in the English consider construction