Search: “evaluation”

VISTA: Dense Multi-Label Classroom Coding with Vision-Language Models

model-releasesarxiv-cs-cv

arXiv:2609.04550v1 Announce Type: new Abstract: Video-language benchmarks are usually constructed by the dataset authors without published reliability statistics, leaving the noise floor of the constr

7 Sept 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

You Really Didn't Get That? Benchmarking Social Pragmatic Inference for Indirect and Playful Chinese Online Comments

DGX agent

arXiv:2609.04384v1 Announce Type: cross Abstract: Chinese online comments often convey social meaning through indirect and playful language that is hard to interpret without context. Existing evaluati

model-releasesarxiv-cs-ai

7 Sept 2026

A Case Study on Emergent Cheating and Whistleblowing in Autonomous Research Swarms

arXiv:2609.04170v1 Announce Type: new Abstract: Multi-agent AI science ecosystems rely on agents possessing tools that allow them to communicate, coordinate, and build on each other's work. Yet this s

A Spectral Phase Admissibility Certificate for Complex Linear Maps

arXiv:2609.02911v1 Announce Type: cross Abstract: The paper imports the Kontsevich Segal Witten criterion from quantum gravity into machine learning to evaluate complex linear maps Standard techniques

researcharxiv-cs-cl

Anonymization, Not Elimination: Utility-Preserved Speech Anonymization

arXiv:2604.17000v1 Announce Type: cross Abstract: The growing reliance on large-scale speech data has made privacy protection a critical concern. However, existing anonymization approaches often degra

researcharxiv-cs-ai

Causal-Counterfactual RAG: The Integration of Causal-Counterfactual Reasoning into RAG

arXiv:2509.14435v3 Announce Type: replace Abstract: Large language models (LLMs) have transformed natural language processing (NLP), enabling diverse applications by integrating large-scale pre-traine

researcharxiv-cs-cl

Counterexamples as Feedback for Agent Self-Correction

arXiv:2609.02892v1 Announce Type: cross Abstract: Single-turn code-generation metrics understate a central property of deployed agents: whether they can repair a wrong artifact after receiving concret

CulturalMenuBench: Probing the Knowledge-Application Gap in Multimodal Culinary Reasoning

arXiv:2609.03526v1 Announce Type: new Abstract: Multimodal language models achieve near-ceiling scores on food recognition benchmarks, yet it remains unclear whether this success reflects genuine cult

Efficient Test-Time Adaptation through Human-AI Interaction

arXiv:2609.04141v1 Announce Type: new Abstract: AI agents are trained on population-scale data to encode broad capabilities spanning those of many practitioners. Yet the artifacts they produce rarely

Local Ai

Epistemic Warrant for LLM Recommendations: Characterizing the Basis for Reliance When Ground Truth Is Unavailable

arXiv:2609.04127v1 Announce Type: new Abstract: Large language models are increasingly used to support organizational decisions, yet users often lack a principled basis for assessing whether to rely o

local-aiarxiv-cs-ai

Evolving Excellence: Automated Optimization of LLM-based Agents

arXiv:2512.09108v2 Announce Type: replace-cross Abstract: Agentic AI systems built on large language models (LLMs) offer significant potential for automating complex workflows, from software developme

Explainable Convolutional Neural Networks for Retinal Fundus Classification and Cutting-Edge Segmentation Models for Retinal Blood Vessels from Fundus Images

arXiv:2405.07338v2 Announce Type: replace-cross Abstract: Early detection of vision-threatening conditions such as diabetic retinopathy, glaucoma, and age-related macular degeneration depends on retin

researcharxiv-cs-cv

FiMI Banking: A Sovereign Model for Indian Retail Banking

arXiv:2609.03960v1 Announce Type: new Abstract: Banks need conversational systems that can answer product questions, assist customers with account-related requests, and operate safely within strict op

FrameBench:A Language Understanding Benchmark Based on Frame Semantics

arXiv:2609.03370v1 Announce Type: new Abstract: In frame semantics, sentence comprehension is assumed to proceed by relating lexical meaning to background knowledge called semantic frames, thereby ena

GeoNatureAgent Benchmark: Benchmarking LLM Agents for Environmental Geospatial Analysis Across Frontier and Open-Weight Foundation Models

arXiv:2606.12821v2 Announce Type: replace Abstract: Environmental scientists spend disproportionate effort on data wrangling rather than analysis. New AI agents can be a helpful tool, but no benchmark

GPS-Bench: A Governance Policy Benchmark for Automating Policy Analysis

arXiv:2609.03553v1 Announce Type: new Abstract: Policy analysis requires more than predicting whether a proposal will pass: it requires identifying who will be affected, how those actors respond, and

Mind the Gap: Robustness Risks in PII Detection Systems

model-releasesarxiv-cs-lg

arXiv:2609.03464v1 Announce Type: new Abstract: Personally Identifiable Information (PII) detection is a foundational component of data protection infrastructure where missed entities constitute direc

PACE: Towards Surfacing Hidden Conflicts in User Requests

arXiv:2609.03293v1 Announce Type: new Abstract: Personalized assistants should not only comply with user requests but also assess whether those requests are appropriate given the user's current circum

Privacy Leakage in Federated Learning: Gradient-Based Client Identity Inference and Defenses for Inertial Sensing in Vehicular Edge Networks

model-releasesarxiv-cs-lg

arXiv:2609.02971v1 Announce Type: cross Abstract: As vehicular networks move toward 5G/6G edge intelligence, federated learning (FL) is widely promoted as a privacy-preserving way for vehicles and inf

Hardware

RobustSeiz: An Open-Source Framework for Benchmarking the Robustness of EEG Seizure Detection Models

arXiv:2609.04007v1 Announce Type: new Abstract: Despite strong performance on held-out electroencephalography (EEG) data, seizure detectors may fail under real-world acquisition variability, artifacts

hardwarearxiv-cs-lg

Selective Hypergraph Refinement for Frozen Graph Clustering

arXiv:2609.03265v1 Announce Type: new Abstract: Existing graph-clustering methods typically improve clustering performance by optimizing model parameters and node representations. Effective means of f

researcharxiv-cs-lg

Uncertainty Is Not a Safety Net for Clinical VQA, but Can It Anticipate Model Failure?

arXiv:2606.16583v2 Announce Type: replace Abstract: Safe deployment of clinical vision-language models (VLMs) requires reliable uncertainty estimation (UE): a signal indicating when predictions should

Understanding Autonomous Driving Datasets by Describing Differences between Image Subsets in Natural Language

arXiv:2609.03677v1 Announce Type: cross Abstract: Understanding the composition of large-scale autonomous driving datasets is essential for safety, robustness, and reliable operation across domains. F

VisCAD: A Foundation Model Suite with Multimodal Industrial CAD Intelligence

arXiv:2609.03811v1 Announce Type: cross Abstract: AI-assisted computer-aided design (CAD) for industrial products involves two challenging phases. Part-level generation maps diverse forms of user inte

researcharxiv-cs-cl

When Models Edit Too Much: On the Fidelity of Minimal Code Edits

arXiv:2609.04061v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used to edit existing code, but correctness alone is not enough: useful repairs should also be minimal,

WISE: World-model-guided Imagination Scheduling for Efficient Post-training of Vision-Language-Action Models

arXiv:2609.03681v1 Announce Type: new Abstract: Post-training VLA policies typically rely on supervised fine-tuning with costly expert demonstrations or reinforcement learning with expensive and poten

safetyarxiv-cs-ro

Beyond Appearance: Can Multimodal Large Language Models Exploit Vertical Structure for Remote Sensing Natural Scene Understanding?

model-releasesarxiv-cs-cv

arXiv:2605.25784v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) have advanced rapidly in remote-sensing analysis, yet existing evaluations remain predominantly 2D-centric.

Candidate Generation and Definition-Guided Verification for Sentence-Level Depression Symptom Recognition

arXiv:2609.01833v1 Announce Type: new Abstract: Sentence-level recognition of depression symptoms is challenging because similar expressions can differ in symptom relevance, and language-model inferen

Cite or Decline: A Strict Course-Grounded Chatbot for STEM Lecture Videos

arXiv:2609.01846v1 Announce Type: new Abstract: Recorded lecture videos, often enhanced with search and summarization features, are a standard study resource. However, students cannot easily ask cours

CORAL: An LLM-Native Harness for Production Recommender Systems

arXiv:2609.02730v1 Announce Type: new Abstract: Production recommender systems shape what billions of people see, and sustaining their performance requires continual optimization: as content, user beh

CrashDiffuser: VLM-Guided Collision Intent Reasoning for Fine-Grained Safety-Critical Traffic Scenario Generation

arXiv:2609.02270v1 Announce Type: cross Abstract: Generating safety-critical scenarios is essential for evaluating autonomous driving systems. However, existing generators primarily focus on inducing

From Reweighting to Rewriting: Unlocking the Intervention Effects of Influential Samples in Training Data Attribution

arXiv:2609.02771v1 Announce Type: cross Abstract: Training data attribution (TDA) aims to identify training examples that shape model behavior, but its intervention value depends on both which example

HyperMC: Multi-Fidelity Hyperparameter Tuning for Stochastic Gradient MCMC

arXiv:2609.02138v1 Announce Type: cross Abstract: Stochastic gradient Markov chain Monte Carlo (SGMCMC) methods enable scalable Bayesian inference, but their performance depends strongly on hyperparam

researcharxiv-cs-lg

On-Policy Distillation Meets Off-Policy GRPO: Training Compact Instruction-Following Rerankers

arXiv:2609.01947v1 Announce Type: cross Abstract: Compact instruction-following rerankers are attractive for deployment, but conventional distillation pipelines typically train students by offline imi

Orthogonal Ensembles and Tested Explanations for Performer-Independent Body-Motion Emotion Recognition

arXiv:2609.02510v1 Announce Type: new Abstract: We study body-only, 12-class acted-emotion classification from skeleton motion under leave-performer-out (LPO) evaluation, a hard, underdetermined setti

safetyarxiv-cs-cv

PhoenixNest-Video: Evidence-Grounded Multimodal Agent Framework for Automated Video Interview Assessment

arXiv:2609.02231v1 Announce Type: new Abstract: Interview assessment requires per-criterion judgments grounded in behavioral evidence, yet surging applicant volumes have made human-only evaluation cos

Probing Cultural Signals in Large Language Models through Author Profiling

arXiv:2603.16749v3 Announce Type: replace Abstract: Large language models (LLMs) are increasingly deployed in applications with societal impact, raising concerns about the cultural biases they encode.

Quantum Speedups for Sampling and Non-convex Optimization with Stochastic Oracles

arXiv:2504.03626v2 Announce Type: replace-cross Abstract: We present quantum speedups for sampling from distributions of the form pipropto e^{-f} on R^d. We consider two stochastic oracle models: a st

researcharxiv-cs-lg

Applications

UnCapsTSR: An Unsupervised Transformer-based Image Super-Resolution Approach for Capsule Endoscopy Images

arXiv:2609.02476v1 Announce Type: new Abstract: Wireless Capsule Endoscopy (WCE) captures and streams video while passing through a patient's Gastrointestinal (GI) tract and is used to examine its irr

applicationsarxiv-cs-cv

Local Ai

Unfolding the Leech Lattice: Fused Multi-Shell Decoding and VRAM Layouts for 2-Bit LLM Weights

arXiv:2609.02652v1 Announce Type: new Abstract: Leech-lattice vector quantization holds the strongest reported 2-bit quality under its own evaluation protocol. Its kernel decodes one shell; we found n

local-aiarxiv-cs-lg

Applications

Using Large Language Models for Legal Decision-Making in Austrian Value-Added Tax Law: A Comparative Study

arXiv:2507.08468v2 Announce Type: replace Abstract: This paper provides an experimental evaluation of the capability of large language models (LLMs) to assist in legal decision-making within the frame

applicationsarxiv-cs-cl

When Persona Attributes Improve Population Alignment in Large Language Models

arXiv:2609.02526v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly used to predict the responses of human participants in survey panels. Towards that goal, persona prompting

Applications

Wound3DAssist: A Practical Framework for 3D Wound Assessment

arXiv:2508.17635v2 Announce Type: replace Abstract: Managing chronic wounds remains a major healthcare challenge, with clinical assessment often relying on subjective and time-consuming manual documen

applicationsarxiv-cs-cv

A Compact Robotic Finger with 2-DoF MCP Joint Embedding DoF-Selective Passive Continuously Variable Transmission for Wide Force-Speed Operating Range

arXiv:2609.00769v1 Announce Type: new Abstract: This letter presents a compact two-degree-of-freedom (DoF) robotic finger with a flexion-selective passive continuously variable transmission (CVT) to a

agentsarxiv-cs-ro

A Hybrid Insider Threat Detection Framework Combining Multi-Agent Simulation, Layered SIEM Correlation, and Theory-of-Mind Reasoning

arXiv:2601.04243v2 Announce Type: replace-cross Abstract: This paper presents a hybrid insider threat detection framework for enterprise environments, integrating multi-agent simulation, layered SIEM

AI Morbidity and Mortality: A Framework for Clinical AI Failure Review

arXiv:2609.00076v1 Announce Type: new Abstract: Clinical artificial intelligence is increasingly embedded in real-world care, yet existing safety mechanisms are poorly suited to reconstructing and lea

AI Should Not Only Be Helpful. It Should Be Contingent. Artificial Intimacy, Sycophancy, and the Future of Social Learning

arXiv:2609.00211v1 Announce Type: new Abstract: Conversational artificial intelligence is increasingly embedded in everyday social environments, where it functions as both an informational tool and a

Beyond Blind Compliance: Benchmarking Task Verification in OCR Reasoning

model-releasesarxiv-cs-cv

arXiv:2609.00232v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have achieved strong performance on OCR-centric document understanding and text-rich visual reasoning benchmark