Search: “evaluation”

SYN-DIGITS: A Synthetic Control Framework for Calibrated Digital Twin Simulation

arXiv:2604.07513v1 Announce Type: cross Abstract: AI-based persona simulation -- often referred to as digital twin simulation -- is increasingly used for market research, recommender systems, and soci

safetyarxiv-cs-cl

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Synthetic Homes: A Multimodal Generative AI Pipeline for Residential Building Data Generation under Data Scarcity

DGX agent

arXiv:2509.09794v4 Announce Type: replace Abstract: Computational models have emerged as powerful tools for multi-scale energy modeling research at the building and urban scale, supporting data-driven

model-releasesarxiv-cs-ai

10 Apr 2026

Temporal Inversion for Learning Interval Change in Chest X-Rays

arXiv:2604.04563v2 Announce Type: replace-cross Abstract: Recent advances in vision--language pretraining have enabled strong medical foundation models, yet most analyze radiographs in isolation, over

Applications

exttt{SEM-CTRL}: Semantically Controlled Decoding

arXiv:2503.01804v4 Announce Type: replace Abstract: Ensuring both syntactic and semantic correctness in Large Language Model (LLM) outputs remains a significant challenge, despite being critical for r

applicationsarxiv-cs-cl

The AI Skills Shift: Mapping Skill Obsolescence, Emergence, and Transition Pathways in the LLM Era

arXiv:2604.06906v1 Announce Type: cross Abstract: As Large Language Models reshape the global labor market, policymakers and workers need empirical data on which occupational skills may be most suscep

The Art of Building Verifiers for Computer Use Agents

arXiv:2604.06240v1 Announce Type: cross Abstract: Verifying the success of computer use agent (CUA) trajectories is a critical challenge: without reliable verification, neither evaluation nor training

agentsarxiv-cs-ai

The Traveling Thief Problem with Time Windows: Benchmarks and Heuristics

arXiv:2604.06724v1 Announce Type: cross Abstract: While traditional optimization problems were often studied in isolation, many real-world problems today require interdependence among multiple optimiz

Towards Hierarchical Multi-Step Reward Models for Enhanced Reasoning in Large Language Models

arXiv:2503.13551v5 Announce Type: replace Abstract: Recent studies show that Large Language Models (LLMs) achieve strong reasoning capabilities through supervised fine-tuning or reinforcement learning

researcharxiv-cs-cl

TR-EduVSum: A Turkish-Focused Dataset and Consensus Framework for Educational Video Summarization

model-releasesarxiv-cs-cl

arXiv:2604.07553v1 Announce Type: new Abstract: This study presents a framework for generating the gold-standard summary fully automatically and reproducibly based on multiple human summaries of Turki

Tutorials

Tracking Adaptation Time: Metrics for Temporal Distribution Shift

arXiv:2604.07266v1 Announce Type: new Abstract: Evaluating robustness under temporal distribution shift remains an open challenge. Existing metrics quantify the average decline in performance, but fai

tutorialsarxiv-cs-lg

Applications

Unsupervised Neural Network for Automated Classification of Surgical Urgency Levels in Medical Transcriptions

arXiv:2604.06214v1 Announce Type: cross Abstract: Efficient classification of surgical procedures by urgency is paramount to optimize patient care and resource allocation within healthcare systems. Th

applicationsarxiv-cs-ai

Validated Intent Compilation for Constrained Routing in LEO Mega-Constellations

arXiv:2604.07264v1 Announce Type: cross Abstract: Operating LEO mega-constellations requires translating high-level operator intents ('reroute financial traffic away from polar links under 80 ms') int

VisCoder2: Building Multi-Language Visualization Coding Agents

arXiv:2510.23642v2 Announce Type: replace-cross Abstract: Large language models (LLMs) have recently enabled coding agents capable of generating, executing, and revising visualization code. However, e

Visually-grounded Humanoid Agents

model-releasesarxiv-cs-cv

arXiv:2604.08509v1 Announce Type: new Abstract: Digital human generation has been studied for decades and supports a wide range of real-world applications. However, most existing systems are passively

What They Saw, Not Just Where They Looked: Semantic Scanpath Similarity via VLMs and NLP metric

arXiv:2604.08494v1 Announce Type: cross Abstract: Scanpath similarity metrics are central to eye-movement research, yet existing methods predominantly evaluate spatial and temporal alignment while neg

safetyarxiv-cs-cl

What's Missing in Screen-to-Action? Towards a UI-in-the-Loop Paradigm for Multimodal GUI Reasoning

arXiv:2604.06995v1 Announce Type: new Abstract: Existing Graphical User Interface (GUI) reasoning tasks remain challenging, particularly in UI understanding. Current methods typically rely on direct s

A 2D Image Feedback-Based Autonomous Endovascular Navigation Method: A Perception and Control Framework

arXiv:2610.21481v1 Announce Type: new Abstract: In endovascular interventions, physicians rely on planar DSA and X-ray fluoroscopy to interpret vessel anatomy and device motion, yet converting these i

agentsarxiv-cs-ro

A team of Gemini 4 Argon agents beats Minecraft

arXiv:2610.22319v1 Announce Type: new Abstract: We placed four Gemini 4 Argon agents in a sandboxed Minecraft survival world and gave them one goal: defeat the Ender Dragon. Each agent controlled a pl

Agent Status Protocol (ASP): A Lightweight Specification for State Reporting in Multi-Agent Systems

arXiv:2610.21538v1 Announce Type: new Abstract: The Agent Status Protocol (ASP) defines a lightweight way for heterogeneous AI agents to report their operational state to a status server, and for obse

agentsarxiv-cs-ai

AI Knows Where You Are: Exposure, Bias, and Inference in Multimodal Geolocation with KoreaGEO

model-releasesarxiv-cs-cv

arXiv:2506.03371v2 Announce Type: replace Abstract: Recent advances in vision-language models (VLMs) have enabled accurate image-based geolocation, raising serious concerns about location privacy risk

All-in-One Memory: Process-Rewarded Reinforcement Learning for Memory Agents

arXiv:2610.21147v1 Announce Type: new Abstract: Large language models increasingly rely on external memory to answer queries grounded in long-horizon histories such as multi-session dialogues and leng

AlphaDiana: A Measurement System for Agents in Verifiable Reasoning Tasks

arXiv:2610.20675v1 Announce Type: new Abstract: Agents pair reasoning models with harnesses that organize model calls, execute tools, load skill instructions, and retain history in memory. Understandi

agentsarxiv-cs-ai

Anticipatory Commonsense with Moving Objects: An ASP-Based Framework for Predictive Reasoning with Interacting Trajectories

arXiv:2610.20867v1 Announce Type: new Abstract: We present a general declarative framework for anticipatory reasoning about interactive motion in complex dynamic environments. Our focus is on (explain

Approve What, Exactly? Effect Binding and Trusted Rendering for Agent Step-Up Authorization

arXiv:2610.21063v1 Announce Type: cross Abstract: AI agents now pause for approval before they send money, delete files or email outsiders, and that approval is usually treated as a second factor. We

Are You Sure Your LLM Is Sure? Repairing and Auditing Confidence

arXiv:2610.22139v1 Announce Type: new Abstract: Confidence scores determine whether an LLM answer is accepted, reviewed, or regenerated, yet scalar recalibration can only correct errors visible throug

Asynchrony Is Nearly Free for Evolution Strategies on Long-Horizon LLM Agentic Tasks

arXiv:2610.04196v2 Announce Type: replace Abstract: Synchronous policy updates can limit the efficiency of post-training for long-horizon LLM agents. When trajectories span multiple interaction turns,

Athanor: An Agent-Native System for Autonomous Post-Training Research

arXiv:2610.21055v1 Announce Type: new Abstract: Recursive self-improvement, in which AI systems build stronger AI systems, is one promising route to superintelligence. We study a weaker form that can

Bridging the Markerless Tracking Validation Gap: Intraoperative X-ray Workflow Integration

arXiv:2610.21696v1 Announce Type: new Abstract: Markerless intraoperative tracking of spinal anatomy via RGB-D sensors is a promising alternative to invasive bone-anchored fiducials, yet no existing c

researcharxiv-cs-cv

Can LLMs Tell Stories Out of Order? A Corpus and Benchmark for Nonlinear Narrative Generation

arXiv:2610.21468v1 Announce Type: cross Abstract: Every story has two orders: the order in which its events happen and the order in which they are told. A story is nonlinear when the two differ. We in

CBF-Based Control Allocation for Omnidirectional Tiltrotor Aerial Robots

arXiv:2610.22057v1 Announce Type: new Abstract: Actively tilting aerial robots can generate six-dimensional wrenches, but slow servo response can make a desired wrench infeasible during reconfiguratio

researcharxiv-cs-ro

Change the Number, Change the Answer: Assessing Rating Scale Sensitivity in LLM-Based Text Scoring

arXiv:2610.22187v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used in computational social science to assign scalar scores to social and psychological constructs. How

researcharxiv-cs-ai

CLUE: Uncovering Social Context for Pragmatic Understanding

model-releasesarxiv-cs-cl

arXiv:2610.22167v1 Announce Type: new Abstract: Understanding a conversation requires connecting what is said to the speakers' relationships, expectations, and earlier exchanges. Prior work shows that

CoDA: Co-Evolution of Data Engines and Action Policies

arXiv:2610.22362v1 Announce Type: cross Abstract: Generative simulation can automate robot environment construction, but physically valid environments are not necessarily useful for training. The chal

De-Risking Robotic Welding for In-Space Metal Joining Through Physics-Grounded Digital Twins

model-releasesarxiv-cs-ro

arXiv:2610.21939v1 Announce Type: new Abstract: Growing interest in in-space servicing, manufacturing, and assembly has renewed attention on reliable metal joining for modular construction and on-orbi

Dexterity from Supervised Play

arXiv:2610.22340v1 Announce Type: cross Abstract: How can robots autonomously collect the contact-rich experience needed to learn dexterous manipulation? We present DSP: Dexterity from supervised play

Local Ai

DINO-FIL: Multi-Layer Transformer Fusion for Generative Inpainting Forgery Localization

arXiv:2610.21780v1 Announce Type: cross Abstract: We propose DINO-FIL, a transformer-based framework for pixel-level localization of generative image forgeries. The method leverages multi-layer repres

local-aiarxiv-cs-ai

Discovering state-of-the-art quantum circuits with large language models

arXiv:2610.22367v1 Announce Type: cross Abstract: Significant efforts are currently being directed toward the implementation of large-scale quantum information processors, but realizing useful quantum

researcharxiv-cs-ai

FANTF: Fuzzy attention network based transformers for time series analysis

model-releasesarxiv-cs-lg

arXiv:2504.00070v2 Announce Type: replace Abstract: This paper introduces Fuzzy Attention Network-Based Transformer (FANTF), an approach for time series forecasting, classification, and anomaly detect

FIRM: Fisher-Informed Retention Merging for Federated LLM Unlearning

arXiv:2610.21720v1 Announce Type: cross Abstract: Federated LLM unlearning addresses targeted knowledge removal when forget and retain data remain distributed across private clients and are inaccessib

FlashAttention with Statistics: Low-Overhead Attention Features for Compact Hallucination Detectors

arXiv:2610.21483v1 Announce Type: new Abstract: Large language models can produce fluent answers that the supplied context does not support. A compact frozen proxy model can detect such answers by rea

From Adults to Children: Benchmarking Foundation Models for Chest X-Ray Classification under Domain Shift

model-releasesarxiv-cs-cv

arXiv:2610.21809v1 Announce Type: new Abstract: Foundation models have shown significant potential across diverse fields and have been applied to medical imaging, but their robustness across patient p

FusionAudit: Pathway-Conditioned Robustness Auditing for Native Multimodal Models

arXiv:2610.21667v1 Announce Type: new Abstract: As vision-language models (VLMs) transition from frozen-encoder pipelines to native multimodal architectures, the visual channel increasingly serves as

researcharxiv-cs-cv

GraphCompliance: Structure-Aware Regulatory Compliance through Policy-Context Graph Alignment

arXiv:2510.26309v2 Announce Type: replace Abstract: Regulatory compliance is an important requirement in many industrial and administrative settings. Yet compliance assessment remains difficult becaus

Human Interventions as Labels: Localizing, Steering, and (Sometimes) Editing the Computations Behind LLM Agent Failures

arXiv:2610.21708v1 Announce Type: cross Abstract: When an LLM agent misbehaves, a human steps in, and that intervention is usually discarded or replayed as training data. We treat it instead as a meas

Identifying Effective Strategies in Prompt Evolution for Stress and Emotion Prediction

arXiv:2610.21407v1 Announce Type: new Abstract: Early stress detection and risk prediction are crucial for timely mental health assessment and support. While large language models have recently shown

researcharxiv-cs-cl

Intern-Decision: Efficient Multimodal Decision Making with Autoregressive Masked Language Modeling

arXiv:2610.22131v1 Announce Type: new Abstract: Interactive agents repeatedly choose among a finite set of actions, labels, or ordinal outcomes. Generating a free-form response for each choice adds la

agentsarxiv-cs-cl

KODA: Kinematics--Observation Data Alignment for Humanoid Learning from Human Egocentric Demonstration

arXiv:2610.21152v1 Announce Type: new Abstract: Training humanoid whole-body vision-language-action (VLA) policies requires costly robot demonstrations with aligned robot-view observations and control

safetyarxiv-cs-ro

Kolab: Benchmarking Human-Agent Collaboration in Long-Horizon Workflows

arXiv:2610.21109v1 Announce Type: new Abstract: When humans collaborate with AI agents on long-horizon tasks, what happens to the agents' contributions? For solving long-horizon tasks, humans place gr