Search: “evaluation”

Agent4Edu: Generating Learner Response Data by Generative Agents for Intelligent Education Systems

arXiv:2501.10332v2 Announce Type: replace-cross Abstract: Personalized learning represents a promising educational strategy within intelligent educational systems, aiming to enhance learners' practice

agentsarxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Agora: Toward Autonomous Bug Detection in Production-Level Consensus Protocols with LLM Agents

DGX agent

arXiv:2605.29910v1 Announce Type: cross Abstract: Consensus protocols form the backbone of distributed systems and blockchains, where implementation bugs can cause data corruption and financial losses

safetyarxiv-cs-ai

29 May 2026

Industry

Agree! was talking about this with @havoyan just a few days ago. That's also the reason why so much of the value has been accruing to the fr…

Agree! was talking about this with @havoyan just a few days ago. That's also the reason why so much of the value has been accruing to the frontier models in my opinion (cc @GavinSBaker) because if you

industryclem-delangue--x

AlignVid: Training-Free Attention Scaling for Semantic Fidelity in Text-Guided Image-to-Video Generation

model-releasesarxiv-cs-cv

arXiv:2512.01334v2 Announce Type: replace Abstract: Text-guided image-to-video generation has made substantial progress, yet it still struggles to execute text-specified edits that require substantial

Analyzing Persona Effects in Generated Explanations from Multimodal LLM Agents in Urban Perception

arXiv:2605.29064v1 Announce Type: new Abstract: We study how persona prompting shapes language generated by multimodal large language models in an urban perception setting. Using 59,808 annotations fr

researcharxiv-cs-cl

AnomalyAgent: Training-Free Agentic Models for Zero-/Few-Shot Anomaly Detection

arXiv:2605.30140v1 Announce Type: new Abstract: Benefiting from generalizability of vision-language models (VLMs) such as CLIP, many zero-/few-shot anomaly detection (AD) approaches have achieved impr

agentsarxiv-cs-cv

Architecture-Sensitive Supervised Fine-Tuning for Screen-Conditioned Action Prediction: A PiSAR Benchmark

arXiv:2605.29400v1 Announce Type: new Abstract: We benchmark three supervised fine-tuned models against frontier zero-shot baselines on a 661-row held-out slice of PiSAR (Persona, intent, Screen, Acti

Are LLMs Socially Adaptive? Contrasting Belief Evolution in Large Language Models and Humans

arXiv:2410.10398v3 Announce Type: replace-cross Abstract: As large language models (LLMs) increasingly engage in complex social interactions, ensuring that their behaviors align with human ethical pri

Applications

Aryabhata 2: Scaling Reinforcement Learning for Advanced STEM Reasoning

arXiv:2605.28829v1 Announce Type: cross Abstract: Competitive STEM examinations such as JEE and NEET require multi-step symbolic reasoning, precise numerical computation, and deep conceptual understan

applicationsarxiv-cs-ai

Local Ai

AsymVLM: Asymmetric Token Pruning for Efficient Vision-Language Model Inference

arXiv:2605.29535v1 Announce Type: new Abstract: Vision-Language Models (VLMs) process thousands of visual tokens per image alongside comparatively few text tokens, yet existing compression methods tre

local-aiarxiv-cs-lg

AttuneBench: A Conversation-Based Benchmark for LLM Emotional Intelligence

arXiv:2605.21739v2 Announce Type: replace Abstract: Emotional intelligence (EI), the ability to perceive, understand, and respond appropriately to others' emotional states, is central to human communi

Automating Low-Risk Code Review at Meta: RADAR, Risk Calibration, and Review Efficiency

arXiv:2605.30208v1 Announce Type: cross Abstract: AI-assisted coding tools have altered software production. At Meta, significant lines of code per human-landed diff grew by 105.9% year over year and

safetyarxiv-cs-ai

AutoSizer: Automatic Sizing of Analog and Mixed-Signal Circuits via Large Language Model (LLM) Agents

arXiv:2602.02849v2 Announce Type: replace Abstract: The design of Analog and Mixed-Signal (AMS) integrated circuits remains heavily reliant on expert knowledge, with transistor sizing a major bottlene

Hardware

BadBlocks: Low-Cost and Stealthy Backdoor Attacks Tailored for Text-to-Image Diffusion Models

arXiv:2508.03221v5 Announce Type: replace-cross Abstract: Despite the remarkable progress of diffusion models in image generation, recent studies reveal their vulnerability to backdoor attacks via cov

hardwarearxiv-cs-cv

Applications

Before the Shutter: Aesthetic and Actionable Portrait Photography Planning in 3D Scenes

arXiv:2605.30318v1 Announce Type: cross Abstract: Portrait photography is largely decided before the shutter opens: the subject's pose, the camera configuration, and the lighting devices must be coord

applicationsarxiv-cs-ai

Benchmarking LLM-Assisted Blue Teaming via Standardized Threat Hunting

arXiv:2509.23571v3 Announce Type: replace-cross Abstract: As cyber threats continue to grow in scale and sophistication, blue team defenders increasingly require advanced tools to proactively detect a

Benchmarking Positional Encoding Strategies for Transformer-Based EEG Foundation Models

arXiv:2605.29754v1 Announce Type: new Abstract: Electroencephalography (EEG) is a widely used non-invasive technique for measuring brain activity in brain-computer interface (BCI) applications. Superv

Beyond Accuracy: Are Time Series Foundation Models Well-Calibrated?

arXiv:2510.16060v2 Announce Type: replace-cross Abstract: The recent development of foundation models for time series data has generated considerable interest in using such models across a variety of

Beyond Bilingual Transfer: Multilingual Code-Switching in Instruction Tuning

arXiv:2605.29414v1 Announce Type: cross Abstract: Recent studies have shown that code-switching data (CSD), in which multiple languages are mixed within the same context, can improve cross-lingual tra

safetyarxiv-cs-ai

Beyond Recall: Behavioral Specification as an Interpretive Layer for AI Personalization

arXiv:2605.28969v1 Announce Type: cross Abstract: If an AI agent makes decisions on a person's behalf, those decisions must align with its user. We introduce representational accuracy to measure how f

Tutorials

BioArc: Discovering Optimal Neural Architectures for Biological Foundation Models

arXiv:2512.00283v3 Announce Type: replace-cross Abstract: Foundation models have revolutionized various fields such as natural language processing (NLP) and computer vision (CV). While efforts have be

tutorialsarxiv-cs-ai

Bosses, Kings, and the Commons: Cooperation Under Power Asymmetry in LLM Societies

arXiv:2605.29062v1 Announce Type: new Abstract: Communities can sustainably manage shared resources (commons) through self-governance and cooperative norms, a central finding of Ostrom's theory of sel

agentsarxiv-cs-cl

Brain-IT-VQA: From Brain Signals to Answers

arXiv:2605.29588v1 Announce Type: cross Abstract: Decoding visual content from fMRI signals recorded while a person views images, and specifically answering questions about the seen images, is a long-

Building and Road Recognition in Dense Urban Informal Settlements: A Dataset and Benchmark

model-releasesarxiv-cs-cv

arXiv:2605.29856v1 Announce Type: new Abstract: As a widespread form of informal settlements, urban villages present significant challenges for sustainable urban development and governance. Precise ma

BullingerDB: A Dataset for Handwritten Text Recognition and Writer Retrieval

model-releasesarxiv-cs-cv

arXiv:2605.30235v1 Announce Type: new Abstract: We present BullingerDB, a large-scale benchmark dataset for historical document analysis based on the correspondence of Heinrich Bullinger (1504-1575).

Casual as an Anchor: Resolving Supervision Misalignment in Formality Transfer Dataset

model-releasesarxiv-cs-cl

arXiv:2605.29365v1 Announce Type: new Abstract: Formality transfer is commonly framed as a symmetric bidirectional task between informal and formal registers. We argue that this framing conceals a sup

Catalyst-Agent: Autonomous heterogeneous catalyst screening with an LLM Agent

arXiv:2603.01311v2 Announce Type: replace Abstract: The discovery of novel catalysts tailored for particular applications is a major challenge for the twenty-first century. Traditional methods for thi

agentsarxiv-cs-cl

Tutorials

Causal Intelligence for Constraint-Aware Intervention Design to Induce State Transitions

arXiv:2605.29008v1 Announce Type: new Abstract: Driving a system from one state to another through targeted interventions is a fundamental challenge in science, yet most predictive models offer limite

tutorialsarxiv-cs-lg

Applications

Ciphera: A Decentralised Biometric Identity Framework

arXiv:2605.29868v1 Announce Type: cross Abstract: Centralised biometric identity systems expose users to single points of failure, opaque verification processes, and irreversible biometric compromise.

applicationsarxiv-cs-cv

Citation-Closure Retrieval and Per-Rule Attribution for Real-World Regulatory Compliance Question Answering

arXiv:2605.29742v1 Announce Type: new Abstract: Deploying Large Language Models (LLMs) for regulatory compliance demands rigorous traceability via comprehensive citations across multi-tiered authority

City-Mesh3R: Simulation-Ready City-Scale 3D Mesh Reconstruction from Multi-View Images

arXiv:2605.30310v1 Announce Type: cross Abstract: City-scale 3D surface reconstruction from multiview images for downstream 3D simulation, poses highly challenging problems due to the scale and comple

Code-QA-Bench: Separating Code Reasoning from Documentation Memorization in Repository-Level QA

arXiv:2605.29277v1 Announce Type: cross Abstract: We present Code-QA-Bench, a fully automated framework for synthesizing repository-level code understanding benchmarks that separates genuine code comp

agentsarxiv-cs-ai

Collaborative Threshold Watermarking

arXiv:2602.10765v2 Announce Type: replace Abstract: In federated learning (FL), K clients jointly train a model without sharing raw data. Because each participant invests data and compute, clients nee

researcharxiv-cs-lg

Combating Data Laundering in LLM Training

arXiv:2604.01904v2 Announce Type: replace-cross Abstract: Data rights owners can detect unauthorized data use in large language model (LLM) training by querying with proprietary samples. Often, superi

Comparing Post-Hoc Explainable AI Methods for Interpreting Black-Box EEG Models in Depression Detection

arXiv:2605.28977v1 Announce Type: cross Abstract: Recent advances in deep learning have enabled increasingly accurate electroencephalography (EEG)-based classification of Major Depressive Disorder (MD

COMPOSE: Composing Future Theorems from Citations and Formal Structure

model-releasesarxiv-cs-cl

arXiv:2605.30333v1 Announce Type: new Abstract: A plausible future mathematical claim must satisfy two constraints: it should follow the direction of prior work and respect the formal dependencies tha

Compute Allocation in Evolutionary Search: From Depth-Breadth to Multi-Armed Bandits

arXiv:2605.29268v1 Announce Type: cross Abstract: LLM-guided evolutionary search (Evolve systems) has reached state-of-the-art results on mathematical and combinatorial tasks, yet most existing system

Conformal Certification of Reasoning Trace Prefixes

arXiv:2605.30085v1 Announce Type: new Abstract: Language model reasoning traces are rarely all-or-nothing; they frequently contain valid intermediate steps before a critical error occurs. Existing unc

Connecting Independently Trained Modes via Layer-Wise Connectivity

model-releasesarxiv-cs-lg

arXiv:2505.02604v5 Announce Type: replace Abstract: Empirical studies have shown that continuous low-loss paths can be constructed between independently trained neural network models. This phenomenon,

CorPipe at CRAC 2026: Empty Nodes and Cross-Lingual Transfer in Multilingual Coreference Resolution

arXiv:2605.30133v1 Announce Type: new Abstract: We introduce CorPipe 26, our winning submission to the CRAC 2026 Shared Task on Multilingual Coreference Resolution. The fifth edition of this shared ta

researcharxiv-cs-cl

Deep Adaptive Dimension Reduction for Bayesian Inference in Inverse Problems

model-releasesarxiv-cs-lg

arXiv:2605.29373v1 Announce Type: new Abstract: Solving high-dimensional PDE-governed inverse problems is often challenging due to complex non-Gaussian posterior distributions, expensive forward model

DefSynUS: Real-time Patient-specific Intrahepatic Vessel Identification via Deformation-Aware CT-US Domain Adaptation

arXiv:2605.29570v1 Announce Type: new Abstract: Purpose: Laparoscopic ultrasound (LUS) enhances the safety of liver surgery by visualizing intrahepatic vessels in real-time. Still, vessel identificati

safetyarxiv-cs-cv

DiffSpot: Can VLMs Spot Fine-Grained Visual Differences in Web Interfaces?

model-releasesarxiv-cs-cl

arXiv:2605.29615v1 Announce Type: cross Abstract: Vision-language models (VLMs) have made strong progress on high-level image-text alignment, yet their ability to perceive subtle visual differences re

Diffusion-based learning framework for Constrained Nonconvex Optimization with Weighted Bootstrapped Refinement

model-releasesarxiv-cs-lg

arXiv:2502.10330v4 Announce Type: replace Abstract: Recent advances in diffusion models show promising potential to accelerate nonconvex problem solving by leveraging their multimodality. However, mos

Discovering Cooperative Pipelines: Autoresearch for Sequential Social Dilemmas

arXiv:2605.30003v1 Announce Type: cross Abstract: We study two-level autoresearch for cooperation: an outer-loop AI agent autonomously redesigns the inner-loop pipeline of an LLM policy-synthesis syst

safetyarxiv-cs-ai

Does Distributed Training Undermine Compute Governance?

arXiv:2605.29359v1 Announce Type: cross Abstract: Compute governance proposals often rely on the assumption that frontier AI training requires large, detectable computing clusters. However, recent adv

Draft-OPD: On-Policy Distillation for Speculative Draft Models

arXiv:2605.29343v1 Announce Type: new Abstract: Speculative decoding accelerates large language model inference by pairing a target model with a lightweight draft model whose proposed tokens are verif

safetyarxiv-cs-cl

Local Ai

DynaGraph: Lightweight Multi-Model Interaction Framework via Dynamic Topological Reconfiguration

arXiv:2605.29511v1 Announce Type: cross Abstract: Tackling complex reasoning tasks typically relies on massive monolithic LLMs, which suffer from severe computational redundancy. While task decomposit

local-aiarxiv-cs-cl