Search: “evaluation”

AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery

arXiv:2605.23204v1 Announce Type: new Abstract: Scientific research is being reshaped by AI systems that move beyond isolated assistance toward longer-horizon workflows spanning literature grounding,

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physics

DGX agent

arXiv:2510.12787v4 Announce Type: replace Abstract: We present Ax-Prover, a multi-agent system for automated theorem proving in Lean that can solve problems across diverse scientific domains and opera

model-releasesarxiv-cs-ai

25 May 2026

Benchmarking and Enhancing VLM for Compressed Image Understanding

model-releasesarxiv-cs-cv

arXiv:2512.20901v2 Announce Type: replace Abstract: With the rapid development of Vision-Language Models (VLMs) and the growing demand for their applications, efficient compression of the image inputs

Benchmarking Google Embeddings 2 against Open-Source Models for Multilingual Dense Retrieval and RAG Systems

arXiv:2605.23618v1 Announce Type: new Abstract: We benchmark Google Embeddings (GE2), a Vertex-AI-hosted bi-encoder with 2,048-token context and explicit task-type conditioning, against five open-sour

Bridging Data and Physics: A Graph Neural Network-Based Hybrid Twin Framework

arXiv:2512.15767v2 Announce Type: replace-cross Abstract: Simulating complex unsteady physical phenomena relies on detailed mathematical models, simulated for instance by using the Finite Element Meth

tutorialsarxiv-cs-ai

Applications

BVI-RLV: A Fully Registered Dataset for Low-Light Video Enhancement

arXiv:2407.03535v3 Announce Type: replace Abstract: Low-light videos often exhibit spatiotemporally incoherent noise, compromising visibility and degrading performance in computer vision applications.

applicationsarxiv-cs-cv

Can AI Guess What You Know? Performance Comparison of Large Language Models for Human Domain Knowledge Estimation From Communication Logs

arXiv:2605.22971v1 Announce Type: new Abstract: Employees often struggle to identify ``who knows what,'' leading to organizational productivity losses. We investigate whether Large Language Models (LL

CarlaNCAP: A Framework for Quantifying the Safety of Vulnerable Road Users in Infrastructure-Assisted Collective Perception Using EuroNCAP Scenarios

arXiv:2512.11551v2 Announce Type: replace Abstract: The growing number of road users has significantly increased the risk of accidents in recent years. Vulnerable Road Users (VRUs) are particularly at

safetyarxiv-cs-ro

Causal Additive Models with Unobserved Causal Paths and Backdoor Paths

arXiv:2502.07646v3 Announce Type: replace Abstract: Causal additive models provide a tractable yet expressive framework for causal discovery in the presence of hidden variables. When unobserved backdo

ChartFI: Benchmarking Faithfulness and Insightfulness of Chart Descriptions from Multimodal Large Language Models

arXiv:2605.23694v1 Announce Type: new Abstract: Chart descriptions are essential for accessibility, cross-modal retrieval, and assisting readers in extracting insights from complex visualizations. As

Classical State Preparation for Variational Quantum Algorithms via Reinforcement Learning

arXiv:2605.23138v1 Announce Type: cross Abstract: Variational Quantum Algorithms (VQAs) potentially offer a pathway to practical quantum advantage, but their optimization is heavily hindered by barren

Classification of IED-free EEG Responses for Assisted Epilepsy Diagnosis

arXiv:2605.22858v1 Announce Type: cross Abstract: Diagnosing epilepsy is challenging when routine EEGs lack interictal epileptiform discharges (IEDs). Intermittent photic stimulation (IPS) and hyperve

Coloring the Noise: Adversarial Sobolev Alignment for Faithful Image Super Resolution

arXiv:2605.23264v1 Announce Type: cross Abstract: Generative priors in Image Super-Resolution (SR) often compromise faithful restoration, we attribute this limitation to a fundamental spectral misalig

Commutator-Induced Uncertainty in VAEs

arXiv:2605.23449v1 Announce Type: cross Abstract: Variational autoencoders (VAEs) often struggle to represent non-commutative structure in learned latent spaces. Symmetry-aware VAEs commonly address t

researcharxiv-cs-cv

Controlled Personalization in Legacy Media Online Services: A Case Study in News Recommendation

arXiv:2510.09136v2 Announce Type: replace-cross Abstract: Personalized news recommendations have become a standard feature of large news aggregation services, optimizing user engagement through automa

Cross-attention-based bipartite graph neural network for coupled nodal and elemental field prediction in large-deformation sheet material forming

arXiv:2605.22845v1 Announce Type: cross Abstract: Finite element simulations of large-deformation sheet material forming involve node-element coupling between nodal kinematics and element-level deform

CultivAgents: Cultivating Relationship-Centered Multi-Agent Systems for Personalized Gardening

arXiv:2605.23193v1 Announce Type: cross Abstract: Gardening is critical to support well-being, cultural continuity, and food autonomy, yet existing digital tools often provide generic advice that over

local-aiarxiv-cs-cl

Cultural Adaptation in Large Language Models for Political Discourse

arXiv:2605.23332v1 Announce Type: new Abstract: The integration of large language models into political discourse analysis creates new opportunities for comparative research, policy analysis, and civi

Curriculum reinforcement learning with measurable task representation learning

arXiv:2605.23372v1 Announce Type: cross Abstract: In curriculum reinforcement learning (CRL), an agent incrementally accumulates knowledge over a sequence of tasks (i.e., a curriculum), and the learni

D2 Actor Critic: Diffusion Actor Meets Distributional Critic

model-releasesarxiv-cs-lg

arXiv:2510.03508v3 Announce Type: replace Abstract: We introduce D2AC, a new model-free reinforcement learning (RL) algorithm designed to train expressive diffusion policies online effectively. At its

DART: Semantic Recoverability for Structured Tool Agents

arXiv:2605.23311v1 Announce Type: new Abstract: When a structured tool agent fails mid-execution, the runtime faces a dilemma: replaying the entire task is safe but wasteful, while restoring from a lo

local-aiarxiv-cs-ai

DCC: Data-Centric Compilation of Machine Learning Kernels for Processing-In-Memory Architectures

model-releasesarxiv-cs-lg

arXiv:2511.15503v2 Announce Type: replace-cross Abstract: High-performance Host processors can integrate Processing-In-Memory (PIM) devices, which can accelerate memory-intensive kernels of Machine Le

Detecting Drunk Driving Using Off-the-Shelf Smartwatches

arXiv:2605.23663v1 Announce Type: cross Abstract: Alcohol-impaired driving remains a major yet preventable cause of road traffic injury and death, with many drivers underestimating their level of into

Differences in Typological Alignment in Language Models' Treatment of Differential Argument Marking

arXiv:2602.17653v2 Announce Type: replace Abstract: Recent work has shown that language models (LMs) trained on synthetic corpora can exhibit typological preferences that resemble cross-linguistic reg

safetyarxiv-cs-cl

Dithering Defense: Adversarial Robustness of Vision Foundation Models via Multi-Level Floyd-Steinberg Dithering

arXiv:2605.23065v1 Announce Type: cross Abstract: Vision foundation models are widely used as frozen backbones across many downstream tasks, making them a single point of failure under adversarial att

researcharxiv-cs-ai

Do Synthetic Brain MRIs Reliably Improve Tumour Classification? A StyleGAN2-ADA Class-Plane Augmentation Study on BRISC 2025

model-releasesarxiv-cs-ai

arXiv:2605.23094v1 Announce Type: cross Abstract: Generative augmentation is often proposed as a remedy for small medical-image datasets, but synthetic images are only useful when they improve downstr

Empowering 9-1-1 Calltaking Training with Generative AI: Experiences and Lessons Learned

arXiv:2602.13241v2 Announce Type: replace-cross Abstract: Emergency call-takers form the first operational link in public safety response, handling over 240 million calls annually while facing a susta

Energy-Guided Generative Modeling for Low-Energy Molecular Structure Discovery

arXiv:2512.22597v2 Announce Type: replace Abstract: Exploring molecular energy landscapes and identifying ground-state conformations are central challenges in computational chemistry. However, generat

Every Component is a Lookup: Token Attribution and Composition from a Single Decomposition

arXiv:2605.23393v1 Announce Type: cross Abstract: Mechanistic interpretability of transformers requires identifying not just which components matter but how they compose into the computational route t

researcharxiv-cs-ai

Exploring deep learning for Event-Based Saliency Prediction with a Transformer-based model

model-releasesarxiv-cs-cv

arXiv:2605.23790v1 Announce Type: new Abstract: Saliency prediction has been extensively studied in RGB images and videos as a computational model of human visual attention. In contrast, predicting sa

FederatedRSF : Federated Random Survival Forests for Partially Overlapping Medical Data

arXiv:2605.22954v1 Announce Type: new Abstract: Multi-center survival prediction can improve robustness and generalizability, yet privacy regulations and institutional governance often prevent pooling

local-aiarxiv-cs-lg

From Raw Experience to Skill Consumption: A Systematic Study of Model-Generated Agent Skills

arXiv:2605.23899v1 Announce Type: new Abstract: Language agents increasingly improve by reusing skills -- structured procedural artifacts distilled from past experience. In particular, domain-level an

General Hazard Detection

arXiv:2605.23304v1 Announce Type: new Abstract: Hazard, as an abstract concept, is typically defined through cognitive-level logical reasoning rather than concrete examples. In contrast, existing haza

safetyarxiv-cs-cv

Generator-Refiner-Examiner: A Tri-Module Data Augmentation Framework for 3D Human Avatar Learning from Monocular Videos

arXiv:2605.23555v1 Announce Type: new Abstract: This paper addresses the challenge of reconstructing photorealistic and animatable 3D human avatars from monocular videos. While existing methods rely o

researcharxiv-cs-cv

Applications

GeoMAE: Masking Representation Learning for Spatio-Temporal Graph Forecasting with Missing Values

arXiv:2508.14083v3 Announce Type: replace-cross Abstract: The ubiquity of missing data in urban intelligence systems, attributable to adverse environmental conditions and equipment failures, poses a s

applicationsarxiv-cs-ai

GlowGS: Generative Semantic Feature Learning for 3D Gaussian Splatting in Nighttime Glow Scenes

arXiv:2605.23602v1 Announce Type: new Abstract: Existing 3DGS methods effectively render high-quality novel views in clear-day scenes. However, they struggle with night scenes, particularly in glow re

researcharxiv-cs-cv

GlyTwin: Digital Twin for Glucose Control in Type 1 Diabetes Through Optimal Behavioral Modifications Using Patient-Centric Counterfactuals

arXiv:2504.09846v2 Announce Type: replace-cross Abstract: Frequent and long-term exposure to hyperglycemia increases the risk of chronic complications, including neuropathy, nephropathy, and cardiovas

tutorialsarxiv-cs-ai

GMENet: Generative Mixture of Experts Network for Multi-Center Glioma Diagnosis with Incomplete Imaging Sequences

arXiv:2605.23183v1 Announce Type: cross Abstract: Contemporary glioma diagnosis integrates molecular features with histopathology to guide clinical decision-making. However, in clinical settings, dive

tutorialsarxiv-cs-cv

GradingAttack: Exposing Security Vulnerabilities in LLM Based Educational Grading Agents

arXiv:2602.00979v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are increasingly deployed as educational agents for automatic short answer grading (ASAG) in real-world education

GT-HarmBench: Benchmarking AI Safety Risks Through the Lens of Game Theory

model-releasesarxiv-cs-ai

arXiv:2602.12316v2 Announce Type: replace Abstract: Frontier AI systems are increasingly capable and deployed in high-stakes multi-agent environments. However, existing AI safety benchmarks largely ev

GT-SVJ: Generative-Transformer-Based Self-Supervised Video Judge For Efficient Video Reward Modeling

arXiv:2602.05202v2 Announce Type: replace Abstract: Aligning video generative models with human preferences remains challenging: current approaches rely on Vision-Language Models (VLMs) for reward mod

tutorialsarxiv-cs-cv

HARNESS-LM: A Three-Phase Training Recipe for Harnessing SLMs in Sponsored Search Retrieval

model-releasesarxiv-cs-ai

arXiv:2605.23572v1 Announce Type: cross Abstract: In the competitive landscape of sponsored search, balancing retrieval quality with production latency is a critical challenge. While large retrieval m

HawkesLLM: Semantic Uncertainty Propagation in Agentic Text Simulation

arXiv:2605.23043v1 Announce Type: new Abstract: Agentic text-simulation systems write in sequence, with each item becoming possible context for later steps. That makes uncertainty path-dependent: an e

local-aiarxiv-cs-cl

Applications

Hinge Regression Trees and HRT-Boost: Newton-Optimized Oblique Learning for Compact Tabular Models

arXiv:2605.23422v1 Announce Type: new Abstract: Learning high-quality oblique decision trees remains a significant challenge due to the discrete and non-convex nature of split optimization. We present

applicationsarxiv-cs-lg

How Far Are We from Generating Missing Modalities with Foundation Models?

arXiv:2506.03530v3 Announce Type: replace-cross Abstract: Multimodal foundation models have demonstrated impressive capabilities across diverse tasks. However, their potential as plug-and-play solutio

How Far Will They Go? Red-Teaming Online Influence with Large Language Models

arXiv:2605.22880v1 Announce Type: cross Abstract: As large language model (LLM)-based agents increasingly participate in online discourse, red-teaming their capacity to support political influence cam

local-aiarxiv-cs-ai

How Hard is it to Rig a Benchmark? A Social Choice Analysis of Leaderboard Robustness

model-releasesarxiv-cs-lg

arXiv:2605.23628v1 Announce Type: new Abstract: Multi-task benchmarks have become a central pillar of machine learning research, yet their growing influence has incentivised benchmark gaming -- strate

Human Decision-Making with Persuasive and Narrative LLM Explanations

arXiv:2605.23867v1 Announce Type: cross Abstract: Large language models (LLMs) have the potential to aid and improve human decision-making in classification tasks, not only by providing fairly accurat

researcharxiv-cs-ai