Search: “evaluation”

Demystifying Scientific Problem-Solving in LLMs by Probing Knowledge and Reasoning

model-releasesarxiv-cs-cl

arXiv:2508.19202v3 Announce Type: replace Abstract: Scientific problem solving poses unique challenges for LLMs, requiring both deep domain knowledge and the ability to apply such knowledge through co

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Dial HEALTHDIAL for Advice: A Multilingual and Multi-Parallel Spoken Dialogue Dataset for Knowledge-Grounded Information Seeking

DGX agent

arXiv:2605.30107v1 Announce Type: new Abstract: Creating spoken dialogue datasets is methodologically challenging, and these challenges are amplified when the goal is to build multilingual, multi-para

model-releasesarxiv-cs-cl

29 May 2026

Do Language Models Track Entities Across State Changes?

arXiv:2605.30233v1 Announce Type: cross Abstract: Entity tracking (ET), the ability to keep track of states, is a fundamental skill that underlies complex reasoning. An increasing amount of work inves

DocRetriever: A Plug-and-Play Framework for Multimodal Document Retrieval with Comprehensive Benchmark

model-releasesarxiv-cs-cv

arXiv:2605.30027v1 Announce Type: new Abstract: Multimodal documents contain diverse elements, such as tables, figures, and layouts, which can complicate retrieval tasks. While current approaches typi

Efficient, Validation-Free Intrinsic Quality Estimation for Large-Scale Face Recognition Datasets

arXiv:2605.29720v1 Announce Type: new Abstract: We propose Intrinsic Quality (IQ), a validation-free metric designed to estimate the inherent potential of face recognition (FR) datasets to produce hig

researcharxiv-cs-cv

Enhancing Reinforcement Learning in 3D Environments through Semantic Segmentation: A Case Study in ViZDoom

arXiv:2511.11703v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) in 3D environments with high-dimensional sensory input poses two major challenges: (1) the high memory consumption

applicationsarxiv-cs-ai

Fairness-Aware Federated Learning with Trajectory Shapley Value

model-releasesarxiv-cs-lg

arXiv:2605.30336v1 Announce Type: new Abstract: Federated learning is an emerging distributed paradigm that addresses the challenges posed by heterogeneous, privacy-sensitive data. It enables multiple

Frontier LLM-based agents can overcome the ontology curation bottleneck for natural phenotypes

arXiv:2605.28965v1 Announce Type: new Abstract: Linking free-text phenotype descriptions to ontology terms, typically referred to as phenotype annotation, is essential for the cross-study integration

Getting to the Point: Pointing Improves LVLMs at Counting

arXiv:2603.21746v2 Announce Type: replace Abstract: Pointing-based methods decompose complex tasks as sequential grounding and reasoning steps. Given a query, the model first grounds the relevant obje

researcharxiv-cs-cv

GMOS: Grounding Moving Object Segmentation in 3D Space and Time

arXiv:2605.30352v1 Announce Type: new Abstract: Moving Object Segmentation (MOS) aims to discover, segment, and track objects that move independently of the camera. Current MOS methods, however, exhib

applicationsarxiv-cs-cv

Good SFT Optimizes for SFT, Better SFT Prepares for Reinforcement Learning

arXiv:2602.01058v2 Announce Type: replace-cross Abstract: Post-training of reasoning LLMs is a holistic process that typically consists of an offline SFT stage followed by an online reinforcement lear

GTA: Generating Long-Horizon Tasks for Web Agents at Scale

arXiv:2605.29218v1 Announce Type: new Abstract: Web agents, which couple language models with browsing and tool-use capabilities, show promise as open web assistants. Yet progress is increasingly limi

HaluNet: Learning Hallucination Risk from Internal Signals in LLM Question Answering

arXiv:2512.24562v2 Announce Type: replace Abstract: Large language models (LLMs) achieve strong question answering (QA) performance but can produce fluent answers unsupported by available evidence. Ex

researcharxiv-cs-cl

HEART-Bench: Do LLM Agents Exhibit Human-like Psychology?

model-releasesarxiv-cs-cl

arXiv:2605.30058v1 Announce Type: new Abstract: While LLM agents have demonstrated remarkable task-oriented abilities such as planning, reasoning, and action, few works have treated them as complete h

Agents

Hijacking Agent Memory: Stealthy Trojan Attacks Through Conversational Interaction

arXiv:2605.29960v1 Announce Type: cross Abstract: Large language model (LLM) agents increasingly leverage long term memory to support persistent and autonomous task execution. However, this capability

agentsarxiv-cs-ai

How LoRA Remembers? A Parametric Memory Law for LLM Finetuning

arXiv:2605.30260v1 Announce Type: cross Abstract: Large Language Models (LLMs) must continuously learn and update knowledge to remain effective in dynamic real-world environments. While Low-Rank Adapt

Agents

Human-in-the-Loop Swarms: A Bionic Swarm Approach to Real-World Soil Mapping

arXiv:2605.29091v1 Announce Type: new Abstract: Swarm and field robotics face significant barriers to real-world validation due to the high cost and development time to deploy hardware. This paper int

agentsarxiv-cs-ro

Implicit Identity Technologies for LLMs: Fingerprinting and Watermarking across Datasets, Models, and Generated Content

arXiv:2605.29245v1 Announce Type: cross Abstract: This paper presents a survey and taxonomy of LLM fingerprinting and watermarking for identity, ownership verification, provenance, and generated-conte

researcharxiv-cs-cl

InsightEval: An Expert-Curated Benchmark for Assessing Insight Discovery in LLM-Driven Data Agents

arXiv:2511.22884v2 Announce Type: replace Abstract: Data analysis has become an indispensable part of scientific research. To discover the latent knowledge and insights hidden within massive datasets,

Large-Scale AI and Foundation Models for Neuroscience: A Comprehensive Review

arXiv:2510.16658v3 Announce Type: replace Abstract: The development of large-scale artificial intelligence (AI) models is influencing neuroscience research by enabling end-to-end learning from raw bra

Leak@k: Unlearning Does Not Make LLMs Forget Under Probabilistic Decoding

model-releasesarxiv-cs-lg

arXiv:2511.04934v3 Announce Type: replace Abstract: Unlearning in large language models (LLMs) is critical for regulatory compliance and for building ethical generative AI systems that avoid producing

Learning Representations from 3D Gaussian Splats

model-releasesarxiv-cs-cv

arXiv:2605.29549v1 Announce Type: new Abstract: 3D Gaussian Splatting (3DGS) is a recent approach for scene rendering. Although primarily designed for view synthesis, its potential for scene understan

LLMSurgeon: Diagnosing Data Mixture of Large Language Models

arXiv:2605.30348v1 Announce Type: cross Abstract: The pretraining data mixture of Large Language Models (LLMs) constitutes their 'digital DNA', shaping model behaviors, capabilities, and failure modes

LLUMI: Improving LLM Writing Assistance for Mental Health Support with Online Community Feedback

arXiv:2605.30273v1 Announce Type: cross Abstract: Large language models (LLMs) show promise in generating supportive responses for mental health queries, but improving their usefulness, empathy, and s

safetyarxiv-cs-ai

Loong: A Human-Like Long Document Translation Agent with Observe-and-Act Adaptive Context Selection

arXiv:2605.30274v1 Announce Type: cross Abstract: Document-level translation remains one of the most challenging tasks for large language models, which are constrained by limited context windows that

MARTIAN: A Rendering Framework for Aerial Mars Imagery from HiRISE Orbital Data

arXiv:2605.29647v1 Announce Type: new Abstract: Aerial navigation on Mars requires vision-based pipelines that are robust to the diverse illumination conditions and terrain morphology of the Martian s

researcharxiv-cs-cv

MATNet: Multi-Level Fusion Transformer-Based Model for Day-Ahead PV Generation Forecasting

arXiv:2306.10356v3 Announce Type: replace-cross Abstract: Accurate forecasting of renewable generation is crucial to facilitate the integration of Renewable Energy Sources into the power system. Focus

MetaRanker: Human-in-the-loop Active Ranking for Metalens Image Quality

arXiv:2605.29212v1 Announce Type: new Abstract: Image quality in modern imaging systems emerges from the coupled effects of the sensor, optics, and computational reconstruction. Ultra-thin metalenses

safetyarxiv-cs-cv

MMTM: Tri-Modal Topic Modeling for Long-Form Video via Similarity-Gated Fusion

arXiv:2605.29765v1 Announce Type: new Abstract: We introduce MMTM, a modular pipeline for topic discovery in long-form video that integrates speech recognition, audio and visual embeddings, and BERTop

researcharxiv-cs-lg

MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsing

arXiv:2605.22100v2 Announce Type: replace Abstract: Document parsing converts visually rich documents into machine-readable structured representations, forming a crucial foundation for information sys

NICE: A Theory-Grounded Diagnostic Benchmark for Social Intelligence of LLMs

arXiv:2605.29685v1 Announce Type: new Abstract: As large language models (LLMs) are increasingly applied in social contexts such as emotional companionship and customer service, measuring their social

Agents

No Reader Left Behind: Multi-Agent Summaries Everyone Can Understand

arXiv:2605.28836v1 Announce Type: cross Abstract: The Plain Writing Act in the United States requires government documents to be accessible in clear and simple language that the general public can eas

agentsarxiv-cs-ai

Notation Matters: A Benchmark Study of Token-Optimized Formats in Agentic AI Systems

arXiv:2605.29676v1 Announce Type: new Abstract: Large language models in Agentic AI systems consume tool schemas and execution results and emit tool invocations as structured data. The default languag

Parallel Adaptive Multi-Objective Evolutionary Learning of Discretized Bayesian Network Classifiers for Clinical Data

arXiv:2605.29058v1 Announce Type: new Abstract: Bayesian Networks (BNs) are of interest from an explainable AI viewpoint, offering transparent probabilistic models for decision support. Baymex is a re

applicationsarxiv-cs-lg

PhoneWorld: Scaling Phone-Use Agent Environments

arXiv:2605.29486v1 Announce Type: cross Abstract: A central bottleneck for phone-use agents is that controllable, reproducible environments covering real mobile behavior are hard to build at scale. Ex

Provably Secure Agent Guardrail

arXiv:2605.29251v1 Announce Type: new Abstract: As large language models transition from bounded generative engines to agents with expansive execution privileges, AI going out of control precipitates

safetyarxiv-cs-ai

Robust and Efficient Writer-Independent IMU-Based Handwriting Recognition

arXiv:2502.20954v3 Announce Type: replace Abstract: Handwriting recognition (HWR) using inertial measurement unit (IMU) data remains challenging due to variations in writing styles and the limited ava

applicationsarxiv-cs-lg

RUBRIC-ARROW: Alternating Pointwise Rubric Reward Modeling for LLM Post-training in Non-verifiable Domains

arXiv:2605.29156v1 Announce Type: cross Abstract: Pointwise reward modeling offers critical signals for LLM post-training, yet struggles with absolute scoring in subjective, non-verifiable settings. R

safetyarxiv-cs-cl

Rubric-Guided Process Reward for Stepwise Model Routing

arXiv:2605.29310v1 Announce Type: new Abstract: Stepwise model routing improves the efficiency of Large Reasoning Models (LRMs) by assigning each reasoning step to a suitable model. Recent methods for

safetyarxiv-cs-ai

SafeSearch: Automated Red-Teaming of LLM-Based Search Agents

arXiv:2509.23694v5 Announce Type: replace Abstract: Search agents connect LLMs to the Internet, enabling them to access broader and more up-to-date information. However, this also introduces a new thr

Same Question, Different Source, Different Answer: Auditing Source-Dependence in Medical Multi-Source RAG

arXiv:2605.29084v1 Announce Type: cross Abstract: A retrieval-augmented generation (RAG) system deployed over a multi-author institutional corpus can give a different answer to the same question depen

SigmaMedStat: Temporal Signal Modeling for ICU False Alarm Reduction

arXiv:2605.29236v1 Announce Type: new Abstract: Alarm fatigue in intensive care units (ICUs) is a well documented patient safety crisis. Clinical monitors generate 350 or more alarms per patient per d

safetyarxiv-cs-lg

Specialty-Specific Medical Language Model for Immune-Mediated Diseases

arXiv:2605.28838v1 Announce Type: cross Abstract: Extracting detailed clinical information from free-text medical narratives remains a practical challenge for researchers and healthcare systems. Termi

applicationsarxiv-cs-ai

SurfFill: Completion of LiDAR Point Clouds via Gaussian Surfel Splatting

arXiv:2512.03010v2 Announce Type: replace Abstract: LiDAR-captured point clouds are often considered the gold standard in active 3D reconstruction. While their accuracy is exceptional in flat regions,

applicationsarxiv-cs-cv

The Anatomy of Conversational Scams: A Topic-Based Red Teaming Analysis of Multi-Turn Interactions in LLMs

arXiv:2601.03134v2 Announce Type: replace Abstract: As LLMs gain persuasive capabilities through extended dialogues, they create new opportunities for studying adversarial conversational behavior in e

safetyarxiv-cs-cl

The Impact of Semantic Pairs on Self-Supervised Representation Learning

arXiv:2510.08722v3 Announce Type: replace-cross Abstract: Instance discrimination learns visual representations by treating different augmented views of the same image as positive pairs. While this en

Who Am I? History-Aware Profiles for Student Simulation in Tutoring Dialogues

arXiv:2605.30051v1 Announce Type: new Abstract: A key part of developing large language model (LLM)-powered, automated tutoring tools is student simulation, i.e., using LLMs to role-play as students,

applicationsarxiv-cs-cl

YoCausal: How Far is Video Generation from World Model? A Causality Perspective

model-releasesarxiv-cs-cv

arXiv:2605.30346v1 Announce Type: new Abstract: As video diffusion models (VDMs) advance toward world models, a key question arises: do they truly understand causality, or merely overfit to statistica