Search: “evaluation”

Overview of SHROOM-Visions 2026: A Shared Task on Hallucination Detection in Large Vision-Language Models

arXiv:2608.25662v1 Announce Type: new Abstract: In 2026, we held the fourth iteration of the SHROOM Shared Task series: SHROOM-Visions (extbf{S}hared-task on extbf{H}allucinations and extbf{R}elated e

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

PA-CoT: Profile-Adaptive Chain-of-Thought for Personalized Nutritional Consulting

DGX agent

arXiv:2608.24907v1 Announce Type: cross Abstract: In health and nutrition consulting, widely used prompting methods pass the user profile as an unstructured block without a dedicated analysis step, le

model-releasesarxiv-cs-cl

27 Aug 2026

Prefix-Denoising Consistency: Test-Time Verification for Diffusion Language Models

arXiv:2608.25311v1 Announce Type: new Abstract: Diffusion Language Models (DLMs) have recently become increasingly competitive with autoregressive (AR) models, and even outperform them on certain task

PRISM: Projection-Integrated Sampling-Based MPC with Bayesian Cost Tuning for Bimanual Manipulation

model-releasesarxiv-cs-ro

arXiv:2608.25666v1 Announce Type: new Abstract: Bimanual manipulation in cluttered, contact-rich environments remains challenging because it requires coordinated motion generation, interaction-aware p

Provable Privacy Attacks on Trained Shallow Neural Networks

arXiv:2410.07632v3 Announce Type: replace Abstract: We study what provable privacy attacks can be shown for trained 2-layer ReLU neural networks, focusing on two types of attacks: membership inference

safetyarxiv-cs-lg

Rare Diseases, Common Dilemmas: LLMs Prioritize Equal Resource Distribution over Patient Benefit in Decision-Making

model-releasesarxiv-cs-cl

arXiv:2608.25236v1 Announce Type: cross Abstract: Clinical decision-making often involves prioritizing ethical values, such as beneficence, non-maleficence, respecting a patient's autonomy, and justic

Reasoning or Rambling? Exploring the Effect of Thinking on Agent Persuasion

arXiv:2509.21054v2 Announce Type: replace-cross Abstract: Understanding persuasion is critical for the safety and reliability of multi-agent systems built on large language models (LLMs). This paper s

safetyarxiv-cs-cl

Same-Player Verification for Account Consistency in Counter-Strike 2

arXiv:2608.24893v1 Announce Type: cross Abstract: In competitive first-person shooter (FPS) games such as Counter-Strike 2 (CS2), account-integrity review often asks whether an account's recent behavi

researcharxiv-cs-lg

SAMpLE: A SystemC-AMS Machine LEarning-based Framework for Virtual Prototyping

arXiv:2608.25910v1 Announce Type: new Abstract: Machine Learning (ML) is increasingly used in virtual prototypes of embedded systems to model behaviors that are difficult to capture analytically. Howe

Hardware

Scalable Multi-GPU Simulation of 3D Multicellular Growth with RNN-Based Workload Balancing

arXiv:2608.25890v1 Announce Type: cross Abstract: Detailed multicellular growth simulations based on subcellular element models (SEMs) can capture complex tissue development, but their element-level i

hardwarearxiv-cs-lg

Semantic Variability of Replies Across LLMs: Implications for Designing Conversation-Based Assessment

arXiv:2608.24920v1 Announce Type: new Abstract: This study examines whether LLM-generated replies remain semantically consistent when the underlying LLM changes. Using messages from real collaborative

safetyarxiv-cs-cl

SNAP-KG: Streaming Node Assignment via Projection for Knowledge Graph Entity Integration

arXiv:2608.25149v1 Announce Type: new Abstract: Knowledge graph (KG) construction pipelines must continuously integrate newly arriving entities into a growing graph. Unlike inserting triples between e

The Imperfective Paradox Is Not Necessarily in Large Language Models: A Benchmark Failure Before a Model Failure

model-releasesarxiv-cs-cl

arXiv:2608.25005v1 Announce Type: new Abstract: The imperfective paradox provides a useful test of compositional semantic analysis. Recent work constructs an NLI benchmark and reports that models freq

Training Alignment Auditors via Reinforcement Learning

arXiv:2608.25460v1 Announce Type: cross Abstract: Alignment auditing of frontier models increasingly relies on LLM auditors to surface undesirable behaviors at scale, but current automated auditors ca

safetyarxiv-cs-lg

Unsupervised Post-Training of Foundation Models: A Survey

arXiv:2608.24982v1 Announce Type: new Abstract: Foundation-model post-training usually relies on human labels, preference data, stronger teachers, or executable verifiers. We study Unsupervised Post-T

When Does Context Routing Help? A Systematic Study of Multi-Modal Fusion in Time Series Forecasting

arXiv:2608.25128v1 Announce Type: new Abstract: Multi-modal time series forecasting methods integrate auxiliary context into temporal predictions through increasingly sophisticated fusion mechanisms.

When Personality Meets Quantization: A Layer-wise MBTI Analysis of Quantized LLMs

arXiv:2608.25977v1 Announce Type: new Abstract: Personality is increasingly important in large language models (LLMs), as it shapes users' trust, engagement, and emotional experiences. While the Myers

A Dual-Dimensional LLM Framework for Automated Item Incidental Content Similarity Analysis in Large-Scale Assessments

arXiv:2608.24825v1 Announce Type: new Abstract: The rapid expansion of large-scale assessments and the growing adoption of automatic item generation have intensified concerns about incidental content

A study on the effects of mixed explicit and implicit communications in human-artificial-agent interactions

model-releasesarxiv-cs-ro

arXiv:2409.18745v5 Announce Type: replace Abstract: Communication between humans and artificial agents is essential for their interaction. This is often inspired by human communication, which uses ges

Accelerating the Adoption of Residential Solar Power Systems: Policy Analysis using a Dynamic Structural Model

arXiv:2608.23796v1 Announce Type: cross Abstract: Problem definition: Solar electricity generation is a strategic component of energy portfolios designed to meet growing demand and reduce carbon emiss

safetyarxiv-cs-lg

Agents

AI Agents Push Humans Out of the Loop

arXiv:2608.23642v1 Announce Type: new Abstract: AI agents pose significant risks as they are granted increasing autonomy. A commonly proposed solution is human oversight and keeping a ''human in the l

agentsarxiv-cs-ai

C3VDReg: A Benchmark for Local-to-Local Colonoscopic Registration toward Anatomical Localization

model-releasesarxiv-cs-cv

arXiv:2511.00260v2 Announce Type: replace Abstract: Anatomy-aware colonoscopic navigation requires localizing partial endoscopic observations on a stable 3D reference to support coverage assessment, r

CAFE: Self-Improving Search Agents Need Co-Evolving Feedback

arXiv:2608.24794v1 Announce Type: new Abstract: Outcome-supervised search agents learn when and how to retrieve evidence, but terminal rewards neither localize intermediate errors nor redirect an ongo

Can large language models assist choice modelling? Insights into prompting strategies and current models' capabilities

arXiv:2507.21790v3 Announce Type: replace-cross Abstract: Large Language Models (LLMs) are becoming widely used to support various workflows across different disciplines, yet their potential in discre

Agents

Confident at the moment of action: belief miscalibration in LLM play under hidden information

arXiv:2608.24691v1 Announce Type: new Abstract: Agentic systems increasingly gate actions on a model's own stated confidence, which assumes confidence tracks correctness at the moment of acting. We te

agentsarxiv-cs-ai

Applications

ConsensusTAS: Self-Supervised Temporal Action Segmentation for Long-Horizon Construction Videos

arXiv:2608.24043v1 Announce Type: new Abstract: Recognizing sequential construction activities is important for collaborative human-robot work; for example, robots are able to understand workers' curr

applicationsarxiv-cs-cv

Local Ai

Delayed Optimizer-State Transport Shapes Short-Horizon Training Decisions

arXiv:2608.24593v1 Announce Type: new Abstract: Adaptive optimizers retain gradient history in moment variables, allowing a local change in loss weighting to alter later updates. We examine whether th

local-aiarxiv-cs-lg

Design-to-Plan: A Large Language Model-Based Multi-Agent Framework for Manufacturing Process Planning from 3D CAD Models and 2D Engineering Drawings

arXiv:2608.24039v1 Announce Type: cross Abstract: Manufacturing process planning transforms heterogeneous design information into coherent manufacturing decisions. However, existing approaches focus o

Agents

Discovering Adaptive Transmission Programs for Collective Innovation

arXiv:2608.24545v1 Announce Type: new Abstract: Human collective intelligence depends on transmission processes: who shares what with whom, how, and when. While these processes emerge from individual

agentsarxiv-cs-ai

Discovering Cross-Language Reasoning Invariance in LLMs with Geometry-Invariant Sparse Autoencoders

arXiv:2608.23809v1 Announce Type: cross Abstract: Multilingual language models can solve the same mathematical problem in different languages, but it remains unclear whether they rely on shared featur

Local Ai

Do Recipes Have Personas? Characterizing and Generating Creator Style in Attributed Procedural Graphs

arXiv:2608.24369v1 Announce Type: new Abstract: While large language models (LLMs) possess vast zero-shot procedural knowledge, their tendency to produce homogenized logic often obscures the unique, i

local-aiarxiv-cs-ai

DRRG: A Discrete Diffusion Framework for Radiology Report Generation

arXiv:2608.24105v1 Announce Type: new Abstract: Purpose: Automatic radiology report generation (RRG) has been widely explored to improve reporting accuracy and reduce radiologists' workload. Most exis

researcharxiv-cs-cv

Ensemble of Convolutional Neural Networks for StrokePrediction: Towards Improved Diagnostic Accuracy

arXiv:2608.24771v1 Announce Type: cross Abstract: Brain stroke, known for its high mortality and incidence rates, poses significant health risks and requires rapid intervention for survival. Early dia

researcharxiv-cs-ai

EstLLM: Enhancing Estonian Capabilities in Multilingual LLMs via Continued Pretraining and Post-Training

arXiv:2603.02041v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are predominantly trained on English-centric data, resulting in uneven performance for smaller languages. We stud

From Gradient-Boosted Trees to Deep Recommenders: Practical Lessons from Migrating a Production Customer Support Recommender

arXiv:2608.24132v1 Announce Type: cross Abstract: Product catalogs in fast-moving service businesses are shifting from static, independently priced SKUs toward dynamically bundled, discount-coupled of

From State to Action: OODA-Tool for Reliable Multi-Turn Tool Use

arXiv:2608.24368v1 Announce Type: new Abstract: Reliable multi-turn tool use requires an agent to preserve an evolving task state and ensure that each action remains consistent with it. However, direc

safetyarxiv-cs-ai

Game2World Engine: Unlocking In-the-Wild Gameplay Videos for World Model Training

arXiv:2608.24680v1 Announce Type: new Abstract: Video games provide a scalable source of training data for video world models, offering diverse environments, complex interactions, and abundant in-the-

researcharxiv-cs-cv

GATNextHop: A GAT for Shortest Path Routing with Cross-Topology Generalization

arXiv:2608.23917v1 Announce Type: new Abstract: Common shortest-path algorithms, such as Dijkstra's (SPF), that OSPF uses, provide exact routing solutions but must be recomputed for each network topol

Highway Congestion Reduction through Reinforcement Learning Based Eulerian Headway Control

arXiv:2412.02520v4 Announce Type: replace-cross Abstract: Connected automated vehicles (CAVs) equipped with adaptive cruise control (ACC) create new opportunities for highway congestion mitigation. Tr

researcharxiv-cs-ai

Applications

LEMMA-RCA: A Large Multi-modal Multi-domain Dataset for Root Cause Analysis

arXiv:2406.05375v4 Announce Type: replace Abstract: Root cause analysis (RCA) is crucial for enhancing the reliability and performance of complex systems. However, progress in this field has been hind

applicationsarxiv-cs-ai

Lightweight GenAI for Network Traffic Generation: Fidelity, Augmentation, and Classification

arXiv:2603.25507v2 Announce Type: replace-cross Abstract: Network Traffic Classification (NTC) increasingly relies on data-driven models, yet its practical deployment is often constrained by limited l

researcharxiv-cs-ai

LLM Agents Perform Controlled Experiments Using Simulation Models

arXiv:2608.23622v1 Announce Type: new Abstract: Large language models (LLMs) have shown strong capabilities in reasoning, planning, and tool use, but many scientific and engineering tasks require more

Tutorials

Macro-Operator Generation and Predicate Selection for TAMP Operator Learning

arXiv:2608.23629v1 Announce Type: cross Abstract: Creating symbolic operators by hand is one of the main bottlenecks in deploying Task and Motion Planning systems (TAMP). Recent works show that these

tutorialsarxiv-cs-ai

MatReplace: A Reference-Free, Conditioning-Aligned Benchmark for Material Replacement in Interior Scenes

arXiv:2608.24107v1 Announce Type: cross Abstract: Material replacement is a common interior-design operation: changing the material of a selected surface while preserving its geometry, surroundings, a

Multi-Stage Prompt-Guided Feature Modulation for Generalizable Brain Tumor Segmentation

arXiv:2608.23745v1 Announce Type: cross Abstract: Accurate brain tumor segmentation from magnetic resonance imaging (MRI) is essential for diagnosis, treatment planning, surgical guidance, and disease

researcharxiv-cs-cv

Local Ai

Not All Tokens Are Equal: Region-Aware Consistency Repair of Backdoors in MLLMs

arXiv:2608.24354v1 Announce Type: cross Abstract: MLLMs are increasingly deployed in user-facing applications, yet they inherit backdoor risks from the pipelines used to construct them: triggers may r

local-aiarxiv-cs-ai

Olapa-MCoT: Enhancing the Chinese Mathematical Reasoning Capability of LLMs

arXiv:2312.17535v2 Announce Type: replace Abstract: In the past two years, the outstanding performance of ChatGPT in multilingual and multitasking has led to large language models (LLMs) attracting wi

OmniJudge or OmniBias? Diagnosing Multimodal Judges through Balanced, Decoupled Lenses

arXiv:2608.24160v1 Announce Type: new Abstract: Multimodal understanding models that can jointly judge text-to-image (T2I), text-to-video (T2V) and text-to-speech (TTS) generation are increasingly use