Search: “evaluation”

Behavioral Controllability of Agentic Models for Information Extraction: From Fixed Workflows to Reflective Agents

arXiv:2607.15715v2 Announce Type: replace Abstract: Large language model (LLM) agents are increasingly used for complex information-extraction tasks, yet it remains unclear whether agentic components

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

Belief Coevolution in a Social Network of Generalist and Specialist Large Language Models

DGX agent

arXiv:2607.27512v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed in multi-agent environments. However, the processes by which beliefs form and propagate among int

agentsarxiv-cs-cl

31 Jul 2026

Benchmarking LLM Competence on Logical Inference over Probability Operators

arXiv:2607.27405v1 Announce Type: new Abstract: Both expressions of uncertainty and inferences are ubiquitous in natural language, and valid inferences over natural-language expressions of uncertainty

Beyond KV Reconstruction: Functional Reconstruction for MLA Draft Models in Speculative Decoding

arXiv:2607.27269v1 Announce Type: new Abstract: Multi-head latent attention (MLA) is increasingly important for long-context LLM inference because compact latent states replace the growing key-value (

BridgeAlign: Bridging Preference Alignment for Humanities and Social Sciences

arXiv:2607.27366v1 Announce Type: new Abstract: While data synthesis for large language models (LLMs) is prevalent, it primarily targets domains with verifiable answers, overlooking open-ended humanit

safetyarxiv-cs-cl

ChronoMem: Version Control and Semantic Rollback for Large Language Model Agent Memory

arXiv:2607.27773v1 Announce Type: new Abstract: LLM agents increasingly rely on long-term memory to support multi-session interaction and personalization. However, existing agent memory systems are de

Cocktail-Talker: Multi-Speaker Dialog Modeling in Noisy Social Environments with Turn Action GRPO

arXiv:2607.27756v1 Announce Type: cross Abstract: Spoken dialog systems are typically designed for clean, dyadic interactions in which a single user and an assistant take turns speaking. Real-world so

applicationsarxiv-cs-cl

Contextualized Counterspeech Can Be More Persuasive Than Generic Counterspeech

arXiv:2607.26236v1 Announce Type: cross Abstract: AI-generated counterspeech offers a scalable and effective strategy to mitigate online toxicity by promoting more constructive dialogue. Yet, existing

researcharxiv-cs-ai

Contrastive Concept Importance: Explaining Pairwise Class Decisions Through Automatically Extracted Concept Representations

arXiv:2607.27904v1 Announce Type: new Abstract: Concept-based explanations are a prevalent way to explain the decisions of complex black-box methods through semantically meaningful, human-interpretabl

researcharxiv-cs-lg

Creative Transformation in Literary Texts: Modelling Change Across Representational Levels

arXiv:2607.28513v1 Announce Type: new Abstract: Creativity is often framed as the production of novelty, yet many cultural works emerge through transformation of earlier artifacts and not through isol

safetyarxiv-cs-cl

Decision-oriented joint optimization of evidence fusion based on event-conditioned credibility

arXiv:2504.04128v3 Announce Type: replace Abstract: In decision-level fusion tasks involving heterogeneous sources with unequal precision and potential anomalies, evidence deviating from the majority

researcharxiv-cs-ai

Do Latent Channels Actually Communicate? A Causal Audit of Latent Multi-Agent LLM

arXiv:2607.26773v1 Announce Type: new Abstract: Latent communication in large language model (LLM)-based multi-agent systems (MAS) transmits continuous internal representations instead of text, but gr

EEG-EditBench: Probing Visual Information in EEG-Image Retrieval Models with Controlled Image Edits

arXiv:2607.27857v1 Announce Type: new Abstract: Recent EEG-to-image retrieval models have achieved strong performance in identifying viewed images from semantically diverse candidates. Yet such succes

Efficient LLMs with AMP: Attention Heads and MLP Pruning

arXiv:2504.21174v2 Announce Type: replace Abstract: Deep learning drives a new wave in computing systems and triggers the automation of increasingly complex problems. In particular, Large Language Mod

Exploring Structures in Physics Problems: Can AI Agents Discover Statistical Mechanical Mappings?

arXiv:2607.26367v1 Announce Type: new Abstract: An important skill in theoretical physics is to recognize when a new problem can be transformed into a known model. We study this skill as an AI-agent t

Fewer Clarifications, Better Code: Benchmarking Cross-Session Personalized Ambiguity Adaptation in Coding Assistants

arXiv:2607.26611v1 Announce Type: new Abstract: AI-assisted coding increasingly translates informal user intent into executable software, yet coding requests often contain ambiguities that recur in us

Local Ai

First-order Constrained Trilevel Optimization Over Distributed Networks for Robust Coreset Selection

arXiv:2607.27632v1 Announce Type: new Abstract: With the rapid advancement of the Internet of Things (IoT), massive amounts of data are generated across distributed edge networks. Training models on f

local-aiarxiv-cs-lg

FunL2O: LLM-Guided Feature Function Design for Learning to Optimize

arXiv:2607.27389v1 Announce Type: new Abstract: Learning-to-optimize (L2O) methods accelerate repeated optimization by training models to predict solutions, warm starts, branching decisions, or other

researcharxiv-cs-lg

How does downsampling affect needle electromyography signals? A generalisable workflow for understanding downsampling effects on high-frequency time series

arXiv:2601.10191v2 Announce Type: replace Abstract: Automated analysis of needle electromyography (nEMG) signals is emerging as a tool to support the detection of neuromuscular diseases (NMDs), yet th

researcharxiv-cs-ai

IDP AutoOpt: Agent-Driven Optimization of Document Processing Pipeline Configurations

arXiv:2607.26075v1 Announce Type: cross Abstract: We present IDP AutoOpt, an autonomous LLM agent that discovers high-performing configurations for intelligent document processing (IDP) pipelines. Tun

Improving Mental Health Screening and Early Risk Detection in Spanish

arXiv:2607.28476v1 Announce Type: new Abstract: Early detection of mental health disorders is often limited by the lack of specialized resources in Spanish and the difficulty of analyzing long histori

researcharxiv-cs-cl

Information Bottleneck Learning for Faithful Time Series Forecasting Explanations

arXiv:2607.28124v1 Announce Type: new Abstract: As forecasts increasingly drive decisions in fields such as energy, transportation, and healthcare, understanding the historical data behind these predi

applicationsarxiv-cs-lg

Learning-Augmented and Randomized Algorithms for Line Aggregation with Delays

arXiv:2607.27807v1 Announce Type: new Abstract: This paper studies learning-augmented and randomized online aggregation with delays on a line metric. We consider advice given as online suggested servi

LLMs struggle to simulate human belief updates in controlled environments

arXiv:2607.28347v1 Announce Type: new Abstract: LLMs are increasingly deployed as proxies for human study participants in social science experiments, yet the fidelity of this practice has rarely been

LM-GRASP: Instance-Specific Language Models for Combinatorial Construction via Online Imitation Learning

arXiv:2607.28135v1 Announce Type: new Abstract: Machine learning for combinatorial optimization typically relies on neural constructors trained via reinforcement learning on large offline datasets for

MedHallTune: An Instruction-Tuning Benchmark for Mitigating Medical Hallucination in Vision-Language Models

arXiv:2502.20780v2 Announce Type: replace-cross Abstract: The increasing use of vision-language models (VLMs) in healthcare applications presents great challenges related to hallucinations, in which t

MemSecBench: Tracking Agent Memory Poisoning from Persistence to Consequence and Repair

arXiv:2607.27080v1 Announce Type: cross Abstract: Memory systems allow agents to retain and reuse information from past interactions, but they can also let malicious content persist. A malicious instr

MMHBench: A Multi-Perspective Benchmark for Mental Health Understanding in Long-Form Videos

arXiv:2607.27895v1 Announce Type: cross Abstract: Mental health understanding in long-form videos requires nuanced reasoning over observable behavior, interpersonal context, and latent psychological s

MPIE-Bench: Benchmarking Anatomically Plausible Multi-Person Interaction Editing

arXiv:2607.27616v1 Announce Type: new Abstract: Text-to-image and personalized editing models now synthesize high-fidelity single-subject images with ease. Yet placing multiple named people into share

Multi-Agent Debate Strategies: Survey, Taxonomy, and Challenges

arXiv:2607.26212v1 Announce Type: cross Abstract: Multi-Agent Debate (MAD) is a promising paradigm for improving the accuracy and robustness of Large Language Model (LLM)-based agentic systems. It ena

MultivationBench: A Benchmark for Multimodal Sequential Motivation Reasoning

arXiv:2607.26465v1 Announce Type: new Abstract: Multimodal Large Language Models have sparked significant interest due to their potential for social intelligence; however, their ability to perform seq

Optimizing Regret

arXiv:2607.18866v2 Announce Type: replace-cross Abstract: Building on the identity that expected regret equals the covariance between costs and decisions, this paper develops a derivative theory of th

safetyarxiv-cs-lg

Partner Capability Estimation for Task-Agnostic Adaptation in Ad-Hoc Teamwork

arXiv:2607.27177v1 Announce Type: new Abstract: Effective collaboration with novel and diverse partners is a crucial skill for autonomous agents. Most current ad-hoc teamwork (AHT) approaches assume t

PCAP-LM: An LLM-Native Text Representation for TLS Bulk Traffic Analysis

arXiv:2607.28100v1 Announce Type: cross Abstract: Large language models (LLMs) offer powerful reasoning capabilities for network traffic analysis, but standard capture formats and their textual equiva

PlatformBid: An Auto-Bidding Benchmark from a Unified Advertising Platform's Perspective

arXiv:2607.27265v1 Announce Type: new Abstract: Real-time bidding is central to computational advertising, comprising three elements: Supply Side Platform (SSP) selling ad impressions, Demand Side Pla

Prompt Chaining in Practice: A Case Study in Automated Scholarly Report Generation

arXiv:2607.27210v1 Announce Type: new Abstract: The exponential growth of scholarly publications requires automated tools for effective information synthesis. However, simple, single-shot prompting me

applicationsarxiv-cs-cl

Recursive transformers for semiconductor thermo-mechanical reliability

arXiv:2607.27251v1 Announce Type: new Abstract: Transformer-based surrogate models are increasingly used to replace expensive first-principles simulation in engineering design. But conventional transf

RefCaptioner: Multi-Reference Image-Grounded Video Captioning

arXiv:2607.28509v1 Announce Type: new Abstract: Existing video captioning models generate natural descriptions of video content but cannot explicitly ground local visual elements to multiple reference

RMBench: Memory-Dependent Robotic Manipulation Benchmark with Insights into Policy Design

model-releasesarxiv-cs-ro

arXiv:2603.01229v3 Announce Type: replace Abstract: Robotic manipulation policies have made rapid progress in recent years, yet most existing approaches give limited consideration to memory capabiliti

Hardware

ROCS: Request-Oriented Compute Sharing for Efficient Large-Scale Recommendation

arXiv:2607.27744v1 Announce Type: new Abstract: Modern recommendation models gain prediction quality by scaling feature-interaction and sequence modules, but production cost constraints cap how far sy

hardwarearxiv-cs-lg

Same Facts, Different Diagnosis: Measuring and Mitigating Narrative Anchoring in Clinical Language Models

arXiv:2607.27384v1 Announce Type: new Abstract: Large language models used for clinical diagnostic reasoning are sensitive to sociolinguistic register, not just clinical content. We term this failure

Tutorials

Same Graph Cross-Task Transfer in GNNs: Protocols and Predictors

arXiv:2607.28525v1 Announce Type: new Abstract: Many real-world graphs support multiple predictive tasks over the same underlying structure, creating an opportunity to reuse supervision across node cl

tutorialsarxiv-cs-lg

Scalable Drift Monitoring in Medical Imaging AI

arXiv:2410.13174v3 Announce Type: replace-cross Abstract: The integration of artificial intelligence (AI) into medical imaging has advanced clinical diagnostics but poses challenges in managing model

applicationsarxiv-cs-cv

Scaling Vision-Language Models Is Not Enough to Mitigate Bias

arXiv:2607.28211v1 Announce Type: new Abstract: Vision-Language Models (VLMs) such as CLIP are now foundational to multimodal systems, yet their robustness to spurious correlations remains poorly unde

SCOPE: Supply-Chain Operations through Coupled Policies for End-to-End Coordination

arXiv:2607.28488v1 Announce Type: cross Abstract: Can supply-chain AI move beyond isolated decision modules toward unified operational planning? A complete replenishment plan specifies which products

safetyarxiv-cs-lg

SemAnCorr: Semantic Anchored Correspondence for Zero-Shot Manipulation Skill Transfer

model-releasesarxiv-cs-ro

arXiv:2607.28382v1 Announce Type: new Abstract: Transferring manipulation skills across object instances that share functionality but differ in geometry remains a fundamental challenge in robot learni

Tutorials

SUNSET - A Sensor-fUsioN based semantic SegmEnTation exemplar for ROS-based self-adaptation

arXiv:2601.13732v2 Announce Type: replace Abstract: The fact that robots are getting deployed more often in dynamic environments, together with the increasing complexity of their software systems, rai

tutorialsarxiv-cs-ro

TacWAM: Anchor-Guided World Action Model with Mechanics-Aware Tactile Prediction

arXiv:2607.28391v1 Announce Type: new Abstract: World Action Models (WAMs) combine future-state prediction with robot action generation, but existing approaches largely rely on visual futures. Visual

applicationsarxiv-cs-ro