Search: “evaluation”

Assessing Automated Prompt Injection Attacks in Agentic Environments

arXiv:2606.10525v1 Announce Type: cross Abstract: Indirect prompt injection poses a critical threat to LLM agents that interact with untrusted external data, yet automated attack methods--proven effec

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Attention Expansion: Enhancing Keyphrase Extraction from Long Documents with Attention-Augmented Contextualized Embeddings

DGX agent

arXiv:2606.10716v1 Announce Type: cross Abstract: Pre-trained language models (PLMs) have achieved strong performance in keyphrase extraction (KPE), largely due to their ability to generate rich conte

model-releasesarxiv-cs-ai

10 Jun 2026

Automated Alignment between Elicitation Interviews and Requirements

arXiv:2510.08622v2 Announce Type: replace Abstract: Software requirements are derived from a variety of elicitation techniques, many of which have a conversational nature, like interviews. However, ev

safetyarxiv-cs-cl

BenSyc: Benchmarking Conversational Sycophancy and Human Alignment in LLMs for Bengali Contexts

model-releasesarxiv-cs-cl

arXiv:2606.10061v1 Announce Type: new Abstract: Large language models (LLMs) increasingly participate in emotionally sensitive social conversations, where responses may shift from balanced support tow

Beyond APIs: Probing the Limits of MLLMs in Physical Tool Use

arXiv:2606.10803v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) excel at utilizing digital APIs and increasingly serve as the 'brain' of embodied AI, instructing robots to i

CAST: Counterfactual Labels Improve Instruction Following in Vision-Language-Action Models

arXiv:2508.13446v2 Announce Type: replace Abstract: Generalist robots should be able to understand and follow user instructions. Despite providing a powerful architecture for mapping open-vocabulary l

researcharxiv-cs-ro

ComBench: A Benchmark for Rigorous Proof Reasoning and Constructive Realization in Olympiad-Level Combinatorics

arXiv:2606.10479v1 Announce Type: new Abstract: Combinatorics is central to Olympiad-level mathematical problem solving, requiring deep discrete reasoning, creative constructions, and rigorous structu

Data Journalist Agent: Transforming Data into Verifiable Multimodal Stories

arXiv:2606.11176v1 Announce Type: cross Abstract: Data tells stories that shape society; the data journalist's job is to turn raw information into stories non-experts can trust. A high-quality news fe

agentsarxiv-cs-cl

Decision-Making under Combinatorial Risk

arXiv:2606.10092v1 Announce Type: new Abstract: Decision-making under risk is typically studied through single-shot lottery choices. Yet many real decisions involve combinatorial risk, where risk aris

researcharxiv-cs-lg

Don't waste SAM

model-releasesarxiv-cs-cv

arXiv:2606.10696v1 Announce Type: new Abstract: Meta AI has recently released the Segment Anything Model (SAM), which demonstrates exceptional zero-shot image segmentation performance across various t

Event-Driven Reinforcement Learning Enables Long-Horizon Control in Semiconductor Fabrication

arXiv:2606.10705v1 Announce Type: cross Abstract: Reinforcement learning promises to optimize sequential decisions in large-scale systems. Semiconductor manufacturing systems are stochastic and highly

safetyarxiv-cs-ai

Expert-Level Crisis Detection in Mental Health Conversations

arXiv:2606.10380v1 Announce Type: cross Abstract: Real-world crisis intervention is inherently conversational, yet existing research largely focuses on static texts.Real-world crisis intervention is i

Exploration of Foundation Model-Based Robots in Patient and Elderly Care

arXiv:2606.10208v1 Announce Type: cross Abstract: Demand for older-adult and patient care is growing rapidly as populations age worldwide. Foundation models are increasingly being integrated into robo

researcharxiv-cs-ai

From Context-Aware to Conflict-Aware: Generalizing Contrastive Decoding for Knowledge Conflict in LLMs

arXiv:2606.10298v1 Announce Type: new Abstract: When large language models generate from retrieved or augmented contexts, conflicts between external context and parametric priors remain a central reli

researcharxiv-cs-ai

Gaming AI-Assisted Peer Reviews Poses New Risks to the Scientific Community

arXiv:2606.10159v1 Announce Type: cross Abstract: AI is increasingly used to support scientific peer review, from manuscript screening, reviewer assistance to editorial triage. Although such systems p

Geometric Coastline Localization using Vision-Language Models

arXiv:2606.10468v1 Announce Type: new Abstract: Coastline detection in remote sensing imagery is commonly formulated as a pixel-wise segmentation problem, where the final coastline is extracted from a

local-aiarxiv-cs-cv

IDP-Bench: Benchmarking ability of LLMs to protect personal information in interdependent privacy contexts

arXiv:2606.09908v1 Announce Type: cross Abstract: Large language models (LLMs) are becoming widely deployed as personal AI assistants with access to sensitive user data, making privacy a major challen

Learning Entropy and Spatial Adaptation Dynamics of Multilayer Perceptrons for Structural Point Extraction

arXiv:2606.10170v1 Announce Type: new Abstract: This paper extends the concept of Learning Entropy (LE) from temporal adaptive systems to spatial learning in multilayer perceptron networks (MLPs) appl

applicationsarxiv-cs-lg

Learning the Universe: Posterior Reliability of Neural Generative Models in High-Dimensional Field-Level Inference of Cosmic Initial Conditions

arXiv:2606.10023v1 Announce Type: cross Abstract: Accurate posterior estimation is central to scientific inference, as uncertainties determine what can be reliably learned from observational data. Whi

applicationsarxiv-cs-lg

Lem is generally above Adams, may be tied with Wells. Asimov depends on the series.

applicationsethan-mollick--x

This post likely discusses the relative ranking or comparison of science fiction authors—specifically Stanislaw Lem, Douglas Adams, H.G. Wells, and Isaac Asimov—in terms of literary quality, influence

Modeling Complex Behaviors: Multi-Personality Composition and Dynamic Switching in Vision-Language Models

arXiv:2606.11074v1 Announce Type: cross Abstract: With the widespread deployment of Multimodal Large Language Models (MLLMs) in social interaction, understanding and controlling their behavior under c

Multi-Faceted Interactivity Alignment in Full-Duplex Speech Models

arXiv:2606.11167v1 Announce Type: new Abstract: Full-duplex spoken dialogue models can listen and speak simultaneously, making them a promising architecture for natural conversation. However, current

safetyarxiv-cs-cl

Multi-task LLMs for Bug Classification: Efficient Inference with Auxiliary Decoding Heads

arXiv:2606.09956v1 Announce Type: cross Abstract: The rapid adoption of LLM-powered code generation has dramatically accelerated software development, yet effective verification methods remain severel

local-aiarxiv-cs-lg

Optimizing 2D Input Representations and Sub-phase Fusion Strategies for Differential Diagnosis of Asthma and COPD Using CNN- and GRU-Based Networks

arXiv:2606.10972v1 Announce Type: cross Abstract: This study aims to explore the performance of the VAR model in comparison with mel-frequency cepstral coefficient (MFCC) matrices and log-mel spectrog

researcharxiv-cs-ai

Parametric Knowledge is Not All You Need: Toward Honest Large Language Models via Retrieval of Pretraining Data

model-releasesarxiv-cs-cl

arXiv:2601.21218v2 Announce Type: replace Abstract: Large language models (LLMs) are highly capable of answering questions, but they are often unaware of their own knowledge boundary, i.e., knowing wh

Pareto-Guided Teacher Alignment for Fair Personalized Text Generation

arXiv:2606.10126v1 Announce Type: cross Abstract: Personalized persuasive text generation can improve relevance and engagement, but demographic conditioning may also introduce unequal framing across g

safetyarxiv-cs-ai

PENet+: A Lightweight Residual Transformer Framework for Efficient Image Steganalysis

arXiv:2606.10939v1 Announce Type: new Abstract: Image steganalysis, the detection of hidden information embedded in digital images, is a core component of modern cybersecurity and digital forensics. R

researcharxiv-cs-cv

Regimes: An Auditable, Held-Out-Gated Improvement Loop Demonstrated on LongMemEval with ActiveGraph

arXiv:2606.10241v1 Announce Type: new Abstract: Autonomous improvement loops are hard to trust because the improvement process is usually external scaffolding bolted onto the agent: failures go unlogg

agentsarxiv-cs-ai

Spatio-Temporal Attention Graph Neural Network: Explaining Causalities With Attention

arXiv:2603.10676v2 Announce Type: replace Abstract: Industrial Control Systems (ICS) underpin critical infrastructure and face growing cyber-physical threats due to the convergence of operational tech

researcharxiv-cs-lg

Streaming Knowledge Compilation: Proactive Materiality-Scored Pinning for Time-Evolving LLM Wikis

model-releasesarxiv-cs-cl

arXiv:2606.09877v1 Announce Type: cross Abstract: LLM wiki systems compile knowledge into pre-filled KV caches for efficient inference, but assume a static corpus -- an assumption that fails whenever

Structure from Reasoning, Numbers from Search: On-Premise Open LLMs as Structural Priors for Coupled MIMO Controller Tuning

arXiv:2606.11015v1 Announce Type: new Abstract: Tuning controllers for strongly coupled multi-input multi-output (MIMO) industrial processes is hard: decentralized classical auto-tuning ignores loop i

The 1st PortraitCraft Challenge: A CVPR 2026 Workshop Competition on Portrait Composition Understanding and Generation

model-releasesarxiv-cs-cv

arXiv:2606.10894v1 Announce Type: new Abstract: This paper presents an overview of the inaugural PortraitCraft Challenge, held as one of the official competitions at CVPR 2026. The challenge focuses o

The Arbiter Agent: Continually Monitoring Multi-Agent Conversations to Detect Emergent Misalignment

arXiv:2606.10747v1 Announce Type: new Abstract: As AI systems built from multiple language-model agents become more common, they are increasingly used to make decisions together: discussing, negotiati

agentsarxiv-cs-ai

TRAPS: Therapeutic Response Analysis via Pathway-informed Stratification

model-releasesarxiv-cs-lg

arXiv:2606.09898v1 Announce Type: new Abstract: Cancer treatment planning requires decisions across multiple clinical dimensions at once. Clinicians must determine whether a patient should receive tar

What makes a harness a harness: necessary and sufficient conditions for an agent harness

arXiv:2606.10106v1 Announce Type: cross Abstract: The term agent harness now circulates widely in software engineering with generative artificial intelligence. It names the layer that wraps a language

What Should a Skill Remember? Quality--Cost Trade-offs in Cost-Aware Skill Rewriting for Language Model Agents

arXiv:2606.09421v2 Announce Type: replace Abstract: Large language model agents increasingly rely on skills: reusable procedural documents encoding workflows, tool use, implementation patterns, valida

safetyarxiv-cs-cl

A Camera-Native Talking-Head Video Dataset for Various Computer Vision Tasks

arXiv:2603.26763v2 Announce Type: replace Abstract: Talking-head videos constitute a predominant content type in real-time communication, yet publicly available datasets for video processing research

researcharxiv-cs-cv

A Resilience-as-a-Service assessment framework for coordinated disruption response in interdependent urban transit systems

arXiv:2606.08849v1 Announce Type: new Abstract: Urban public transport disruptions require rapid response strategies, yet existing studies rarely provide a decision support framework to compare altern

agentsarxiv-cs-ai

A Survey of Heterogeneous Graph Neural Networks for Cybersecurity Anomaly Detection

model-releasesarxiv-cs-lg

arXiv:2510.26307v3 Announce Type: replace-cross Abstract: Anomaly detection is a critical task in cybersecurity, where identifying insider threats, access violations, and coordinated attacks is essent

A systematic investigation of molecular encoding methods for drug property predictions across neural network and Transformer encoder-based model

arXiv:2606.08973v1 Announce Type: cross Abstract: Fundamental investigations into how different molecular encoding methods affect molecular property prediction remain relatively limited. In this study

local-aiarxiv-cs-lg

Tutorials

A Universal Dense Football Event Representation Based on TabTransformer

arXiv:2606.09327v1 Announce Type: cross Abstract: Football event data constitute a rich spatiotemporal source for quantitative analysis of player actions in team sports. These datasets contain heterog

tutorialsarxiv-cs-ai

Adversarial Robustness of Activation Steering in Large Language Models

arXiv:2606.07696v1 Announce Type: cross Abstract: Activation steering has become a popular training-free method to control LLM behavior by injecting precomputed direction vectors into the model's resi

applicationsarxiv-cs-ai

AeroSpectra Sentinel: An Auditable LLM Prompt-Chaining Decision-Support Workflow for Acute Asthma Risk Assessment from Respiratory Sounds and Clinical Signals

arXiv:2606.08247v1 Announce Type: cross Abstract: Acute asthma risk assessment requires rapid interpretation of respiratory sounds, oxygenation, airflow limitation, speech ability, work of breathing,

safetyarxiv-cs-ai

Agentic Neuro-Symbolic Planning and Commissioning for Human-in-the-Loop Industrial Robotics with Digital Twins

arXiv:2606.08214v1 Announce Type: new Abstract: Flexible robotic automation requires systems that interpret operator intent, verify physical feasibility, and recover from execution failures across bot

agentsarxiv-cs-ro

AGENTSERVESIM: A Hardware-aware Simulator for Multi-Turn LLM Agent Serving

arXiv:2606.09613v1 Announce Type: cross Abstract: Multi-turn LLM agents interleave model calls with external tool invocations, shifting serving from stateless request processing to stateful program ex

local-aiarxiv-cs-ai

AMN: An Adaptive Multi-Scale Fusion Network with Boundary and Uncertainty Modeling for Nuclei Segmentation

arXiv:2606.07633v1 Announce Type: cross Abstract: Accurate classification of nuclei subtypes in histopathology images is critical for downstream tasks including tumor grading, immune infiltrate quanti

Automatic Extraction of Structured Information from Brain MRI Reports Using an Open-Weight Large Language Model

arXiv:2606.07721v1 Announce Type: new Abstract: Objectives: Automatic data extraction from free-text radiology reports enables large-scale research, but few studies assessed the performance of large l

Benchmarking Empirical Privacy Protection for Adaptations of Large Language Models

model-releasesarxiv-cs-lg

arXiv:2606.09401v1 Announce Type: new Abstract: Recent work has applied differential privacy (DP) to adapt large language models (LLMs) for sensitive applications, offering theoretical guarantees. How