Search: “llm”

Measuring Harmfulness of Computer-Using Agents

arXiv:2508.00935v3 Announce Type: replace-cross Abstract: Computer-using agents (CUAs), which can autonomously control computers to perform multi-step actions, might pose significant safety risks if m

MedQA-MM: Shortcuts Behind Medical Visual Reasoning

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2609.03261v1 Announce Type: cross Abstract: A benchmark score credits final answers, but not the route by which an item can be answered. In medical multimodal multiple-choice questions (MCQs), t

model-releasesarxiv-cs-cl

4 Sept 2026

ObserverBench: Testing Mechanistic Estimates for Intervention and Control

arXiv:2609.03026v1 Announce Type: cross Abstract: Mechanistic interpretability is increasingly used to guide interventions such as activation steering, circuit removal, and safety monitoring. Yet an i

PACE: Towards Surfacing Hidden Conflicts in User Requests

arXiv:2609.03293v1 Announce Type: new Abstract: Personalized assistants should not only comply with user requests but also assess whether those requests are appropriate given the user's current circum

R^{2}Adapter: A Routing and Rewriting Adapter for Efficient Hybrid RAG

arXiv:2609.02894v1 Announce Type: new Abstract: Retrieval-Augmented Generation (RAG) has become a prevailing paradigm for enhancing Large Language Models (LLMs) with non-parametric knowledge. Vanilla

Representational alignment yields generalizable safety in language models

arXiv:2609.04022v1 Announce Type: cross Abstract: Aligning large language models (LLMs) is essential for their safe deployment. Current alignment methods mainly optimize observable responses, yet mode

SafeRestore: Detector-Relative Risk Certificates for Selective Industrial Image Restoration

arXiv:2609.03475v1 Announce Type: new Abstract: Industrial inspection pipelines often restore a measured image before a detector acts on it, yet restoration can suppress detector-supported defect stru

safetyarxiv-cs-cv

SGD-KV: Summarization Guided KV Cache Compression

arXiv:2609.03235v1 Announce Type: new Abstract: Large language models (LLMs) face severe memory bottlenecks in long-context inference due to the linearly growing size of key-value (KV) caches. Existin

SWE-Gate: Passing Functional Tests Is Not Enough for Software Engineering Agents

arXiv:2609.04167v1 Announce Type: cross Abstract: Repository-level software engineering benchmarks have significantly advanced the evaluation of coding agents, but existing benchmarks primarily measur

To What Extent Do Large Language Models Understand Bangla Idioms?

model-releasesarxiv-cs-cl

arXiv:2609.03410v1 Announce Type: new Abstract: Idiomatic expressions are an integral part of natural language, reflecting cultural nuances and posing unique challenges for computational models, parti

Towards Numerical TOHTN Planning with SMT-based HTN-SAT Encoding

arXiv:2609.03938v1 Announce Type: new Abstract: While HTN planning has received significant attention in recent years, support for numerical reasoning remains very limited. In this paper, we investiga

Transfiver: Human-AI Co-Inference through a Shared Editable State

arXiv:2609.03797v1 Announce Type: new Abstract: Long-term human-AI interaction is difficult because the information that guides inference is updated implicitly by the model and is not directly inspect

When Models Edit Too Much: On the Fidelity of Minimal Code Edits

arXiv:2609.04061v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used to edit existing code, but correctness alone is not enough: useful repairs should also be minimal,

Action abstractions for amortized sampling

arXiv:2410.15184v2 Announce Type: replace-cross Abstract: As trajectories sampled by policies used by reinforcement learning (RL) and generative flow networks (GFlowNets) grow longer, credit assignmen

AI Mathematician: Towards Fully Automated Frontier Mathematical Research

arXiv:2505.22451v2 Announce Type: replace Abstract: Large Reasoning Models (LRMs) have made significant progress in mathematical capabilities in recent times. However, these successes have been primar

Before the Script, Set the Stage: How Worldview Simulation Amplifies Psychologically Grounded Persuasion in Multi-Turn Jailbreaking

arXiv:2609.02414v1 Announce Type: cross Abstract: Multi-turn jailbreak attacks demonstrate that harmful intent can be distributed across dialogue, yet existing methods obscure what conversational mech

Beyond-RAG: Question Identification and Answer Generation in Real-Time Conversations

arXiv:2410.10136v2 Announce Type: replace-cross Abstract: In customer contact centers, human agents often struggle with long average handling times (AHT) due to the need to manually interpret queries

Breadth Beats Depth: Improving GCG-Based Jailbreak Optimization with Breadth-Oriented Suffix Search

arXiv:2609.02172v1 Announce Type: new Abstract: Optimization-based jailbreak attacks such as Greedy Coordinate Gradient (GCG) achieve strong effectiveness and transferability by optimizing adversarial

C^{3}T: Counterfactual Causal Reasoning for Sentiment Shifts in Social-Media Conversation Trees

arXiv:2609.02131v1 Announce Type: cross Abstract: Sentiment in social-media threads does not only vary across posts; it shifts as users react to claims, corrections, evidence, and hostility within a b

CivBench: A Long-Horizon Benchmark for Tool-Mediated Agents in Civilization VI

arXiv:2609.02459v1 Announce Type: new Abstract: We present CivBench, an open-source benchmark for evaluating language model agents in long-horizon, tool-mediated environments through the Model Context

Debias-SparseGPT: Bias-Aware Pruning for Large Language Models

arXiv:2609.02496v1 Announce Type: new Abstract: Model compression techniques such as pruning and quantization facilitate the efficient deployment and acceleration of Large Language Models (LLMs). Howe

Discriminative World Models for Web Agents

arXiv:2609.02885v1 Announce Type: new Abstract: Recent web agents use world models for test-time action selection by sampling candidate actions, predicting the resulting web states, and ranking them w

Do Large Language Models Always Tell The Same Stories?

arXiv:2606.17350v2 Announce Type: replace-cross Abstract: Recent advances in large language models (LLMs) have enabled the generation of high-quality prose, yet whether these models are capable of gen

Epistemic Sybil Resistance: Multiplying AI Agents Without Multiplying Evidence

arXiv:2609.01873v1 Announce Type: new Abstract: Multi-agent AI systems improve inference by spawning agents and synthesizing reports. But another agent is not another observation: apparently independe

GAPS: Dimension-Level Gates for Conditional Activation Steering

model-releasesarxiv-cs-cl

arXiv:2609.01878v1 Announce Type: new Abstract: Activation steering suppresses undesired behaviors in language models by adding a steering vector to the hidden state during generation. Recent conditio

How Output Format Confounds Data Quality and Capability in Instruction Tuning

arXiv:2609.02015v1 Announce Type: new Abstract: Instruction-tuning data are judged by quality metrics, and tuned models are judged by benchmarks, but both judgments pass through an output interface: t

Learning Evidence Sufficiency Boundaries for Selective Answering in Grounded Multi-Hop QA

arXiv:2609.01687v1 Announce Type: new Abstract: Grounded question answering systems should answer only when the supplied evidence supports the answer. In multi-hop QA, this requirement is difficult be

MESSY STREETS: A Benchmark for Geocoding Real-World Addresses

model-releasesarxiv-cs-cl

arXiv:2609.01612v1 Announce Type: cross Abstract: We introduce MESSY STREETS, a benchmark for evaluating geocoders on verbatim web addresses, with existence verification and controlled measurement of

MineTRACE: An Evidence-Grounded Interactive Reasoning System for Mineral Prospectivity

arXiv:2609.02060v1 Announce Type: new Abstract: Mineral exploration requires integrating heterogeneous geochemical, geophysical, and geological evidence, yet existing prospectivity systems often provi

Monitoring Web Agents Without Internal Signals: Observable Trajectories and Key-Step Supervision

arXiv:2609.02057v1 Announce Type: new Abstract: Reliable web-agent monitoring is difficult when model-internal uncertainty signals such as token logits are unavailable. In this work, we study prefix-l

OBJECTION! Lawyer Agents Mitigate Guilty Bias in Legal Judgment Prediction

arXiv:2609.02158v1 Announce Type: cross Abstract: Legal Judgment Prediction (LJP) models are typically trained on documents that describe facts from a prosecutorial perspective. Existing datasets furt

PragAlign: Feedback-Guided Pragmatic Alignment for Controlled Synthetic Dialogue Generation

arXiv:2609.02480v1 Announce Type: new Abstract: Synthetic dialogue generation can support research in privacy-restricted service settings, but generated conversations must preserve communicative inten

Ranked by the Matcher: A Reproducibility Audit of Knowledge Graph Extraction from Threat Reports

arXiv:2609.01671v1 Announce Type: cross Abstract: Security teams and researchers choose knowledge-graph extraction tooling for threat reports on the strength of published triple-F1 scores, yet those s

SCX Router: Streaming Zero-Shot Model Selection with a Decoder-KV Classifier and a Real-World Task Ontology

arXiv:2609.02292v1 Announce Type: new Abstract: The rapid proliferation of large language models (LLMs) and the growing diversity of their applications presents a unique optimization opportunity: sele

Local Ai

Seed-Anchored Budget-Bounded Graph Rendering for Question Answering on Industry-Standard Power-Grid Information and Exchange Models

arXiv:2609.02011v1 Announce Type: cross Abstract: Large language model question answering over power-grid models must respect a fixed context budget. We introduce seed-anchored graph rendering, a dete

local-aiarxiv-cs-ai

Tutorials

SMart: A Multi-source Multi-phase Time Series Representation Transfer Framework

arXiv:2609.02203v1 Announce Type: cross Abstract: Time series representation learning (TSRL) has attracted growing research interests in recent years. Two recent explorations in TSRL are: i) exploitin

tutorialsarxiv-cs-ai

Towards One-for-All Robustness Across a Continuum of Threat Levels

arXiv:2609.02440v1 Announce Type: cross Abstract: Adversarially robust models often overfit to a specific attack budget, necessitating multiple specialized models for diverse and dynamic adversarial e

Towards Trustworthy Autonomous Robots: An Explainable AI-Based Decision Framework

arXiv:2609.02861v1 Announce Type: cross Abstract: Autonomous robots powered by deep learning face a fundamental auditability challenge: when incidents occur, investigators cannot reconstruct why the s

What Transfers Under Source Shift? Definitions, Examples, and Fine-Tuning for Climate Disclosure Classification

arXiv:2607.17952v2 Announce Type: replace Abstract: Climate disclosure classification is a fundamental task for analysing corporate climate disclosures, yet such disclosures appear in many different s

Hardware

A Composable Evaluation System for Reproducible Omni-Modal Foundation Model Evaluation

arXiv:2609.01315v1 Announce Type: new Abstract: Building an omni-modal foundation model means evaluating it across text, image, video, and audio. Excellent evaluation toolkits exist for each modality,

hardwarearxiv-cs-ai

A Human-AI Theorem Connecting Spontaneous and Field-Induced Mechanisms of Collective Behavior in One Dimension

arXiv:2609.00322v1 Announce Type: cross Abstract: Can an artificial intelligence (AI) generate a scientific hypothesis outside a human collaborator's active hypothesis space (AHS), and can human-AI re

Applications

A Mathematical Framework for Legacy, Governance, and Decision Integrity in Enterprise AI

arXiv:2609.00572v1 Announce Type: cross Abstract: Enterprise artificial intelligence is increasingly embedded in decisions that must remain lawful, explainable, adaptable, and accountable despite pers

applicationsarxiv-cs-ai

AgentFactory: Towards Automated Agentic System Design and Optimization

arXiv:2609.01045v1 Announce Type: new Abstract: Large Language Models (LLMs) have demonstrated remarkable capabilities as powerful components in agentic systems, enabling sophisticated reasoning and c

Applications

AnalysisBank: An Expert Analysis Pattern Library for Financial Report Generation

arXiv:2609.00818v1 Announce Type: new Abstract: We argue that financial report generation should operate at the analytical rather than structural level, composing content from data-derived insights ra

applicationsarxiv-cs-ai

Athena: Vulnerability-Affected Library Identification via Knowledge Graph Completion

arXiv:2609.01187v1 Announce Type: cross Abstract: A single vulnerability in a widely used library can cascade through millions of dependent applications, yet more than half of vulnerability database e

Automated Tree Knowledge Graph Construction using Ontology Expansion and Retrieval from Vietnamese History Textbooks

arXiv:2609.00763v1 Announce Type: new Abstract: Hierarchical Knowledge graph (KG)-based retrieval augmented generation (RAG) has emerged as a powerful approach for supporting large language models wit

Autonomous discovery of new structure-plausibility laws for explainable and rapid crystal diagnosis and screening

arXiv:2609.01209v1 Announce Type: cross Abstract: Crystal generators and tool-using agents propose structures faster than density functional theory (DFT) energy and phonon calculations or experiments

Beyond the Clock: Measuring the Value of Adaptive Revision

arXiv:2609.00874v1 Announce Type: new Abstract: As agentic systems become compound systems, increasingly important decisions move above task execution itself: when should a higher-level controller pre