Search: “arxiv-cs-cl”

Should We Still Pretrain Encoders with Masked Language Modeling?

arXiv:2507.00994v4 Announce Type: replace Abstract: Learning high-quality text representations is fundamental to a wide range of NLP tasks. While encoder pretraining has traditionally relied on Masked

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Simulated Students in Tutoring Dialogues: Substance or Illusion?

DGX agent

arXiv:2601.04025v2 Announce Type: replace Abstract: Advances in large language models (LLMs) enable many new innovations in education. However, evaluating the effectiveness of new technology requires

model-releasesarxiv-cs-cl

6 May 2026

Sparse Memory Finetuning as a Low-Forgetting Alternative to LoRA and Full Finetuning

arXiv:2605.03229v1 Announce Type: new Abstract: Adapting a pretrained language model to a new task often hurts the general capabilities it already had, a problem known as catastrophic forgetting. Spar

Steer Like the LLM: Activation Steering that Mimics Prompting

arXiv:2605.03907v1 Announce Type: new Abstract: Large language models can be steered at inference time through prompting or activation interventions, but activation steering methods often underperform

Local Ai

Stochastic Attention: Connectome-Inspired Randomized Routing for Expressive Linear-Time Attention

arXiv:2604.00754v2 Announce Type: replace Abstract: The whole-brain connectome of a fruit fly comprises over 130K neurons connected with a probability of merely 0.02%, yet achieves an average shortest

local-aiarxiv-cs-cl

SURE-RAG: Sufficiency and Uncertainty-Aware Evidence Verification for Selective Retrieval-Augmented Generation

arXiv:2605.03534v1 Announce Type: new Abstract: Retrieval-augmented generation (RAG) grounds answers in retrieved passages, but retrieval is not verification: a passage can be topical and still fail t

Task Vector Geometry Underlies Dual Modes of Task Inference in Transformers

arXiv:2605.03780v1 Announce Type: cross Abstract: Transformers are effective at inferring the latent task from context via two inference modes: recognizing a task seen during training, and adapting to

TeamUp: Semantic Project Matching and Team Formation for Learning at Scale

arXiv:2605.03237v1 Announce Type: cross Abstract: Project-based learning improves student engagement and learning outcomes, yet allocating students to appropriately challenging projects while forming

The Counterexample Game: Iterated Conceptual Analysis and Repair in Language Models

arXiv:2605.03936v1 Announce Type: new Abstract: Conceptual analysis -- proposing definitions and refining them through counterexamples -- is central to philosophical methodology. We study whether lang

The Enemy from Within: A Study of Political Delegitimization Discourse in Israeli Political Speech

arXiv:2508.15524v3 Announce Type: replace Abstract: We present the first large-scale computational study of political delegitimization discourse (PDD), defined as symbolic attacks on the normative val

Hardware

The Polar Express: Optimal Matrix Sign Methods and Their Application to the Muon Algorithm

arXiv:2505.16932v5 Announce Type: replace-cross Abstract: Computing the polar decomposition and the related matrix sign function has been a well-studied problem in numerical analysis for decades. Rece

hardwarearxiv-cs-cl

The Right Answer, the Wrong Direction: Why Transformers Fail at Counting and How to Fix It

arXiv:2605.03258v1 Announce Type: cross Abstract: Large language models often fail at simple counting tasks, even when the items to count are explicitly present in the prompt. We investigate whether t

The TTS-STT Flywheel: Synthetic Entity-Dense Audio Closes the Indic ASR Gap Where Commercial and Open-Source Systems Fail

arXiv:2605.03073v1 Announce Type: new Abstract: Niche-domain Indic ASR -- digit strings, currency amounts, addresses, brand names, English/Indic codemix -- is under-served by both open-source SOTA and

To Write or to Automate Linguistic Prompts, That Is the Question

arXiv:2603.25169v2 Announce Type: replace Abstract: LLM performance is highly sensitive to prompt design, yet whether automatic prompt optimization can replace expert prompt engineering in linguistic

TRACE: A Metrologically-Grounded Engineering Framework for Trustworthy Agentic AI Systems in Operationally Critical Domains

arXiv:2605.03838v1 Announce Type: new Abstract: We introduce TRACE, a cross-domain engineering framework for trustworthy agentic AI in operationally critical domains. TRACE combines a four-layer refer

Local Ai

Tracing the Dynamics of Refusal: Exploiting Latent Refusal Trajectories for Robust Jailbreak Detection

arXiv:2605.02958v1 Announce Type: cross Abstract: Representation Engineering typically relies on static refusal vectors derived from terminal representations. We move beyond this paradigm, demonstrati

local-aiarxiv-cs-cl

Transformers with Selective Access to Early Representations

arXiv:2605.03953v1 Announce Type: cross Abstract: Several recent Transformer architectures expose later layers to representations computed in the earliest layers, motivated by the observation that low

TriBench-Ko: Evaluating LLM Risks in Judicial Workflows

arXiv:2605.03792v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly integrated into legal workflows. However, existing benchmarks primarily address proxy tasks, such as bar e

Two Calls, Two Moments, and the Vote-Accuracy Curve of Repeated LLM Inference

arXiv:2605.03379v1 Announce Type: cross Abstract: Repeated sampling is a standard way to spend test-time compute, but its benefit is controlled by the latent distribution of correctness across example

Understanding and Mitigating Bias Inheritance in LLM-based Data Augmentation on Downstream Tasks

arXiv:2502.04419v3 Announce Type: replace-cross Abstract: Generating synthetic datasets via large language models (LLMs) has emerged as a promising approach to improve LLM performance. However, LLMs i

Vibe Code Bench: Evaluating AI Models on End-to-End Web Application Development

arXiv:2603.04601v2 Announce Type: replace-cross Abstract: Code generation has emerged as one of AI's highest-impact use cases, yet existing benchmarks measure isolated tasks rather than the complete '

When Prompts Interact: Assessing Prompt Arithmetic for Deconfounding under Distribution Shift

arXiv:2605.03096v1 Announce Type: cross Abstract: In classification tasks, models may rely on confounding variables to achieve strong in-distribution performance, capturing spurious features that fail

When Should a Language Model Trust Itself? Same-Model Self-Verification as a Conditional Confidence Signal

arXiv:2605.02915v1 Announce Type: new Abstract: Same-model self-verification, prompting a model to audit its own predicted answer, is a plausible confidence signal for selective prediction, but its pr

When to Think, When to Speak: Learning Disclosure Policies for LLM Reasoning

arXiv:2605.03314v1 Announce Type: new Abstract: In single-stream autoregressive interfaces, the same tokens both update the model state and constitute an irreversible public commitment. This coupling

Workspace-Bench 1.0: Benchmarking AI Agents on Workspace Tasks with Large-Scale File Dependencies

arXiv:2605.03596v1 Announce Type: cross Abstract: Workspace learning requires AI agents to identify, reason over, exploit, and update explicit and implicit dependencies among heterogeneous files in a

A framework for analyzing concept representations in neural models

arXiv:2605.01381v1 Announce Type: new Abstract: Understanding how neural models represent human-interpretable concepts is challenging. Prior work has explored linear concept subspaces from diverse per

Agents

A Language for Describing Agentic LLM Contexts

arXiv:2605.01920v1 Announce Type: cross Abstract: Large language models are increasingly used within larger systems ('LLM agents'). These make a sequence of LLM calls, each call providing the LLM with

agentsarxiv-cs-cl

A Multi-View Media Profiling Suite: Resources, Evaluation, and Analysis

arXiv:2605.01336v1 Announce Type: new Abstract: News outlets shape public opinion at a scale that makes automated detection of political bias and factuality essential. However, the field still lacks u

A multilingual hallucination benchmark: MultiWikiQHalluA

arXiv:2605.02504v1 Announce Type: new Abstract: Most hallucination evaluations focus on English, leaving it unclear whether findings transfer to lower-resource languages. We investigate faithfulness h

A Multimodal Dataset for Visually Grounded Ambiguity in Machine Translation

arXiv:2605.02035v1 Announce Type: new Abstract: Ambiguity resolution is a key challenge in multimodal machine translation (MMT), where models must genuinely leverage visual input to map an ambiguous e

A Systematic Benchmark of Machine Transliteration Models for the Tajik-Farsi Language Pair: A Comparative Study from Rule-Based to Transformer Architectures

arXiv:2605.02270v1 Announce Type: new Abstract: This paper presents the first comprehensive comparative analysis of modern machine learning architectures for transliteration between Tajik (Cyrillic sc

A Systematic Exploration of Text Decomposition and Budget Distribution in Differentially Private Text Obfuscation

arXiv:2605.01065v1 Announce Type: new Abstract: The goal of differentially private text obfuscation is to obfuscate, or 'perturb', input texts with Differential Privacy (DP) guarantees, such that the

A Theoretical Game of Attacks via Compositional Skills

arXiv:2605.01034v1 Announce Type: new Abstract: As large language models grow increasingly capable, concerns about their safe deployment have intensified. While numerous alignment strategies aim to re

Accurate Legal Reasoning at Scale: Neuro-Symbolic Offloading and Structural Auditability for Robust Legal Adjudication

arXiv:2605.02472v1 Announce Type: new Abstract: Legal texts often contain computational legal clauses--provisions whose understanding requires complex logic. While frontier Large Reasoning Models (LRM

Adaptive GoGI-Skip: Coupling Goal-Gradient Importance with Dynamic Uncertainty for Efficient Reasoning

arXiv:2505.08392v3 Announce Type: replace Abstract: Chain-of-Thought (CoT) prompting trades inference speed for reasoning accuracy. Existing compressors force a compromise as static gradient technique

Addressing Data Scarcity in Bangla Fake News Detection: An LLM-Based Dataset Augmentation Approach

arXiv:2605.01292v1 Announce Type: new Abstract: The growing spread of misinformation in digital media highlights the need for reliable fake news detection systems, yet progress in under-resourced lang

Agents

AgentXRay: White-Boxing Agentic Systems via Workflow Reconstruction

arXiv:2602.05353v3 Announce Type: replace-cross Abstract: Large Language Models have shown strong capabilities in complex problem solving, yet many agentic systems remain difficult to interpret and co

agentsarxiv-cs-cl

ALIGNS: Unlocking nomological networks in psychological measurement through a large language model

arXiv:2509.09723v3 Announce Type: replace Abstract: Psychological measurement is critical to many disciplines. Despite advances in measurement, building nomological networks, theoretical maps of how c

Tutorials

An Information-theoretic Propagation Denoising and Fusion Framework for Fake News Detection

arXiv:2605.02259v1 Announce Type: new Abstract: Incomplete propagation data significantly hinders robust fake news detection. Recent approaches leverage large language models to simulate missing user

tutorialsarxiv-cs-cl

Argumentation for Explainable and Globally Contestable Decision Support with LLMs

arXiv:2603.14643v2 Announce Type: replace-cross Abstract: Large language models (LLMs) exhibit strong general capabilities, but their deployment in high-stakes domains is hindered by their opacity and

ARGUS: Policy-Adaptive Ad Governance via Evolving Reinforcement with Adversarial Umpiring

arXiv:2605.02200v1 Announce Type: new Abstract: Online advertising governance faces significant challenges due to the non-stationary nature of regulatory policies, where emerging mandates (e.g., restr

Arithmetic in the Wild: Llama uses Base-10 Addition to Reason About Cyclic Concepts

arXiv:2605.01148v1 Announce Type: cross Abstract: Does structure in representations imply structure in computation? We study how Llama-3.1-8B reasons over cyclic concepts (e.g., 'what month is six mon

Artificial intelligence language technologies in multilingual healthcare: Grand challenges ahead

arXiv:2605.01441v1 Announce Type: new Abstract: AI language technologies (AILTs), increasingly enabled by large language models (LLMs), are becoming embedded in multilingual healthcare workflows for t

ATLAS: Article Tracking, Linking, and Analysis of Swedish Encyclopedias

arXiv:2605.02466v1 Announce Type: new Abstract: The digitization of old encyclopedias represents an important step to improve access to historically structured knowledge. Often, however, this process

ATR-Bench: A Federated Learning Benchmark for Adaptation, Trust, and Reasoning

arXiv:2505.16850v2 Announce Type: replace-cross Abstract: Federated Learning (FL) has emerged as a promising paradigm for collaborative model training while preserving data privacy across decentralize

Attention Sink Forges Native MoE in Attention Layers: Sink-Aware Training to Address Head Collapse

arXiv:2602.01203v2 Announce Type: replace Abstract: Large Language Models (LLMs) often assign disproportionate attention to the first token, a phenomenon known as the attention sink. Several recent ap

Attention Sinks in Massively Multilingual Neural Machine Translation:Discovery, Analysis, and Mitigation

arXiv:2605.01229v1 Announce Type: cross Abstract: Cross-attention patterns in neural machine translation (NMT) are widely used to study how multilingual models align linguistic structure. We report a

Applications

Attribution-Guided Pruning for Insight and Control: Circuit Discovery and Targeted Correction in Small-scale LLMs

arXiv:2506.13727v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) are widely deployed in real-world applications, yet their internal mechanisms remain difficult to interpret and c

applicationsarxiv-cs-cl