Search: “context”

Matching Supervision to the Student's Learning Capacity: A Unified Framework for On-Policy Self-Distillation

arXiv:2608.08176v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) improves the reasoning abilities of LLMs by internalizing privileged context into model parameters through self-disti

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Hardware

Mesh-Attention: A New Communication-Efficient Distributed Attention with Improved Data Locality

DGX agent

arXiv:2512.20968v2 Announce Type: replace-cross Abstract: Distributed attention is essential for scaling large language models (LLMs) to long contexts, yet existing methods either have limited paralle

hardwarearxiv-cs-ai

11 Aug 2026

Motif 3: Technical Report

arXiv:2608.09119v1 Announce Type: new Abstract: We introduce Motif 3, a decoder-only Mixture-of-Experts language model with 314 billion total parameters and 13.2 billion activated per token. Each spar

RippleKV: Cross-Layer KV Cache Allocation via Perturbation Propagation

arXiv:2608.08684v1 Announce Type: cross Abstract: Long-context LLM inference is bottlenecked by KV cache memory, yet distributing a limited cache budget across layers remains challenging. Existing met

SHE: Trajectory-driven Safety Harness Evolution for LLM Agents

arXiv:2608.09885v1 Announce Type: new Abstract: The safety of large language model (LLM) agents depends not only on model weights but also on the agent harness that manages context, memory, tools, per

SR-OPSD: Self-Referenced On-Policy Self-Distillation

arXiv:2608.09745v1 Announce Type: cross Abstract: On-policy self-distillation (OPSD) converts feedback into dense token-level supervision on trajectories generated by the policy to be optimized, provi

SurakshaEval: An Indic Safety Benchmark for Multilingual LLMs

arXiv:2608.07862v1 Announce Type: new Abstract: Existing safety evaluation datasets for large language models (LLMs) predominantly focus on English and Western contexts, often overlooking the linguist

The Knowing-Saying Gap: When Probes See Errors that Confidence Misses

arXiv:2608.07528v1 Announce Type: new Abstract: Linear probes detect corrupted context in language models with near-perfect accuracy, yet this does not translate into reliable failure prediction. The

To Memorize or to Retrieve: Scaling the Interaction Between Pretraining and Retrieval

arXiv:2604.00715v2 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) improves language model (LM) performance by providing relevant context at test time for knowledge-intensi

Unsure but Certain: Uncovering the Representation-Confidence Gap in Diffusion Language Models

arXiv:2608.08791v1 Announce Type: new Abstract: Diffusion language models use broad context to create text, suggesting they might handle input noise better than standard models. Testing reveals this i

researcharxiv-cs-cl

b10355

model-releasesllama-cpp-releases

llama : support multi-output backend sampling (#25532) Enable backend sampling with token speculation Clamp the mask sum before converting it into the sampled index Add a numeric context parameter dec

Coupling Planning with Episodic Memory in LLM Agents for Software Issue Resolution

arXiv:2608.06811v1 Announce Type: cross Abstract: Resolving a real software issue with a large language model (LLM) agent is a long repair episode, often tens to hundreds of steps spanning exploration

Degradation-Aware Prompt Learning with Cross-Modal Compensation for Adverse Weather Removal

arXiv:2608.06939v1 Announce Type: new Abstract: Adverse weather causes diverse and complex image degradations, severely compromising the reliability of computer vision systems. Existing all-in-one res

safetyarxiv-cs-cv

Does More Retrieved Evidence Help Visual Retrieval-Augmented Generation with Diffusion Language Models?

arXiv:2608.07006v1 Announce Type: new Abstract: Visual retrieval-augmented generation (RAG) commonly expands the retrieved evidence set to improve answer-page coverage, implicitly assuming that all av

researcharxiv-cs-cl

GeoBenchLLM: A Comprehensive Benchmark for Evaluating LLMs on Geo-Related Tasks

arXiv:2608.07411v1 Announce Type: new Abstract: In the context of geodata, existing Large Language Models have often been studied in a homogeneous setting, which has considerably limited insights into

KnifeHunter: Structured Local Representation Learning for Fine-Grained Knife Image Retrieval in Law Enforcement

arXiv:2608.07057v1 Announce Type: new Abstract: Knife-enabled violence presents a major public safety challenge, and law enforcement agencies require scalable tools for catalogue-level knife identific

safetyarxiv-cs-cv

Multi Codec Discrete Diffusion Model for Text Guided Speech Inpainting and Editing

arXiv:2608.06424v1 Announce Type: cross Abstract: Speech recordings often contain missing, corrupted, or incorrect regions that must be reconstructed or modified without re-synthesizing the entire utt

Please Share Your Experience About Muse Glimmer

model-releasesr-localllama

I have a classic test for local LLM's. I asked for 8 ball pool game with only one HTML file and Muse Glimmer spend 21k Token(I m using full context so 128k) and only created a 220 lines of HTML and sa

RoRA: Role-Oriented Regional Allocation for Visual Token Pruning in MLLMs

arXiv:2608.07088v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) encode images as long visual token sequences, making prefilling and KV-cache storage expensive. Existing trai

TA-RAG: Tone Awareness as a Design Imperative for Retrieval-Augmented Generation

arXiv:2608.06672v1 Announce Type: new Abstract: Retrieval-Augmented Generation (RAG) has become a robust architecture for grounding large language models (LLMs) in trusted knowledge. However, standard

safetyarxiv-cs-cl

The Horizon Gap: Planning, Memory, Execution, Training, and Evaluation for Long-Horizon LLM Agents

arXiv:2608.06663v1 Announce Type: new Abstract: Frontier language models solve reasoning problems in a single forward pass that would have been research contributions years ago, yet fail at multi-hour

safetyarxiv-cs-cl

AI agentic Internet traffic will obviously VASTLY exceed human usage. Not a close call at all. Cloudflare’s forecast is accurate.

AI agentic Internet traffic will obviously VASTLY exceed human usage. Not a close call at all. Cloudflare’s forecast is accurate. For context, Global bandwidth is somewhere between 2-8 Pbps (2,000-8,0

agentselon-musk--x

9 Aug 2026

Tesla V100 Qwen3.6 27B Performance

model-releasesr-localllama

Looking for V100 users to share your config and it's performance. GPU: Tesla V100 PCIE 32Gb Qwen3.6 27B Q4_K_M + Q8_0 MTP 128K context length Pi coding agent llama.cpp model preset: [*] spec-default =

8 Aug 2026

Comparative Approaches to Agent Retrieval over Large Skill Libraries

arXiv:2608.06196v1 Announce Type: new Abstract: Agents backed by large skill libraries must decide which skills to load and in what order. Loading the entire library into context is expensive and prov

agentsarxiv-cs-ai

Controllable Clothing: Precise Labels and Generation for Virtual Try-On with Latent Diffusion Models

arXiv:2608.05834v1 Announce Type: new Abstract: In this technical report, I present a new method for guiding image generation in the context of Virtual- Try-On (VITON). The proposed method leverages n

ConWriter: Transition-Constrained Stateful Long-Form Story Generation with Lightweight Neuro-Symbolic Consistency Control

arXiv:2608.05169v1 Announce Type: new Abstract: Long-form story generation requires models to preserve narrative consistency across extended contexts, yet existing prompting-based methods often accumu

Tutorials

Dynamics of Learning under User Choice: Overspecialization and Peer-Model Probing

arXiv:2602.23565v3 Announce Type: replace Abstract: In many economically relevant contexts where machine learning is deployed, multiple platforms obtain data from the same pool of users, each of whom

tutorialsarxiv-cs-lg

Evidence-Driven Dynamic Visual Selector for Efficient Long Video Understanding

arXiv:2608.05780v1 Announce Type: new Abstract: Recent advancements in MLLM-based long-form video understanding have mitigated inference-time computational cost and limited context lengths by selectin

safetyarxiv-cs-cv

Is Self-Pretraining really useful to improve diagnosis in medical Time Series?

arXiv:2608.06122v1 Announce Type: cross Abstract: Inspired by recent evidence that transformer architectures benefit from Self-PreTraining (SPT) on long-context benchmarks, we investigate whether simi

researcharxiv-cs-ai

Muon on the Stiefel Manifold Admits an Exact Closed-Form Update

arXiv:2608.06218v1 Announce Type: cross Abstract: We study Muon, a recently proposed matrix-aware optimization method, in the context of the Stiefel manifold. This manifold consists of matrices with o

researcharxiv-cs-lg

SkillZip: Contract-Preserving Graph Compression for Scalable Agent Skill Libraries

arXiv:2608.05604v1 Announce Type: cross Abstract: Large Language Models (LLMs) increasingly act as agents whose procedural knowledge is stored in reusable skill packages and loaded at inference time.

agentsarxiv-cs-ai

Surv-IPTB: An Attention-Based Model for Estimating Individual Probability of Treatment Benefit with Survival Data

arXiv:2608.06288v1 Announce Type: new Abstract: This work presents a novel attention-based framework for estimating the Individual Probability of Treatment Benefit (IPTB) in survival analysis contexts

researcharxiv-cs-lg

Local Ai

Vorch-Streamer: Extending Human Audio-Visual Generation to Real-Time Long-Form Streaming

arXiv:2608.05663v1 Announce Type: new Abstract: Real-time long-form avatar audio--video generation requires causal, continuous synthesis while maintaining audiovisual synchronization and visual consis

local-aiarxiv-cs-cv

A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents

arXiv:2602.06052v4 Announce Type: replace-cross Abstract: Research in artificial intelligence is shifting from model innovations and benchmark scores towards problem definition and rigorous real-world

Bag-of-Visual-Words for Spatial Mapping of Lung Adenocarcinoma Growth Patterns

arXiv:2608.05074v1 Announce Type: new Abstract: Spatial mapping of lung adenocarcinoma (LUAD) growth patterns across whole slide images (WSIs) requires resolving architectural context at the region le

Beyond Global Routing Aggregation: Phase-Aware Expert Merging for MoE Vision-Language Models

arXiv:2608.04454v1 Announce Type: new Abstract: Mixture-of-experts vision-language models (MoE-VLMs) increase model capacity with sparse expert activation, yet deployment requires storing the full exp

EdgeLM: Edge Demonstrations for Language Models' Table Understanding

arXiv:2608.04390v1 Announce Type: new Abstract: Large language models (LLMs) perform table-centric prediction through in-context learning, making demonstration selection critical to performance. Exist

researcharxiv-cs-cl

Eigenius: A Typed Knowledge-Graph DBMS with Epistemic Stratification and Institution-Mediated Reasoning

arXiv:2608.04457v1 Announce Type: cross Abstract: As 'AI Scientists' emerge to drive research via the Model Context Protocol (MCP), systems relying on ephemeral scripts will fail. The sheer scale of s

agentsarxiv-cs-ai

Local Ai

EvolveNet: Collaborative Harness Evolution for Agent Self-Improvement

arXiv:2608.04968v1 Announce Type: new Abstract: The capabilities of an LLM agent depend not only on its model but on the harness: the executable program that constructs context, invokes tools, verifie

local-aiarxiv-cs-lg

Final optimization: from ~10 tok/s to ~15 tok/s on DeepSeek-V4-Flash-0731 at 128K ctx - 1 RTX 3090

model-releasesr-localllama

J'ai consacré beaucoup de temps à l'optimisation de DeepSeek-V4-Flash-0731 GGUF sur une seule RTX 3090. Mon exigence absolue pour chaque configuration était la suivante : Le modèle doit rester utilisa

Local Ai

From Understanding to Erasing: Towards Complete and Stable Video Object Removal

arXiv:2604.01693v2 Announce Type: replace Abstract: Video object removal aims to erase target objects while reconstructing visually plausible and temporally coherent content. However, target objects o

local-aiarxiv-cs-cv

RUTA: Principled Visual Token Allocation via Rate-Utility Optimization

arXiv:2608.04132v1 Announce Type: new Abstract: High-resolution images and long videos provide vision-language models with rich context for multimodal reasoning and fine-grained perception, but the re

Tutorials

SJEPA: Learning Elegant Latent Dynamics with Hybrid Symbolic-Neural Predictors

arXiv:2608.04060v1 Announce Type: cross Abstract: Joint-embedding predictive architectures learn abstract states by predicting target embeddings from context embeddings, but their transition models ar

tutorialsarxiv-cs-ai

When Absence Is Evidence: Evaluating Completeness-Sensitive Negative Reasoning in Large Language Models

arXiv:2608.04591v1 Announce Type: cross Abstract: Large language models (LLMs) are often asked whether something is absent from a record, list, or retrieved context. Yet non-observation licenses a neg

researcharxiv-cs-ai

BAP-SQL: Budget-Aware Observation Planning for Agentic Text-to-SQL

arXiv:2608.02876v1 Announce Type: new Abstract: Tool-using agents do not merely consume observations: their actions determine what arrives next. In agentic text-to-SQL, a broad query can spend context

Cross-Lingual Bias in Large Language Models: A Comparative Analysis of English and Swahili

arXiv:2608.03532v1 Announce Type: new Abstract: Large language models are increasingly deployed in multilingual contexts, yet safety alignment and bias evaluation remain overwhelmingly English-centric

Fail-Fast, Restart-Smart: Early Failure Prediction and Restart for SWE Agentic Tasks

arXiv:2608.03222v1 Announce Type: cross Abstract: Software engineering (SWE) agents resolve repository-level issues through long trajectories that grow increasingly expensive as context accumulates. F

How LendingTree built a multi-agent mortgage assistant on Amazon Bedrock

Learn how LendingTree built a production multi-agent mortgage assistant on Amazon Bedrock. Three coordinated agents use LangGraph, the Model Context Protocol, and Amazon Nova models with built-in guar

agentsaws-ml-blog