Search: “context”

HiKV: Hierarchical Importance-Aware KV Cache with Hardware Acceleration for LLM Decoding

arXiv:2607.22389v1 Announce Type: cross Abstract: With the rapid adoption of long-context large language models (LLMs), the continuously growing KV cache during decoding has become the critical memory

researcharxiv-cs-lg

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Kimi K3 is live on Fireworks. Day 0, inference and training. US-hosted, and zero data retention. This is the first frontier open model in th…

DGX agent

Kimi K3 is live on Fireworks. Day 0, inference and training. US-hosted, and zero data retention. This is the first frontier open model in the 3 trillion parameter class. It sports 1M context, native v

model-releasesfireworks-ai--x

27 Jul 2026

Kimi K3 weights drop today. We're deploying on A100s, H200s and B300s this week and the A100 math is already rough

tldr; we are going to host K3 on A100s (yes, thats correct, we'll try to see if it holds up), H200s & B300s - expect results for A100s & H200s this week while we setup the B300 cluster this weekend &

Leveraging External Knowledge for Historical Document Restoration via Retrieval-Augmented Large Language Models

arXiv:2607.21936v1 Announce Type: new Abstract: Historical documents act as invaluable knowledge archives but often suffer from illegibility due to physical deterioration and damage. While existing re

local-aiarxiv-cs-cl

LMEB: Long-horizon Memory Embedding Benchmark

arXiv:2603.12572v5 Announce Type: replace Abstract: Memory embeddings are crucial for memory-augmented systems, such as OpenClaw, but their evaluation is underexplored in current text embedding benchm

Pixels for Programs? A Cross-Provider Case Study of Input-Token Accounting for Source Code as Text and Images

model-releasesarxiv-cs-cv

arXiv:2607.21672v1 Announce Type: cross Abstract: Long source-code contexts consume many text tokens, motivating the proposal to render code as images for vision-language models. Recent work asks whet

Releasing the model weights and technical report of Kimi K3. Kimi K3 is our most capable model: a 2.8T MoE model with native visual understa…

model-releasesclem-delangue--x

Releasing the model weights and technical report of Kimi K3. Kimi K3 is our most capable model: a 2.8T MoE model with native visual understanding and a 1M-token context window. New model architecture:

Hardware

Six Agent Harness Capabilities for Higher Model Performance

The performance of AI agents depends not only on the underlying models but also heavily on their “harness”—the surrounding architecture that supplies context, state management, action execution, and t

hardwarenvidia-developer

Applications

Start owning your own intelligence today with Kimi K3 on Fireworks. Serve it, fine-tune it, and put it into production. What are you waiting…

applicationsfireworks-ai--x

**Summary:** Kimi K3 is a publicly available 3‑trillion‑parameter language model now live on Fireworks, offering 1 million-token context windows with native vision and reasoning that rivals top closed

The LangChain podcast where @hwchase17 interviews agent builders is full of alpha. Recent one with @EnoReyes was the best one yet. Sharing m…

model-releasesharrison-chase--x

The LangChain podcast where @hwchase17 interviews agent builders is full of alpha. Recent one with @EnoReyes was the best one yet. Sharing my unstructured notes: Eno keeps bringing back some core conc

Toward High-Fidelity 3D Point-Cloud Learning for Brain Folding Morphology Prediction Using Trans-Unet

arXiv:2607.21840v1 Announce Type: new Abstract: Learning high-fidelity point-cloud features in the 3D space poses significant challenges, including permutation invariance, lack of local context, diffi

local-aiarxiv-cs-cv

Towards Reducing Foreign Language Anxiety Using Level-Appropriate Embodied Conversational Agents

arXiv:2607.21887v1 Announce Type: cross Abstract: Foreign language anxiety (FLA) can be a major barrier to second language acquisition (SLA), especially in conversational contexts. With the proliferat

agentsarxiv-cs-cl

This part is spot on: > 'Overall, we found that we were over-constraining Claude Code...while these constraints were once needed to avoid wo…

model-releasesjerry-liu--x

This part is spot on: > 'Overall, we found that we were over-constraining Claude Code...while these constraints were once needed to avoid worst case scenarios, we have since found we can delete many o

26 Jul 2026

Industry

Great to see this out, proud of the team!!! @AMD Instella 16B MoE foundation model, fully open with checkpoint after each stage from pretrai…

Great to see this out, proud of the team!!! @AMD Instella 16B MoE foundation model, fully open with checkpoint after each stage from pretraining, long-context, SFT, DPO and RL. Dataset detail, trainin

industryemad-mostaque--x

25 Jul 2026

Kimi Linear 48B A3B?

Just noticed this exists, 1M context MOE with 48B par seems just like what Ive been looking for - it runs pretty damn fast too compared to Qwen 3.6 35B. after some testing it seems capable of producin

25 Jul 2026

Domyn-Small: A European 10B Reasoning Language Model

arXiv:2607.20448v1 Announce Type: new Abstract: We introduce Domyn-Small, a 10-billion-parameter open-weight reasoning language model released under the MIT license. Domyn-Small is the product of an i

DynamicMCPBench: A Trace-Grounded, Effect-Scored Benchmark for LLM Agents over Live MCP Servers

arXiv:2607.20531v1 Announce Type: new Abstract: Large language model (LLM) agents are increasingly deployed over Model Context Protocol (MCP) servers, yet the benchmarks used to evaluate them score th

swiss-ai/Apertus-v1.5 70B/8B

https://huggingface.co/swiss-ai/Apertus-v1.5-70B https://huggingface.co/swiss-ai/Apertus-v1.5-8B Apertus 1.5 is a family of 8B and 70B parameter language models designed to advance the state of multil

THOR: A Theta-Gamma Hierarchical Oscillatory Reasoning Framework for Multi-hop QA

arXiv:2607.20459v1 Announce Type: cross Abstract: Multi-hop question answering requires retrieving and integrating evidence from multiple contexts. Despite the rapid progress of current research, mult

researcharxiv-cs-ai

Transition-Related Potentials as Markers of Narrative Comprehension in Continuous EEG

arXiv:2607.20720v1 Announce Type: cross Abstract: Harnessing the potential of electroencephalography (EEG) for brain research is fundamentally limited by intrinsic noise and the diffuse projection of

researcharxiv-cs-ai

Applications

AugAbEx: Bridging Abstractive and Extractive Legal Summarization

arXiv:2511.12290v2 Announce Type: replace Abstract: Automatic summarization of legal judgments liberates law professionals from heavy cognitive burden due to the complexity of the language, context-se

applicationsarxiv-cs-cl

ChainWatch: A Kill Chain-Aligned Sequential Detection Framework for Multi-Step Attacks in MCP-Based AI Agent Systems

arXiv:2607.19432v1 Announce Type: cross Abstract: The Model Context Protocol (MCP) is an open-source standard that allows AI agents to connect to external tools, databases, and services. While this co

agentsarxiv-cs-ai

CreatiPoster: Towards Editable and Controllable Multi-Layer Graphic Design Generation

model-releasesarxiv-cs-cv

arXiv:2506.10890v2 Announce Type: replace Abstract: Graphic design plays a crucial role in both commercial and personal contexts, yet creating high-quality, editable, and aesthetically pleasing graphi

GeoTrace: Geometry-Aware Trajectory Token Compression for Video Large Language Models

arXiv:2607.09080v2 Announce Type: replace Abstract: Although Video Large Language Models (Video LLMs) have shown strong performance in video understanding, their efficiency is still limited by the lar

local-aiarxiv-cs-cv

H^2SD: Hybrid Hindsight Self-Distillation

arXiv:2607.18955v2 Announce Type: replace-cross Abstract: Reinforcement learning with verifiable rewards (RLVR) provides reliable outcome supervision for language model reasoning, but a scalar traject

researcharxiv-cs-cl

It's Not What You Say, It's How You Say It: Evaluating LLM Responses to Expressions of Belief

arXiv:2607.18232v2 Announce Type: replace Abstract: Users frequently express their beliefs to large language models (LLMs). In some situations, the LLM should accept these contextual beliefs as true.

LAVIFT: Latent-Action-Guided Vision Fine-Tuning for Surgical Interaction Recognition

arXiv:2607.19889v1 Announce Type: new Abstract: Understanding instrument-tissue interactions is essential for context-aware surgical AI and autonomous robotic surgery. Pretrained vision-language model

local-aiarxiv-cs-cv

Industry

NowSecure adds AI-native testing to keep pace with AI-built mobile apps

Mobile app security company NowSecure Inc. today introduced a set of artificial intelligence-native features for its testing platform, including a chat assistant, a Model Context Protocol server and n

industrysiliconangle

Nuclear Quantum Effects as a Denoising Problem

arXiv:2607.19680v1 Announce Type: cross Abstract: Nuclear quantum effects are rigorously captured by imaginary-time path integrals, which map the quantum Boltzmann distribution onto a ring polymer of

researcharxiv-cs-lg

On the Systematic Challenges of Culturally Loaded Machine Translation: Dream of the Red Chamber as the Cultural Lens

arXiv:2607.20241v1 Announce Type: cross Abstract: Culturally loaded translation poses unique challenges for machine translation (MT), as meanings are deeply embedded in socio-cultural contexts beyond

researcharxiv-cs-ai

PRiSM: Prototype Regularization for Few-Shot VLMs

model-releasesarxiv-cs-cv

arXiv:2607.17820v2 Announce Type: replace Abstract: Training-free few-shot adaptation methods have gained significant attention recently in the context of Vision-language Models (VLMs). Yet, current b

PRO-LONG: Programmatic Memory Enables Long-Horizon Reasoning

arXiv:2607.20064v1 Announce Type: new Abstract: Long-horizon tasks require sustained perception, reasoning, and exploration, and are a persistent challenge for large language model (LLM) agents. This

agentsarxiv-cs-ai

Reinforcement Learning for Large Language Model Selective Evidence Adoption from Contaminated Retrieval Results

arXiv:2607.20090v1 Announce Type: cross Abstract: Retrieval-augmented large language models frequently face contexts that interleave useful evidence with misleading statements or instruction-like cont

Surprise Forcing: What to Remember, When to Skip in Long Video Generation

arXiv:2607.18436v1 Announce Type: new Abstract: Streaming autoregressive diffusion makes minute-scale video synthesis practical, but its bounded context and fixed denoising schedule allocate resources

researcharxiv-cs-cv

Trained a 32B FLUX.2 LoRA on a 24GB AMD 7900 XTX, native ROCm on Windows — full guide + patches

model-releasesr-stablediffusion

TL;DR: Everyone says QLoRA past ~13B is dead on a 24GB card. I got the full 32B FLUX.2 dev transformer QLoRA-training resident on the GPU on a 7900 XTX under native ROCm on Windows (no ZLUDA, no CUDA

SkewAdam: A tiered optimizer that cuts MoE state memory by 97% (fits a 6.7B MoE on a 40GB GPU) [R]

model-releasesr-machinelearning

Paper:https://arxiv.org/abs/2607.19058 Code (GitHub):https://github.com/nuemaan/skewadam Hi everyone, I just published a preprint on a new optimizer designed to tackle the massive VRAM bottleneck in M

22 Jul 2026

Stuck scaling a Next.js app on M3 Pro (36GB) using local Qwen 3.6 + VS Code Copilot. Should I switch extensions or go paid?

Hey everyone, I’m a Full-Stack Developer with 6+ years of experience. I’m relatively new to AI-assisted development workflows and want to build a production-ready, enterprise-level Next.js web applica

model-releasesr-ollama

22 Jul 2026

My OCR model mislabels section titles as body text. Is a CRF the right fix, or am I overcomplicating it? [P]

model-releasesr-machinelearning

Hi everyone, I'm working on extracting the hierarchical structure of long PDF documents (legal/regulatory text, lots of numbered sections) and would like to gather some feedback on my approach before

21 Jul 2026

Today we’re releasing Poolside Laguna S 2.1 It is a 118B-total, 8B-active open-weight model built for agentic coding and long-horizon work, …

model-releasesclem-delangue--x

Today we’re releasing Poolside Laguna S 2.1 It is a 118B-total, 8B-active open-weight model built for agentic coding and long-horizon work, with context up to 1M tokens https://poolside.ai/blog/introd

21 Jul 2026

Benefits and Limitations of Communication in Multi-Agent Reasoning

arXiv:2510.13903v2 Announce Type: replace-cross Abstract: Chain-of-thought prompting has popularized step-by-step reasoning in large language models, yet model performance still degrades as problem co

agentsarxiv-cs-ai

Compaction as Epistemic Failure: How Agentic LLM Tools Fabricate Confirmed Results from Killed Processes

arXiv:2607.13071v1 Announce Type: cross Abstract: Agentic LLM coding tools compress long session histories into compaction summaries that subsequent sessions inherit as ground truth. This paper docume

Interaction Protocol Shapes Moral Judgment in Multi-Agent Debate

arXiv:2510.10002v3 Announce Type: replace Abstract: As large language models (LLMs) are increasingly deployed in sensitive everyday contexts -- offering personal advice, mental health support, and mor

Tutorials

The Hitchhiker's Guide to Monoculture

arXiv:2607.13077v1 Announce Type: cross Abstract: Large language models (LLMs) often produce homogeneous outputs, raising concerns that AI coding assistants may lead to convergence in the software art

tutorialsarxiv-cs-ai

A Shared Subcircuit Lets LLMs Count Down Across Tasks

arXiv:2607.12279v1 Announce Type: new Abstract: Writing a sentence of exactly twelve words; ending a DNA sequence at the right codon; formatting an ASCII table. These are all tasks that language model

Bonsai-27B & Ternary-Bonsai-27B - Updates (on PRs)

Below Upstream Status sections are from https://github.com/PrismML-Eng/Bonsai-demo Upstream Status for Binary Q1_0 is supported out of the box in upstream llama.cpp across many backends: CPU (generic,

Applications

Causal Supervision of Attention for Affective Behaviour Analysis

arXiv:2607.12091v1 Announce Type: new Abstract: Affective Behaviour Analysis aims to enable machines to infer human affective states from behavioural signals, particularly facial expressions, in real-

applicationsarxiv-cs-cv

CLaRa: Bridging Retrieval and Generation with Continuous Latent Reasoning

researchapple-ml-research

Retrieval-augmented generation (RAG) enhances large language models (LLMs) with external knowledge but still suffers from long contexts and disjoint retrieval–generation optimization. In this work, we

Extractable Memorization From First Principles

arXiv:2607.12649v1 Announce Type: cross Abstract: Recent work on extractable memorization in LLMs suffers from two contrasting validity problems. Some studies overstate extraction, e.g., relying on se