Search: “context”

New course: Efficient Inference with SGLang: Text and Image Generation, built in partnership with LMSys @lmsysorg and RadixArk @radixark, and taught by Richard Chen @richardczl, a Member of Technical

hardwareandrew-ng--x

9 Apr 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

The memory ownership point is the real story here. Running a persistent agent 24/7, memory isn't a feature — it's the entire value layer. Lo…

DGX agent

The memory ownership point is the real story here. Running a persistent agent 24/7, memory isn't a feature — it's the entire value layer. Lose it and you're back to day zero. Open harness + portable m

agentsharrison-chase--x

9 Apr 2026

https://x.com/Vtrivedy10/status/2041927488918413589

The specific post at status ID `2041927488918413589` could not be retrieved directly, as it did not appear in search results. However, based on the surrounding context from the same account (@Vtriv...

agentsharrison-chase--x

8 Apr 2026

b11712

model-releasesllama-cpp-releases

tests: give the random model generator a per-tensor filler table (#30674) tests: give the random model generator a per-tensor filler table Muse Spark makes test-llama-context fail on state_load, cp_h

17 Oct 2026

nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16 · Hugging Face

Total Parameters 4B Architecture Looped (latent-recurrent) normalized-GPT with interleaved sliding-window attention (SWA) and full-attention layers Precision BF16 Context Length Up to 256K tokens Supp

17 Oct 2026

Xolotl (Strata based) - DeepSeek-V4.1-Flash (552B) on a single 4090 at ~27 tok/s, Uncensored 1017 quant coming in a couple of days

Hey all, been meaning to post this for a while. I've been building an inference engine based off Strata called Xolotl that runs DeepSeek-V4.1-Flash, all 552B of it, on one gaming PC. My setup is a sin

17 Oct 2026

CodeHealth Predicts the Token Cost of Agentic Code Review: A Pre-Registered Study of 465 Agent-Authored Pull Requests

arXiv:2610.21914v1 Announce Type: cross Abstract: Context: Organizations increasingly delegate code review to multi-agent large language model (LLM) pipelines billed per token. Low code quality raises

Compression Does Not End at Selection: Post-Selection Positional Geometry for Sparse KV Caches

arXiv:2610.21126v1 Announce Type: new Abstract: Sparse KV compression reduces long-context inference costs by retaining selected historical states, yet these states typically keep their coordinates fr

DeepSeek V4.1 Flash on 4x DGX Spark: my numbers vs Patrick Moorhead's results via Wccftech.

A couple of weeks ago I read this Wccftech article about Patrick Moorhead's 4 Spark setup. I meant to post this a few days ago but ran some more tests first, and then my workstation had a problem afte

Explore Once, Evaluate Many: Multiple Policy Evaluation for Stochastic Linear Bandits

model-releasesarxiv-cs-lg

arXiv:2610.22252v1 Announce Type: new Abstract: We study how to evaluate K target policies simultaneously in stochastic contextual bandits with linear reward structure. Given a known d-dimensional fea

Hy-Memory-30B-A3B: Attributed Reinforcement Learning for Long-Term Memory Writing

arXiv:2610.22196v1 Announce Type: new Abstract: External-memory systems extend language-model applications beyond a context window, but their quality depends critically on the model executing the writ

KnowGPO: Knowledge-Grouped Policy Optimization for Search Agents

arXiv:2610.22331v1 Announce Type: new Abstract: Deep search agents solve knowledge-intensive tasks through long-horizon, multi-turn interactions, where assigning credit to individual search decisions

safetyarxiv-cs-ai

Memory as Weights: Internalizing Long-Term History for Streaming Videos

arXiv:2610.22070v1 Announce Type: cross Abstract: Streaming vision-language models (VLMs) must continuously integrate information from the past while remaining responsive to current observations and u

Mosaic: Multi-Session Agentic Reinforcement Learning

arXiv:2610.22174v1 Announce Type: cross Abstract: Most existing agentic reinforcement learning methods assume single-session trajectories, where interaction proceeds within one continuously accumulate

OmicsBench: a long-horizon multi-turn benchmark of AI agents on research-study-scale bioinformatics

arXiv:2610.21074v1 Announce Type: new Abstract: Computational biologists increasingly delegate substantial analyses to AI agents in long-horizon, multi-turn sessions, yet most benchmarks of agents' bi

PocketTSLM: Deploying an On-Device Soft-Prompt Time-Series Language Model for Privacy-Preserving Smartphone Reasoning

arXiv:2610.21308v1 Announce Type: cross Abstract: Consumer phones and wearables increasingly collect physiological time-series data, yet most mobile systems treat these streams as summaries or text ra

Local Ai

Qwen3.8-Flash-Next-GSQ-RCO (IQ3_S): ~40-50 tok/sec decode & 1300-1500 tok/sec prefill at 131k ctx on 12GB VRAM + 32GB RAM + NVME

I got Qwen3.8-Flash-Next-GSQ-RCO-Abliterated running at IQ3_S with just 12GB VRAM + 32GB RAM + NVME, achieving 40-50 tok/sec decode & 1300-1500 tok/sec prefill @ 131k context (44k thinking budget), on

local-air-localllama

Rethinking Classifier-Free Guidance for TI2I Flow Matching

arXiv:2610.21550v1 Announce Type: new Abstract: We study Text-and-Image-to-Image (TI2I) flow matching methods for controllable image editing. In a broader generative modeling context, Classifier-Free

safetyarxiv-cs-cv

Tool-Augmented Large Language Models for Reliable Medical Calculation from Patient Notes

arXiv:2610.21477v1 Announce Type: new Abstract: Medical calculators translate raw patient observations into clinically actionable values and scores. However, applying these calculators directly to fre

Towards Unbiased On-Policy Distillation for Block Diffusion Language Models

arXiv:2610.05373v2 Announce Type: replace Abstract: On-policy distillation (OPD) has emerged as an effective post-training paradigm for language models, with recent efforts extending it to block diffu

safetyarxiv-cs-cl

AlignPoison: Conditional Targeted Poisoning of Generative Recommenders via Decoding-Aligned Prefixes

arXiv:2610.14487v1 Announce Type: new Abstract: Generative recommendation models based on autoregressive decoding have been adopted as alternatives to classical ranking-based systems. While their mode

safetyarxiv-cs-ai

b11658

model-releasesllama-cpp-releases

models : add maion-coder (#29778) Add Support to maion-coder arch iAdd Support to support Draft models Address comments Remove maion context shift function Co-authored-by: Karthik Vijayan kavijay@micr

Combining scEEG and PPG for reliable sleep staging

arXiv:2602.15042v2 Announce Type: replace-cross Abstract: Reliable sleep staging remains challenging for lightweight wearable devices such as single-channel electroencephalography (scEEG) or photoplet

researcharxiv-cs-ai

CORE: Contrast-and-Reflect for Self-Supervised Prompt Optimization in Anomaly Synthesis

arXiv:2610.19610v1 Announce Type: new Abstract: Industrial anomaly detection (AD) is bottlenecked by the scarcity of anomalous samples, making high-fidelity anomaly synthesis crucial for improving dow

researcharxiv-cs-cv

Cost-Efficient Privacy Enforcement for Email-Generating LLM Agents under Strategic Information Requests

arXiv:2610.18007v1 Announce Type: cross Abstract: LLM agents now act as delegated communication intermediaries: they read private context, draft messages, and send externally visible emails on behalf

Applications

FleetPilot: Fine-Grained Steering Empowers Real-World LLM Personalization

arXiv:2610.14970v1 Announce Type: new Abstract: With the rapid evolution of large language models (LLMs), there is an increasing demand for effective personalization techniques that can adapt model be

applicationsarxiv-cs-ai

GateSight: Recurrent Memory Anticipates Attention Memory for Query-Agnostic KV Eviction in Hybrid LLMs

arXiv:2610.14754v1 Announce Type: new Abstract: Hybrid language models interleave Gated DeltaNet (GDN) layers, whose recurrent memory has a fixed size, with full-attention layers, whose key-value (KV)

HarnessNet: Feedback-driven Hierarchical Joint Harness Evolution for Multi-agent Systems

arXiv:2610.15221v1 Announce Type: new Abstract: AI agents can evolve by using environment feedback to revise their harnesses, the software managing model inputs, tool use, memory, and execution, while

HiPPT: Physiology-Grounded Wearable PPG Representation Learning via Multi-Scope Text Alignment

arXiv:2610.14489v1 Announce Type: new Abstract: Reusable wearable PPG representations should capture local pulse morphology and broader physiological regularities. Existing pretraining objectives, how

Humans vs. Machines: A Comparison With AI Agents in Software Reverse Engineering

arXiv:2610.14960v1 Announce Type: cross Abstract: Can an autonomous AI agent reverse engineer a binary as well as a skilled human analyst? Do they adopt the same strategy, and can agents scale to real

MCPDisCo: Seesaw-Mitigated Tuning for MCP-Native Agents

arXiv:2610.14956v1 Announce Type: new Abstract: The Model Context Protocol provides a shared interaction substrate for the agentic web, allowing heterogeneous services to expose capabilities through a

Memory Echo in Single-Agent Long-Term Memory: Lifecycle Evaluation and Provenance-Guided Mitigation

arXiv:2610.17763v1 Announce Type: new Abstract: Long-term memory supports agents across sessions. Repeated retrieval and write-back can let one historical claim occupy multiple retrieval positions and

Mistral just released Timestral, a time series foundation model, on Hugging Face State-of-the-art zero-shot forecasting across 3 major bench…

model-releasesclem-delangue--x

Mistral has released **Timestral**, a time‑series foundation model available on Hugging Face. The model achieves state‑of‑the‑art zero‐shot forecasting performance across three major benchmarks, suppo

MorphAct: Robot Policies Morphing with the Worlds They Act In

model-releasesarxiv-cs-ro

arXiv:2610.20019v1 Announce Type: new Abstract: Progress toward general intelligence in the physical world requires scaling robot learning across diverse environments and interactions. However, existi

Local Ai

Narrative Paradoxes in LLM Inference: Shaping Reasoning Trajectories toward Misalignment

arXiv:2610.16312v1 Announce Type: new Abstract: Explicit reasoning in large language models (LLMs) is often associated with reliability, yet it can still pose risks when a model infers harmful goals u

local-aiarxiv-cs-ai

Overtaught, Underlearned: Learner-Centered Distillation from Multi-Agent Discussion

arXiv:2610.16543v1 Announce Type: new Abstract: Multi-agent discussion produces reasoning collaboratively, while deployment still relies on a smaller student that must answer alone. Full-graph distill

PatientWM: Towards Generalizable Clinical World Models via Unified Patient States

arXiv:2610.17059v1 Announce Type: new Abstract: Clinical decisions depend on anticipating how a patient's condition will evolve as treatment is adjusted and new evidence becomes available. Existing me

researcharxiv-cs-ai

ProgAgent: Learning Tool Orchestration through Programmatic Training

arXiv:2610.14774v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly expected to orchestrate diverse tools over long-horizon tasks. Existing agents typically use Direct Tool C

Qwen3.8FN vLLM vs. llama.cpp vs Ninfer6000

I saw u/lkarlslund 's post just over a week ago regarding Ninfer6000 (a fork of Ninfer specifically tuned for 6000 blackwell and Qwen3.8-Flash-Next) and figured 'Hey I'm an idiot & bought one of those

Scale Agentic Coding Workflows with Meta’s Muse Spark Open on NVIDIA GB300 NVL72

model-releasesnvidia-developer

Meta’s Muse Spark Open is an 816‑billion‑parameter mixture‑of‑experts coding model that activates only 42 billion parameters per token through top‑8 routing across 256 experts, and has been trained on

Select or Rewrite: Oracle-Guided Fine-Tuning for Generative ASR Post-Editing from N-Best Hypotheses

arXiv:2610.15056v1 Announce Type: cross Abstract: Large language models can post-edit ASR by using linguistic context to compare N-best hypotheses and rewrite the transcript when needed, often improvi

safetyarxiv-cs-ai

SpecForge: Recursive Self-Improvement for Coding Agents via Behavioral Specifications

arXiv:2610.15708v1 Announce Type: new Abstract: Coding agents based on frozen language models can improve their performance by refining the external context they rely on, without updating model weight

The COUNT: Counting N-grams Unlocks Scaling on Host Memory and Training-Free Adaptation

arXiv:2610.20456v1 Announce Type: new Abstract: The scaling relationship of compute and performance for language models (LMs) has been extensively studied; more recently, models are being designed to

Tutorials

Training Dynamics of Transformers on Unbounded Inputs: Attention Learning Can Lag Output Layer Learning

arXiv:2610.20337v1 Announce Type: new Abstract: The success of transformers is attributed to several factors, including their capacity to express formal languages over variable-length inputs, and abil

tutorialsarxiv-cs-lg

UDHRBench: Benchmarking Human Rights in Large Language Models

arXiv:2610.15179v1 Announce Type: cross Abstract: Large language models are increasingly deployed in contexts requiring adherence to ethical and legal norms, yet their alignment with internationally r

Applications

VaryST: Generalizable Spatio-Temporal Forecasting Beyond the Closed-World Setting

arXiv:2610.19813v1 Announce Type: new Abstract: Spatio-temporal forecasting is fundamental to many real-world systems, yet deployment environments are inherently varying: temporal distributions may ev

applicationsarxiv-cs-lg

What Breaks in Multi-Image Schema Application? Factorial Oracle Interventions Reveal an Instance-Information Bottleneck

arXiv:2610.19611v1 Announce Type: new Abstract: Modern vision-language models can accept multi-image contexts, but aggregate accuracy rarely reveals where a multi-image reasoning pipeline fails. We st

researcharxiv-cs-cv

What the Gemini agent means for startups

model-releasesgoogle-cloud-ai

Small teams, short runway, and constant pressure to ship faster — it’s the reality we see every day among the founders we work with at Google for Startups. When you are building a company from the gro