model releases

Trained Agentic Context Management

arXiv:2610.02404v1 Announce Type: cross Abstract: We study long context language models. Instead of training long context natively, or designing a long context harness, we train a model over the simpl

Training-Loss Guarantees for Muon with Finite-Step Newton--Schulz Orthogonalization

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2610.03306v1 Announce Type: cross Abstract: Existing convergence analyses of Muon either assume exact orthogonalization or analyze classical Newton--Schulz polynomials, and guarantee only statio

model-releasesarxiv-cs-ai

5 Oct 2026

Turnover-Orthogonal Credit Assignment for Open-Team Multi-Agent Reinforcement Learning

model-releasesarxiv-cs-lg

arXiv:2610.02847v1 Announce Type: cross Abstract: Open-team multi-agent reinforcement learning studies cooperative systems in which agents may join, leave, or be replaced during an episode. In such se

Understanding Affective Adaptation in Multimodal Foundation Models: Emergent Functional Specialization

arXiv:2601.15906v2 Announce Type: replace Abstract: Despite rapid progress in multimodal affective foundation models, how affective capabilities emerge within their internal architectures remains poor

Understanding Clinical Cognitive Dialogues Using Large Language Models

arXiv:2609.34125v2 Announce Type: replace Abstract: In-person cognitive assessment is both a test and an interaction. Clinicians explain tasks, repair misunderstandings, and adapt to patient responses

Understanding Trajectory Heterogeneity in Federated World Model Learning

arXiv:2610.02957v1 Announce Type: cross Abstract: World models learn state evolution from trajectories, making access to temporal context a central training requirement. Federated learning can use dis

Unmasking Propaganda: A Comparative Analysis of Masked and Causal Language Models

arXiv:2610.03077v1 Announce Type: new Abstract: Propaganda detection is an essential task in natural language processing (NLP), particularly in the context of manipulative political communications. Ho

Update #5: Post training yandex/AliceAI-80B-A3B [instruct!] from scratch

Last update for those following: https://www.reddit.com/r/LocalLLaMA/comments/1wxlytt/comment/pdz728b/?screen_view_count=1 Project in a sentence: An instruct finetune of ALiceAI-80B-A3B-Base capable o

v0.6.0

Overview llama.cpp v0.6.0 introduces the new llama_batch_ext extended batch API (with llama_process) for mixed token/embedding inputs and MTP/deepstack state embeddings, adds support for the GLM-5.3-F

VDOT++: Unified Few-Step Video Generation via Unbalanced Optimal Transport Distillation

arXiv:2610.03221v1 Announce Type: new Abstract: Video creation spans text-to-video (T2V), image-to-video (I2V), and condition-based generation, yet video diffusion models remain costly because they re

Verifiable, Articulable, and Tacit Components of Preference

arXiv:2610.03025v1 Announce Type: new Abstract: What makes a short story gripping; a news article newsworthy; or a math proof elegant? These constructs resist articulation or verification; their meani

VisAudit: Evaluating Multimodal Agents for Visual Diagnosis and Repair

model-releasesarxiv-cs-lg

arXiv:2610.02399v1 Announce Type: new Abstract: Multimodal agents are increasingly used for data visualization tasks but remain limited in autonomous review. Unlike humans, they may fail to recognize

ViTok: Improving Dense Semantics in AM-RADIO-Style Multi-Teacher Distillation with PHI-S and Masked Image Modelling

arXiv:2610.02903v1 Announce Type: new Abstract: We study how to consolidate the current VITOK progress into a single multi-teacher distillation recipe that jointly preserves global recognition and den

VTBench: Evaluating Visual Tokenizers for Autoregressive Image Generation

arXiv:2505.13439v2 Announce Type: replace-cross Abstract: Autoregressive (AR) models have recently shown strong performance in image generation, where a critical component is the visual tokenizer (VT)

WakeKV: Reactive, Reversible KV Residency for Heads That Change Their Minds

arXiv:2610.02713v1 Announce Type: new Abstract: Most KV-cache compression methods classify attention heads once, either offline or during prefill, and keep this classification fixed throughout generat

WAMpy: Efficient Synthesis of Prolog Programs in Python

arXiv:2610.03234v1 Announce Type: cross Abstract: We present WAMpy, a Python framework optimized for synthesizing Prolog programs. Unlike general-purpose Prolog systems, WAMpy targets workloads that r

Watermarks have limits. They’re often undetectable, especially in short passages. Rewriting or translating text can completely remove the wa…

Watermarks have limits. They’re often undetectable, especially in short passages. Rewriting or translating text can completely remove the watermark. That’s why, for now, only approved researchers will

model-releasesopenai--x

We can't thank llama.cpp and @ggerganov enough for being among the pioneers of local AI. But we sure as hell can contribute back! Upstream c…

model-releasesgeorgi-gerganov--x

We can't thank llama.cpp and @ggerganov enough for being among the pioneers of local AI. But we sure as hell can contribute back! Upstream contributions will now become a priority in @qvac. One of our

We turned Claude Code, Codex, Hermes, Pi, @opencode and other coding harnesses into RL environments. No changes to the harnesses, no changes…

model-releasesclem-delangue--x

We turned Claude Code, Codex, Hermes, Pi, @opencode and other coding harnesses into RL environments. No changes to the harnesses, no changes to the training code. Any open model, any task set, fully o

WebFovea: When the Model Is Right but the Click Is Wrong -- Reliable Round Trips for Vision-Based Web Agents on Live Websites

arXiv:2610.03036v1 Announce Type: cross Abstract: We present WebFovea, a vision-based web agent that placed 2nd in the WebRetriever Challenge 2026 with a final score of 57.0 out of 100. The challenge

WebUIProof: Benchmarking WebUI Code Generators with UI-Agent Execution Harness

arXiv:2610.02617v1 Announce Type: cross Abstract: Evaluating WebUI code generation at scale is difficult: outputs may compile and look plausible yet fail under user interaction, and prior benchmarks l

What Does a Token Cost? A Mixture-of-Agents Measurement of Sufficient Per-Token Compute

arXiv:2610.02491v1 Announce Type: new Abstract: Large language models spend the same amount of computation on every token they generate, regardless of how difficult each token is to produce. Methods s

what happens to Deepseek?

I've been using deepseek for long and made valuable outputs and resources, but since the update to the 4.1, deepseek just feels dumb. I ask a simple question and process for long, doesn't plan before

model-releasesr-ollama

When a Correct Reward Is Not Enough: Diagnosing and Guiding PPO in an Analytically Solved Broker-Trader Game

arXiv:2610.03598v1 Announce Type: cross Abstract: Reinforcement learning (RL) is increasingly used for financial optimal-control problems when complex dynamics make analytical strategies difficult to

When possible, we want to give people a choice—and be clear about what watermarking can and can’t do. A text watermark helps answer one ques…

When possible, we want to give people a choice—and be clear about what watermarking can and can’t do. A text watermark helps answer one question: “Was this likely generated by an OpenAI model?” It wor

model-releasesopenai--x

When Predicting Nothing Beats SAM 3: Revisiting Evaluation in Video Object Segmentation

arXiv:2610.02946v1 Announce Type: new Abstract: Video Object Segmentation (VOS) in complex and long videos is increasingly important for real-world applications, where target objects often appear only

When Redditors come in here and ask why we run LLMs, this is why: Big AI is watching.

Anthropic Reports Florida Woman's Claude 'Diary' Threat to Law Enforcement And this time it wasn't the AI model that made the LEO referral. It was the 'human review team'. The frontier AI companies ar

When Terminal-Agent Training Stalls: Demystifying Data Generation and Verification Challenge

arXiv:2610.02405v1 Announce Type: new Abstract: Using a frontier model like Claude Opus as a meta-agent to generate terminal tasks and verifiers for RL training is increasingly common. Yet a runnable

Which model, which harness? I have data for you.

I keep testing harness & model setups on real tasks: basic math, vision, computer use (reading emails, navigating stores) and coding. I created a benchmark and a leaderboard. You can see it here: http

World Editing: Intervening on Executable Worlds at Increasing Depth

arXiv:2610.02331v1 Announce Type: new Abstract: Interactive world models are increasingly capable of generating environments and acting within them, yet deliberately editing an existing executable wor

World Embedding Benchmark

arXiv:2610.03632v1 Announce Type: cross Abstract: Physical fidelity has received increasing attention in world models and video generation, yet how video representations encode physical information re

Writerslogic at the CLEF 2026 SimpleText Track: Multi-Candidate LLM Simplification and Stacked Complexity Spotting

arXiv:2610.03567v1 Announce Type: new Abstract: We describe the Writerslogic team's participation in the CLEF 2026 SimpleText shared task, addressing Task 1 (text simplification) and Task 2 (complexit

Y'all this is a sexy paper; context language models

Paper linky - Context Language Models The central idea of the paper is incredibly simple. Give a model the ability to edit its context on-the-go like a file has major benefits on task performance, con

Zephon: Elastic Determinism for Online, Stateful Foundation Model Data Loading Pipelines

arXiv:2610.03087v1 Announce Type: cross Abstract: Deterministic data loading is important for foundation model development: model researchers need confidence that differences they observe across costl

A Minimal Interpretable Architecture for Zero-Shot Reconstruction of Dynamical Systems [R]

model-releasesr-machinelearning

In our #NeurIPS2026 paper “A Minimal Interpretable Architecture for Zero-Shot Reconstruction of Dynamical Systems (DS)” (preprint: https://arxiv.org/abs/2607.14937) we reduce a DS foundation model to

A Strata fork for IBM AC922 running Qwen3.8-FN UD-Q4_K_XL is doing up to 7,357 tk/s prefill and 113 tk/s decode

I forked Strata and worked with Opus 5.5 with some heavy changes to it to make it work on an IBM AC922 I have access to. The IBM AC922 is a 2018 era beast with two POWER9 20 core SMT4 CPUs that are co

An AI couldn’t beat humans at StarCraft, so it decided to cheat

model-releasesthe-verge-ai

StarSkirmish pits AI-made StarCraft-playing bots against one another, as well as against human-made bots. OpenAI's GPT-6 Astra and Claude Opus 5.5 were essentially tied as the best-performing AI-made

b11382

webgpu: add f16 support to fill/set_rows (#29897) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/52497832 macOS/iOS: macOS Apple Silicon (arm64) macOS Appl

b11384

ci : pushing tag needs deploy key (#29937) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/52545484 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silic

b11386

common : prepare load_from_models_dir() for path conversion (#29674) This is part of the fs::path modernization series. That was also the opportunity to remove fs_list(). Signed-off-by: Adrien Gallouë

b11387

spec : fix n-gram drafts rejected at temp > 0 after truncation (#29924) Co-authored-by: Pranesh Gonegandla pgonegandla@nvidia.com Website: https://llama.app Attestations: https://github.com/ggml-org/l

b11388

imatrix: calculate activation-based statistics for new format (GGUF) imatrices (#14891) Use activations to calculate the stats Determine calculation mode Compute entropy for activations Compute cosine

b11389

vulkan: fix rdna4 mat_vec tuning (#29934) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/52579133 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silico

b11390

CUDA: fix MMQ memory fault if n_expert >> n_ubatch (#29941) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/52581427 macOS/iOS: macOS Apple Silicon (arm64)

b11391

cuda : move blocks_per_col to where it is used (#29939) Signed-off-by: Adrien Gallouët angt@huggingface.co Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/5

b11392

ci : set default permissions (#29945) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/52595372 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (a

b11393

chat-peg-parser : clear current_tool when pending_tool_call is reset (#29942) A TOOL_ID node that arrives after TOOL_CLOSE wrote through current_tool, which still pointed into the just-destroyed pendi

b11396

ci : windows llvm build requires ninja multi-config (#29959) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/52619546 macOS/iOS: macOS Apple Silicon (arm64)