Search: “context”

100B Models on Cheap Hardware: how realistic and limitations

There is a lot of buzz around running 100B parameter models on cheap local hardware using ternary (1.58-bit) quantization like Microsoft's BitNet architecture. The theoretical hardware shortcuts are i

model-releasesr-ollama

26 Jul 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Best C++ Local Model? (July 24th 2026 Edition :-P)

DGX agent

I apologize that this question has been asked in various flavors over time, but I couldn't find anything in the posts before that matches the options I have. I have a PC and a mac, both available in m

model-releasesr-ollama

25 Jul 2026

Getting a second GPU in addition to my RTX3090

Hello, I've been learning how to use local LLMs for a year or so on my workstation, using a RTX3090. Current setup : - i5 12400 - 64gb RAM - RTX 3090 - OS : Fedora KDE workstation I'm using LMStudio t

25 Jul 2026

Ollama Qwen3.6:35b randomly stops outputting tokens

RTX 4070, 32gb system ram, Linux. NVIDIA-SMI 610.43.03, KMD Version: 610.43.03, CUDA UMD Version: 13.3 Systemd service modifications: [Service] Environment='OLLAMA_HOST=0.0.0.0:11434' Environment='OLL

25 Jul 2026

A new model launch is not a product update ‼ It's one of three things, and you don't know which until you test it. Sometimes it's nothing: t…

model-releasesitamar-friedman--x

A new model launch is not a product update ‼ It's one of three things, and you don't know which until you test it. Sometimes it's nothing: the model improved inside the same distribution, your harness

A Sovereign, Open-Source Foundation Model for German and English

arXiv:2607.09424v3 Announce Type: replace-cross Abstract: We present Soofi S 30B-A3B, a sovereign, open-source Mixture-of-Experts (MoE) hybrid Mamba Transformer foundation model for German and English

Belief Propagation in LLM World Models: Measuring Strategic Information Bias with Prediction Markets

arXiv:2607.20441v1 Announce Type: new Abstract: Every information ecosystem produces beliefs that shape strategic decisions. Both human analysts and AI systems inherit the blind spots of their informa

safetyarxiv-cs-cl

CachyLLama’s: llama.cpp fork with persistent KV cache that makes long local-agent sessions much less painful

I’m not affiliated with this project, but I’ve been running it recently and I’m surprised it hasn’t received more attention here: https://github.com/fewtarius/CachyLLama CachyLLama is a fork of llama.

CAMeR: Keyword-Gated Hybrid Activation for Adaptive Memory Retention in LLM Agents

arXiv:2607.20458v1 Announce Type: cross Abstract: Large language model (LLM) agents operating over extended dialogues accumulate vast amounts of information, yet existing memory systems either retain

DC-Leap: Training-Free Acceleration of dLLMs via Draft-Guided Contiguous Leaping Decoding

arXiv:2607.20467v1 Announce Type: new Abstract: While parallel decoding is central to the efficiency of Diffusion Large Language Models (dLLMs), current strategies are often hindered by overly conserv

Does Ollama Cloud prompt caching even work?

I launched a new session and tasked GLM to create an implementation plan for a spec. The plan was on the bigger side, about 5k lines. I started with 0% 5h used and ended with 80% used. A few more twea

local-air-ollama

Drive As You Like: Multi-Head Diffusion with Reinforcement Learning for Personalized Driving

arXiv:2508.16947v2 Announce Type: replace-cross Abstract: Despite significant progress, imitation learning-based autonomous driving planners remain largely restricted to reproducing high-frequency bia

Honest take on Laguna S2.1 and its uses (from actual use)

So I've taken some time to actually test laguna on a few of my own projects. I wanted to share as I feel most peoples comments at this point have just been about getting it running or saying it doesnt

Leaky Language Models: Stealing Architecture and Inference Optimizations via Per-Token Timing

model-releasesarxiv-cs-lg

arXiv:2607.20723v1 Announce Type: cross Abstract: This work presents LeakyLMs, a set of attacks that leak proprietary model, architecture, and deployment information from production language models. L

Hardware

NVIDIA-labs OO Agents: Native Python Object-Oriented Agents

arXiv:2607.20709v1 Announce Type: new Abstract: Traditional agent development is split across prompt templates, tool schemas, callback code, and workflow graphs. We present NVIDIA Object-Oriented Agen

hardwarearxiv-cs-ai

On the Granularity of Causal Effect Identifiability

arXiv:2510.16703v3 Announce Type: replace-cross Abstract: The classical notion of causal effect identifiability is defined in terms of treatment and outcome variables. In this paper, we consider the i

PATS: Policy-Aware Training Scaffolding for Agentic Reinforcement Learning

arXiv:2607.21419v1 Announce Type: new Abstract: In long-horizon LLM agent reinforcement learning, weak policies often repeat similar failures, producing uninformative rollout trajectories and limiting

RUMBA: Russian User Memory Benchmark

arXiv:2607.21447v1 Announce Type: cross Abstract: The ability to handle long-term memory in LLMs is becoming increasingly critical, yet existing benchmarks remain English-centric and rely on aggregate

Rushes: A Human Preference Dataset for Pluralistic Alignment

model-releasesarxiv-cs-cl

arXiv:2607.20767v1 Announce Type: new Abstract: We introduce Rushes, a dataset and benchmark for studying revealed human engagement preferences in interactive narrative environments. Rushes is collect

SR-TTT Does Not Learn Retrieval: A Correction and Mechanistic Post-Mortem of Surprisal-Aware Residual Test-Time Training

arXiv:2603.06642v2 Announce Type: replace-cross Abstract: Test-Time Training (TTT) language models replace the KV-cache with fast weights updated during inference, achieving O(1) memory but suffering

tutorialsarxiv-cs-ai

Toward cryptographically verifiable authorization for autonomous AI agents: A security hypothesis, preliminary formal model, and proof-of-concept implementation

arXiv:2607.21325v1 Announce Type: cross Abstract: Autonomous AI agents increasingly execute actions, invoke tools, and operate on protected resources with limited human oversight. Existing authenticat

VPWEM: Non-Markovian Visuomotor Policy with Working and Episodic Memory

arXiv:2603.04910v2 Announce Type: replace-cross Abstract: Imitation learning from human demonstrations has achieved significant success in robotic control, yet most visuomotor policies still condition

WaveformQA: Benchmarking LLM Temporal Reasoning on Digital Waveforms

arXiv:2607.20638v1 Announce Type: new Abstract: Large Language Models (LLMs) have demonstrated strong capabilities in code generation and reasoning, yet their ability to perform temporal reasoning ove

Built a local RAG app that answers questions from your own PDFs, fully offline

Been wanting to build this for a while, finally sat down and did it. It's a Flask app where you upload a PDF, it chunks and embeds it, and then you can ask questions and get answers pulled only from t

local-air-ollama

Detect Early, Escalate Rarely: Anytime Detection of AI-Generated Video from the Compressed Bitstream

arXiv:2607.19476v1 Announce Type: new Abstract: Detectors for AI-generated video are evaluated offline. A clip is decoded to pixels and scored once, increasingly by a large vision-language model. Dete

researcharxiv-cs-cv

Physics-Aware Complex-Valued State Space Model with Scattering-Prior Feature Modulation for PolSAR Image Classification

arXiv:2607.19787v1 Announce Type: cross Abstract: Polarimetric synthetic aperture radar (PolSAR) image classification is a representative task for physics-aware GeoAI, where land-cover semantics are c

Post-Training in Time Series Foundation Models: A Unifying Framework

arXiv:2607.20002v1 Announce Type: cross Abstract: Time series foundation models (TSFMs) have emerged as general-purpose models for time series analysis, but pretraining alone is often insufficient for

SafeGen: Goal-Conditioned Video Diffusion of Safety-Critical Scenarios for VLM-Based Autonomous Driving

arXiv:2607.19701v1 Announce Type: new Abstract: VLMs are increasingly deployed in AD systems, creating an urgent need for rigorous safety evaluation under rare yet safety-critical scenarios. Among the

safetyarxiv-cs-cv

The Blueprint: How Voicify makes AI-enabled ordering a delight for customers

model-releasesgoogle-cloud-ai

Welcome to The Blueprint, a new feature where we highlight how Google Cloud customers are tackling unique and common challenges across industries using the latest AI and cloud technologies. We hope to

Agents

We're parsing some of the hardest financial documents into clean, plaintext/structured outputs through a live webinar. Come check it out! ht…

We're parsing some of the hardest financial documents into clean, plaintext/structured outputs through a live webinar. Come check it out! https://watch.getcontrast.io/register/llamaindex-from-complex-

agentsjerry-liu--x

22 Jul 2026

Vibe coding isn't just for your PC anymore. Here's LLM Hub generating and previewing code entirely on an iPhone. Everything runs locally. Us…

local-aiyohei-nakajima--x

Vibe coding isn't just for your PC anymore. Here's LLM Hub generating and previewing code entirely on an iPhone. Everything runs locally. Using the RunAnywhere SDK, Timmy Qian ported LLM Hub, an Andro

21 Jul 2026

Interesting finding on frontier models. It turns out that frontier models can write proofs but stumble on faithfully copying a long block of…

Interesting finding on frontier models. It turns out that frontier models can write proofs but stumble on faithfully copying a long block of text. This has huge implications. It sounds trivial, which

tutorialsdair-ai--x

20 Jul 2026

A Hybrid Mamba for Audio-Visual Navigation

arXiv:2607.13110v1 Announce Type: cross Abstract: Since the paradigm centered on convolutional neural networks and recurrent architectures was established in 2020, the fundamental backbone networks fo

FOLIO: Focused Semantic Memory for Streaming Video Understanding

arXiv:2607.13298v1 Announce Type: new Abstract: In online streaming video understanding, a video stream continues to arrive and queries may be issued at any time. Because streaming frames grow without

tutorialsarxiv-cs-cv

Agents

Improving Molecular Property Prediction in Small Language Models Using Graph-based Tools

arXiv:2607.13115v1 Announce Type: new Abstract: Small language models (SLMs) have shown promise for zero-shot molecular property prediction from SMILES strings, yet they often suffer from structural b

agentsarxiv-cs-ai

Learning Safe Agent Behaviour from Human Preferences and Justifications via World Models

arXiv:2607.13172v1 Announce Type: new Abstract: We address the problem of safely training an agent policy and deploying a good and safe policy, in settings where the environment dynamics are unknown a

RAGthoven at SemEval-2026 Task 1: A Multi-Stage Pipeline Walks Into a Benchmark and Barely Clears the Bar

arXiv:2607.13189v1 Announce Type: cross Abstract: We present RAGthoven, our system for SemEval-2026 Task 1 (MWAHAHA), Subtask A (multilingual constrained humor generation in English, Spanish, and Chin

ShortOPD: Recovering Pruned LLMs with Short-to-Long On-Policy Distillation

arXiv:2607.13124v1 Announce Type: cross Abstract: Structured pruning is a hardware-friendly way to compress LLMs, but it is mostly validated on multiple-choice recognition tasks, while the same compre

ABot-AgentOS: A General Robotic Agent OS with Lifelong Multi-modal Memory

model-releasesarxiv-cs-ro

arXiv:2607.10350v1 Announce Type: cross Abstract: Recent VLM and VLA systems have improved robotic perception and action prediction, yet long-horizon embodied agents still require a general runtime la

Automated Tensor Scheduling for Hybrid CPU-GPU LLM Inference on Consumer Devices

arXiv:2607.10183v2 Announce Type: replace-cross Abstract: Running large language models on consumer devices such as laptops and desktops is challenging because model weights often exceed GPU memory ca

local-aiarxiv-cs-ai

BAT-RM: A Boundary-Aware Transformer with Region-Aware Multi-Directional Mamba for Clinically Deployed Cervical Cancer Radiotherapy Auto-Contouring

arXiv:2607.11949v1 Announce Type: cross Abstract: We present a clinically deployed end-to-end auto-contouring system for cervical cancer radiotherapy planning, anchored by the Boundary-Aware Transform

Hardware

Blog and paper: https://research.nvidia.com/labs/gear/robottt/ Presented to you from NVIDIA GEAR Lab. Please check out Yunfan's technical de…

Blog and paper: https://research.nvidia.com/labs/gear/robottt/ Presented to you from NVIDIA GEAR Lab. Please check out Yunfan's technical deep dive! https://x.com/YunfanJiang/status/207740099214934055

hardwarejim-fan--x

Calibration-First Reward-Component Auditing for Reinforcement Learning Control in Smart Greenhouses

arXiv:2607.11959v1 Announce Type: new Abstract: Greenhouse reinforcement learning can test climate-control ideas at a speed and scale that is difficult to achieve with crop experiments alone. For smar

Can a Language Model Learn Facts Continually in Its Weights?

arXiv:2607.11020v2 Announce Type: replace Abstract: Continual learning promises a language model that keeps acquiring knowledge after training, with each new fact written into its weights. Whether wei

tutorialsarxiv-cs-cl

CASHEW: Stabilizing Multimodal Reasoning via Iterative Trajectory Aggregation

arXiv:2601.08010v3 Announce Type: replace Abstract: Vision-language models achieve strong performance across a wide range of multimodal understanding and reasoning tasks, yet their multi-step reasonin

safetyarxiv-cs-cv

DECO: Decoupled Multimodal Diffusion Transformer for Bimanual Dexterous Manipulation with a Plugin Tactile Adapter

arXiv:2602.05513v3 Announce Type: replace-cross Abstract: Bimanual dexterous manipulation relies on integrating multimodal inputs to perform complex real-world tasks. To address the challenges of effe

Deep Learning-based Surrogate Modelling of the LOD Method for Multiscale Problems

arXiv:2607.12570v1 Announce Type: cross Abstract: Multiscale problems are notoriously difficult to tackle using traditional numerical methods, as accurately resolving fine-scale features often require

Do We Really Need Transformers for Global Spatial Information Extraction in Traffic Forecasting?

arXiv:2607.12462v1 Announce Type: new Abstract: Existing traffic forecasting models commonly focus on extracting spatial dependencies, particularly global spatial information, which characterizes the