local ai

Built an SQLite memory engine for Ollama that does not eat all your VRAM

Wanted to share a local memory engine I built called Hillock. The main problem I had with standard local RAG was that running document parsing and vector search chewed up so much VRAM that my actual O

Cannot install gemma4:26b

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

Every time I try, I'm met with this: error message: Error: max retries exceeded: Get 'https://dd20bb891979d25aebc8bec07b2b3bbc.r2.cloudflarestorage.com/ollama/docker/registry/v2/blobs/sha256/00/001e5d

local-air-ollama

7 Oct 2026

Capacity, Responsiveness and Alignment: What Makes a Latent Structure Actionable

arXiv:2610.06897v1 Announce Type: new Abstract: Localizing latent structures in the activation space of language models (LMs) is central to understanding and controlling their behavior. Yet, localized

local-aiarxiv-cs-cl

CausalBind: Causal Modeling and Learning for Protein-Molecule Virtual Screening

arXiv:2610.07340v1 Announce Type: cross Abstract: Protein-molecule virtual screening is increasingly cast as a problem of representation learning in a shared embedding space. Existing methods rely on

ComfyUI-qwen_img_2_1_enhancer added ref mask support

Follow up update of this post here I added mask support to the reference strength node. You can now increase or reduce attention to a selected part of a reference instead of adjusting the whole photo.

Computationally efficient goodness-of-fit tests through kernelized Stein discrepancy

arXiv:2512.20007v3 Announce Type: replace-cross Abstract: Models with intractable normalizing constants are widely used in statistics and machine learning. Assessing the adequacy of such models poses

Do I Need the Cloud? Uncertainty-Aware Step-Level Handoff for Small Language Model Agents

arXiv:2610.07816v1 Announce Type: new Abstract: Small language models (SLMs) are attractive as local agent controllers because they reduce remote inference, latency, and deployment footprint, yet stru

DySCo: Dynamic Sharding for Collaborative Edge-Cloud LLM Inference with Depth-Synchronized Batching

arXiv:2610.08268v1 Announce Type: cross Abstract: Pervasive intelligent applications are increasingly deployed on mobile and Internet of Things (IoT) edge devices. Consequently, Large Language Models

Embedding and Rerankers models should be availabe on ckoud

I am sure people need it you know? There are plenty of embedding models on ollama, but only for local deployment. Which is a shame. I wish ollama would make embedding and rerankers available on ollama

Exact Unlearning via Quantized Sufficient Statistics

arXiv:2610.07197v1 Announce Type: new Abstract: Exact unlearning requires a deployed predictor to match one rebuilt without the information named by a deletion request. Existing general-purpose exact

FastVideo’s FastH3 now runs on a single consumer machine

https://x.com/haoailab/status/2107591980591227227 https://github.com/hao-ai-lab/FastVideo https://haoailab.com/FastVideo/cookbook/minimax-h3/ https://huggingface.co/FastVideo/FastVideo-FastH3-Trim-Com

Fed-BRDECS: Privacy-Preserving and Heterogeneity-Aware Federated Deep Embedded Clustering

arXiv:2610.07399v1 Announce Type: new Abstract: Federated deep clustering seeks to learn clustering-friendly representations from decentralized unlabeled data while preserving client privacy. However,

Foresight-over-Graph: Reasoning Beyond Local Horizons for Knowledge Base Question Answering

arXiv:2610.08388v1 Announce Type: cross Abstract: Large language models (LLMs) have demonstrated strong capabilities in question answering, yet they still frequently suffer from hallucinations on know

Foundation Model-Aided Multi-Agent Reinforcement Learning for Wireless Random Access Network Optimization

arXiv:2610.07550v1 Announce Type: cross Abstract: Random access (RA) is one of the most foundational medium access control (MAC) layer scheduling schemes for handling unpredictable data traffic from m

Foveated Compression: Selective High-Resolution Preservation for Token-Efficient VLMs

arXiv:2610.07729v1 Announce Type: new Abstract: Visual tokens are a major source of inference cost in vision-language models, yet simple image downsampling remains a surprisingly strong compression ba

From Shared Demand Patterns to Local Uncertainty: Probabilistic Load Forecasting by Mixing Compact Adaptations

arXiv:2610.08538v1 Announce Type: cross Abstract: Probabilistic load forecasting has been widely studied for power-system operation and planning, but customer- and transformer-level forecasting introd

Hybrid Cross-Modal Attention Network for Early Breast Cancer Detection in Low-Resource Clinical Settings

arXiv:2610.07243v1 Announce Type: new Abstract: Breast cancer is the leading cause of cancer-related mortality among women in Sub-Saharan Africa, where delayed diagnosis results from limited radiology

Idea/Thinking outloud: Minimax to build LoRA datasets?

Since Minimax H3 does such a good job of taking a source or two of a character and doing an animation with them while maintaining the character's integrity, it has me thinking that it could be used to

If you need any more evidence about how exciting local AI (and llamacpp) is! From the @Microsoft windows launch today with @satyanadella @sr…

On October 7, 2026, Clement Delangue noted that Microsoft’s Windows launch—highlighted by Satya Nadella and others—demonstrated the growing excitement around local AI solutions such as llamacpp. The e

local-aiclem-delangue--x

Image-text retrieval with EmbeddingGemma 2's vision tower, running in the browser on WebGPU

EmbeddingGemma 2 came out this week. It maps images and text into one 768-dim space, so you can search photos by describing them. I ported its text and vision towers to ruNNtime, a WebGPU inference li

local-air-localllama

Inference-Time Projection for Physically Valid Biomolecular Diffusion Models

arXiv:2610.07037v1 Announce Type: new Abstract: AlphaFold 3-style cofolding models predict biomolecular complexes with high structural accuracy, yet a large fraction of their outputs are physically in

Learning consistent molecular mechanics force fields from first principles

arXiv:2610.08020v1 Announce Type: cross Abstract: Classical force fields (FFs) remain the workhorse for large-scale simulations even as machine-learned interatomic potentials (MLIPs) approach ab initi

LFHE: Local-First Heuristic Evolution for Bounded Local Topology Search in Decentralized Learning with Non-IID Data

arXiv:2610.08176v1 Announce Type: new Abstract: Decentralized learning is highly sensitive to communication topology under non-IID data. Adaptive peer-selection methods can exploit local model informa

Localize Any Object in X-Ray Security Scans without Human Annotation

arXiv:2610.07326v1 Announce Type: new Abstract: Universal object localization in X-ray security inspection is critical for automated threat detection in safety-critical venues. However, unlike everyda

Looking for 10–20 people for a coordinated LLM test

Thursday, October 8 — 15:00–19:00 UTC Access is free and the API is OpenAI-compatible. During those 4 hours, everyone will be asked to use it actively at the same time—coding, chatting, agents, long c

Looking for the best affordable AI video-generation models with fewer restrictions.

Hi everyone, I’m exploring AI filmmaking and looking for good AI video-generation models that are either free, open-source/open-weight, or affordable. I’m particularly interested in models who allow u

MacJEPA: Missingness-Robust Audio-Visual Recognition from Untrimmed Egocentric Videos

arXiv:2610.08192v1 Announce Type: new Abstract: Audio-visual models improve egocentric action recognition by exploiting complementary cues, yet typically assume that both streams remain available at i

Memory-Efficient Expert Routing for Distributed MoE Training

arXiv:2610.07333v1 Announce Type: cross Abstract: As Mixture-of-Experts (MoE) models scale toward hundreds of experts and higher top-k routing, memory efficiency in distributed training becomes a crit

Microsoft opens preorders for the $5,999 Surface RTX Spark Dev Box, with 128GB of unified memory to run local models with 120B+ parameters, shipping in November (Stevie Bonifield/The Verge)

Stevie Bonifield / The Verge: Microsoft opens preorders for the $5,999 Surface RTX Spark Dev Box, with 128GB of unified memory to run local models with 120B+ parameters, shipping in November — Microso

local-aitechmeme

Neural Fields Encode Adaptation Geometry

arXiv:2610.07253v1 Announce Type: new Abstract: Neural fields are usually evaluated by how well they reconstruct an observation. We show that this misses two useful properties of a fitted network: how

Neural Global Optimization via Iterative Refinement from Noisy Samples

arXiv:2604.03614v3 Announce Type: replace-cross Abstract: Global optimization of black-box functions from noisy samples is a fundamental challenge in machine learning and scientific computing. Traditi

omni-d1 600M by Liquid AI running in the browser using WebGPU

Liquid just dropped d1-omni-600M and it's a decision model! I ported it to runntime, the WebGPU inference library I'm currently working on. It's plain TypeScript on top of TypeGPU with no WASM and vir

local-air-localllama

OpenWAM: An Open Framework for Composable World-Action Models

arXiv:2610.07922v1 Announce Type: cross Abstract: World-action models (WAMs) couple future prediction with robot control, yet existing systems often vary the video backbone, interaction structure, sup

PC making weird noises when using AIs locally

I recently installed ollama on my machine to test using AI locally, I don't know if you will be able to hear it on the video but every time my terminal outputs a response there is this weird writing/s

PHBA: Prefix-State Hybrid Block Attention

arXiv:2610.08527v1 Announce Type: new Abstract: Hybrid architectures combining linear sequence models with softmax attention provide an effective balance between efficient long-context modeling and pr

ProactiveVLA: Augmenting Embodied Memory through Proactive Environment Exploration

arXiv:2610.06999v1 Announce Type: new Abstract: Rapid adaptation to a new environment requires a robot to acquire useful knowledge about local objects, states, and interactions from limited experience

local-aiarxiv-cs-ro

RELACE: retrospective likelihood-based action credit estimation for long-horizon language agents

arXiv:2610.07349v1 Announce Type: cross Abstract: Group Relative Policy Optimization (GRPO) avoids a separate critic by estimating advantages from rollout groups. For multi-turn agents, however, traje

RIWANav: Recursive World-Action Models with Self-Improvement for Urban Navigation

arXiv:2610.08640v1 Announce Type: new Abstract: Long-horizon urban navigation requires sequential local decisions whose errors can compound over time. Imitation learning (IL) rarely learns from failur

local-aiarxiv-cs-ro

Ruach Studio: a whole song studio around YuE2 on your own GPU. Score first, LoRA training, stems,remaster, DAW export.

We spent the last weeks building a studio around YuE2, the open song model by m-a-p, and today it reaches its first release candidate. Write the style and the lyrics, and it composes, sings and render

local-air-localllama

SAGE: Semantic Anchor-Guided Evolution for Grounded Medical QA Data Synthesis

arXiv:2610.08093v1 Announce Type: cross Abstract: Developing reliable models for clinical tasks, such as Medical Question Answering (QA), is severely constrained by the limited availability of high-qu

Selective Critique for Cost-Aware LLM Agents in Long-Horizon Decision Making

arXiv:2610.07335v1 Announce Type: cross Abstract: Improving the reliability of large language model (LLM) agents in long-horizon decision-making remains a key challenge. When deployed as autonomous ag

Sim-to-Real Transfer of Vision-Language Navigation in Continuous Environments Using an Ackermann-Steered Mobile Robot

arXiv:2610.07192v1 Announce Type: new Abstract: Vision-Language Navigation (VLN) enables robots to navigate through environments using natural language instructions, making human-robot interaction int

Small uncensored model for everyday questions on a CPU-only laptop?

Hey everyone, I'm looking for a small uncensored model to run locally with Ollama. Nothing fancy. I just want something I can ask everyday questions without it refusing or lecturing me every other mes

StairVLA: Stage-Aware Hierarchical Action Generation for Vision-Language-Action Models

arXiv:2610.07756v1 Announce Type: new Abstract: Vision-language-action (VLA) models increasingly rely on diffusion- or flow-matching-based action heads to generate continuous robot actions. These acti

local-aiarxiv-cs-ro

Stepped MoE: Segment-Level Routing with Configurable Inference Complexity

arXiv:2610.07348v1 Announce Type: cross Abstract: Training large language models (LLMs) is resource-intensive, and adapting them for diverse deployment scenarios with varying computational constraints

Textual Environmental Context and Spatial Graphs for LLM-Based Regional SST Forecasting

arXiv:2610.07895v1 Announce Type: new Abstract: Sea surface temperature (SST) forecasting depends on local temporal persistence, regional spatial dependence, and environmental conditions that evolve w

ThinkFuse: Trajectory-Aware Test-Time Fusion for Small Reasoning Models

arXiv:2610.07803v1 Announce Type: new Abstract: Small reasoning models (SRMs) have shown strong performance on complex reasoning tasks by generating extended chain-of-thought trajectories, but they of

Three AI agents research a 4-day week and build the deck | Row-Bot + GPT 6.1 Sol

One prompt to Row-Bot 5.0 on GPT 6.1 Sol, through my ChatGPT plan (no API key): 'Split the research across three helper agents working in parallel, cite sources, save the findings, then build a 6-slid