Search: “local-ai”

“The All Spark” Cluster: Upgrading from 16 - 36 DGX Sparks

Earlier this year I posted about building what at the time I believe was the first 16x DGX Spark Cluster. I’m now adding 20 more Sparks to the cluster in my homelab server rack, giving me 4.6TB of uni

23 Aug 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Unsloth Q1-Q2 Qwen3.8-27B with MTP since the unsloth ones don't ship with for the lowest quants

DGX agent

https://huggingface.co/jojohai/Qwen3.8-27B-MTP-graft Tested on Vulkan, the grafting saves RAM compared to using an external file. What I don't guarantee however is the quality of answers. The model is

local-air-localllama

23 Aug 2026

Cloud usage: 4-hr windows to weekly caps? (Pro $20)

Is there a good rule-of-thumb to calculate how many full 5-hour windows add up to one week's allowed usage under the $20/Pro plan? ie: you fill up six 5-hour windows, and that equals 100% usage for a

Gemax Ai New Version v1.9.15 (Offline AI Agent for Windows)

Gemax 1.9.15 — What’s new LAN server — share Gemax on your local network; open the real IP from another PC or phone Mobile-friendly UI — responsive layout for phone browsers on the same Wi‑Fi Workspac

How to give a local LLM/agent access to a 'real' web browser

I can't seem to find a good answer to this, my Hermes agent has access to Firecrawl and some other web scrapers for content extraction, but anyone know of a way to let a local LLM drive a 'real' web b

How to make sure Ollama is using my Intel Arc A580, and not the CPU?

I have a Intel Arc A580 GPU that has 8gb VRAM, but I'm not sure that I am running ollama's local ai on it. Also, any suggestions on a good model to use for general purpose AI? submitted by /u/Illustri

New 100B Liquid AI model coming soon

Liquid AI currently possesses among the fastest LLM architectures around, and some of the best SLMs (in terms of utility IMO) around, so I'm very excited to see what a potential 100B LFM (3?) model wo

Quoting Linus Torvalds

And this was a debug session from hell, enormously helped by an AI doing much of the grunt-work. I'd like to call it my tireless helper, but the AI several times stated flat out that this was impossib

local-aisimon-willison

This is a great sub, regardless of what complaints people have about it.

This is a genuine community of real generally respectful adult human beings. Despite the enthusiasm all of you have for local AI, you can recognize that there are times when local LLMs are flawed, and

What if Chain-of-Thought wasn’t lossy? Exploring reversible logic (Toffoli/Fredkin-style) for edge LLMs

Right now standard CoT is a one-way street. You generate forward, dump a pile of scratchpad tokens into the KV cache, and pray the model doesn’t hallucinate halfway through. On phones/laptops that cre

A Locally Tokenized Generative Model for Robust Time-Series Watermarking

arXiv:2608.19727v1 Announce Type: cross Abstract: Watermarking is a central tool for provenance in generative models, yet its application to multivariate time series remains hindered by reliability fa

An Agentic Approach for Active Data Collection, Travel Behavior Modeling, and Weather-Sensitive Demand Prediction

arXiv:2608.20320v1 Announce Type: new Abstract: Travel behavior research increasingly combines digital data collection with predictive modeling, yet these stages are often developed and evaluated sepa

Auditing Recorded Predictive Lead Service-Line Classifications Against Physical Verification: A Statewide Study of New York

arXiv:2608.19922v1 Announce Type: new Abstract: Under the US Lead and Copper Rule Revisions, a utility may determine a service line's material with a predictive model instead of inspecting it. New Yor

Causal Inference under Interference with Learned Exposure Mappings

arXiv:2608.19224v1 Announce Type: cross Abstract: Exposure mappings are often assumed to be known in causal spillover analyses. In environmental settings, however, they are typically induced by transp

CharTool: Tool-Integrated Visual Reasoning for Chart Understanding

arXiv:2604.02794v2 Announce Type: replace Abstract: Charts are ubiquitous in scientific and financial literature for presenting structured data. However, chart reasoning remains challenging for multim

CoToGrasp: Contact-Topology-Conditioned Dexterous Grasp Synthesis via Canonical Workspace Learning

arXiv:2608.19776v1 Announce Type: cross Abstract: Current dexterous grasp planners primarily optimize for physical stability, focusing on whether an object can be grasped rather than how it should be

DARS: Dual-Level Credit Assignment RL with Structured Reasoning for Instruction-Based Image Editing

arXiv:2608.20161v1 Announce Type: new Abstract: Instruction-based image editing uses a planner-renderer pipeline: a vision-language model (VLM) first converts the instruction into an edit plan, and a

Does PCIe matter much for inference?

Speaking of -sm tensor. I have 2x5060ti and i get some 40-50tps form 3.8 27B q6. I used HWinfo to see how saturated the PCIes are during inference are and as expected both the PCIe 5x16 slot and PCIe

Exact Algebraic Computation of Learning Coefficients for Two-Dimensional Singular Models

arXiv:2608.20183v1 Announce Type: new Abstract: Classical information criteria such as the Bayesian Information Criterion (BIC) rely on regularity assumptions that break down for singular models, lead

I'm really hoping we're in 2026's 2-month-gap between QwQ and Qwen3 right now

QwQ was genuine next-gen performance usable on local hardware, but the massive required context (it's reasoning style was akin to 'if I say every possible word, I'll notice the right one!') kinda made

MileGPO: Milestone Inference with Local Evidence for Graph-Based Policy Optimization of Long-Horizon LLM Agents

arXiv:2608.19803v1 Announce Type: cross Abstract: Credit assignment is challenging in long-horizon agentic reinforcement learning, where supervision often comes only from final rewards. Existing metho

Object-aware graph matching network for cross-domain remote sensing image localization

arXiv:2511.02489v2 Announce Type: replace Abstract: Cross-domain and cross-modal remote sensing image geo-localization remains challenging due to large appearance discrepancies and unstable semantic c

‘Open Models, Production Agents’ is underway! Tonight means another event hosted at FriendliAI's San Francisco HQ. A very lively turn out, a…

‘Open Models, Production Agents’ is underway! Tonight means another event hosted at FriendliAI's San Francisco HQ. A very lively turn out, and a stellar lineup of panelists exploring how open models a

local-aiollama--x

Open-Vocabulary 3D Object Detection with Co-Distillation Discovery and Dual Guidance Robust Training

arXiv:2608.19973v1 Announce Type: cross Abstract: Recently, open-vocabulary 3D object detection (3D-OVD) has gained increasing attention for its ability to detect unseen objects in 3D scenes. Existing

Prompt-Conditioned Channel Attention for Hierarchical Feature Modulation toward Anatomy-Agnostic Segmentation

arXiv:2608.20229v1 Announce Type: cross Abstract: Anatomically plausible segmentation remains challenging because of low contrast, ambiguous boundaries, and modality-specific artifacts. Interactive se

Represented but Ignored: A Causal Account of Prosodic Underuse in Audio-Language Models

arXiv:2608.19211v1 Announce Type: cross Abstract: Human speech is richly expressive, with prosody carrying linguistic and emotional information beyond the lexical content. A capable large audio-langua

SAGE-XGBoost: Spatially Augmented Graph Embeddings--Machine Learning Framework for Natural Hazards Susceptibility Mapping under Data Scarcity

arXiv:2608.19672v1 Announce Type: new Abstract: Natural hazard susceptibility mapping is often constrained by limited labeled data, reducing the generalizability of conventional machine learning and l

SPyCE: Skill-Policy Co-evolution for Multimodal Agents

arXiv:2607.13854v2 Announce Type: replace Abstract: Multimodal agents that think with images iteratively manipulate visual evidence and invoke tools across many steps. Existing reinforcement learning

local-aiarxiv-cs-cl

Stream4D: 4D-Consistency for Streaming Autoregressive Diffusion Video Models

arXiv:2608.19556v1 Announce Type: cross Abstract: Streaming autoregressive diffusion models enable real-time, long-horizon video generation, but their training objectives optimize local frame predicti

Welcome @ATT to open models!

The post titled “Welcome @ATT to open models!” announces AT&T’s participation in open‑source AI model initiatives. It references the Ollama platform and cites Amir Efrati’s comment on the growing tren

local-aiollama--x

Write Once, Run Everywhere: The Axon DSL for Shape-Safe and Framework-Agnostic LLM Architectures

arXiv:2608.19889v1 Announce Type: new Abstract: The entire ecosystem of open-source language models effectively relies on a single platform. What if this platform was forced to shut down tomorrow? Imp

A Real-Time Tsetlin Machine-based Non-intrusive Load Monitoring System on MCUs

arXiv:2608.18780v1 Announce Type: new Abstract: Non-Intrusive Load Monitoring (NILM) systems estimate individual appliance energy consumption from a single aggregate meter, without requiring separate

AQuA's 'self-improvement' updates research state, not the agent LM. What should a local port freeze?

AQuA's preprint uses 'recursive self-improvement' for a bounded research loop. It does not say the research-agent LM rewrites its own weights. The paper separates three objects: The language model dri

Aurora-80K releases! A modern tiny language model.

I'm introducing Aurora-80K, a small language model with exactly 80 thousand parameters. It uses a factorized 4,096-token vocabulary despite having only 80K parameters. The benchmarks: Wikitext-2 BPB:

Beyond receptive fields: sequence-pooled normalization can supply most of a sequence labeler's context

arXiv:2608.18576v1 Announce Type: new Abstract: A convolutional sequence labeler's receptive field is routinely treated as the extent of the model's usable context: it sets dilation schedules, bounds

Congrats to @ComfyUI on making Comfy MCP local and open source! Love to see more options for local AI workflows. 👏

Congrats to @ComfyUI on making Comfy MCP local and open source! Love to see more options for local AI workflows. 👏 Comfy MCP is now local and open-source! The #1 ask after Comfy Cloud MCP shipped in J

local-aicomfyui--x

Connect Open-Webui to local Ollama does not show Ollama Cloud Models

Using Open-Webui I can connect to Ollama Cloud using ollama.com and the api key. It lists the models, it works. but i want to connect open-webui to the loacl ollama installation (windows) because all

Coupled-cluster molecular properties across the main group that extrapolate beyond training size

arXiv:2608.18346v1 Announce Type: cross Abstract: Coupled-cluster theory defines the accuracy standard for molecular electronic-structure properties but scales too steeply for routine application, whe

Eureka: Task-Conditioned Meta-Agent Orchestration for Scientific Discovery

arXiv:2608.19047v1 Announce Type: new Abstract: We present Eureka, a task-conditioned Meta-Agent architecture that compiles long-horizon tasks into dynamic obligation graphs with explicit acceptance s

EVADE: Evidence-Verified Agentic Diagnosis with Escape

arXiv:2608.18833v1 Announce Type: new Abstract: Medical vision-language models (VLMs) can achieve high accuracy but remain unreliable: they are systematically overconfident, benefit little from test-t

Flama: a Python framework for development and deployment of production-ready APIs, machine learning, and LLM services

arXiv:2608.18733v1 Announce Type: cross Abstract: We present Flama, an open-source Python framework for developing and deploying production-ready web APIs, machine learning services, and large-languag

Frozen DINO Localizes Image Edits Without a Localizer

arXiv:2608.18968v1 Announce Type: new Abstract: Localized image edits can change a photograph's meaning while leaving most of it authentic, so forensic analysis must identify where an edit occurred. W

Graph-Based Approaches to Learning Epileptogenic Zone Localization Using Stereo-EEG Recordings

arXiv:2608.18887v1 Announce Type: new Abstract: The epileptogenic zone (EZ) is the brain region that generates seizures in an individual, and is the target of epilepsy surgery. Localizing the EZ from

[GUIDE] Running CUDA 12.9 on NVIDIA Pascal (GTX 10xx) with Arch Linux

Tested on: X570DD_M570DD / GTX 1050 mobile / Arch Linux x86_64 / NVIDIA 580.178.04 driver / CUDA V12.9.86 What happened: As everyone knows, NVIDIA dropped the Pascal line in the 590.xxx.xx+ and CUDA 1

H^2EDL: Hyper Evidential Deep Learning for Hierarchical Classification

arXiv:2608.18185v1 Announce Type: cross Abstract: Fine-grained recognition often involves hierarchical label spaces, where a model may be confident about a coarse semantic concept while remaining unce

home lab assistant llm

hey so im currently working to integrate a locally ran llm to control home assistant (through tool calling, no direct connection) so i can use a voice input without needing very specific commands. Its

Huge thanks to Unsloth for the great work. This is wonderful news for the community! 🥳Qwen3.8-27B, smaller and sharper than ever. Let's try…

Huge thanks to Unsloth for the great work. This is wonderful news for the community! 🥳Qwen3.8-27B, smaller and sharper than ever. Let's try it! @UnslothAI We’re releasing new Qwen3.8-27B GGUFs with 10

local-aiqwen--x

I built a free, self-hosted app that does everything around a LoRA run — dataset, triage, captions, training (local or rented GPU), then checkpoint comparison

local-air-stablediffusion

I build LoRA Dataset Studio — free, open source, self-hosted, no account and no telemetry. It is not a competitor to ai-toolkit: it orchestrates it. ai-toolkit is the trainer; this is everything befor