local ai

I built Slopus, a free, open-source desktop app for generating and editing AI videos locally (Minimax H3)

local-air-stablediffusion

Slopus is a desktop app for making AI videos on your own GPU, from the first prompt to the exported file. What it does: Generate scenes shot by shot. You lay out scenes on a board, write each shot, an

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

Navigating Cost Efficient Hardware in these Volatile Times

DGX agent

Where to even begin on this one...I guess I should start by acknowledging the risk vs reward for vendors other than nvidia, so: Yes I understand that nvidia are dominant currently on speed (llm and im

local-air-localllama

27 Sept 2026

One .char model, Consistent face, body & cloths: Minimax H3

local-air-stablediffusion

Hey Guys, Based on my last post on stills, I thought to experiment the same .char model with Minimax H3. I created a character model sia.char which encodes references, prompts around face, body & clot

Prevent CUDA OOM in PyTorch with dynamic lane switching

I built MEM v3 to solve a frustrating problem in PyTorch: CUDA Out-of-Memory crashes during long training and fine-tuning runs. Instead of restarting when memory spikes or keeping batch sizes overly s

Qwen3.8-27B FP8 dual GPUs

Hardware RTX 5090 (32 GB) + RTX 4070 Ti Super (16 GB) = 48 GB VRAM 32 GB DDR5 6200 RAM Arch Linux, KDE on the 5090 (takes ~1-1.5 GB VRAM) daily driver OrcaRouter Qwen3.8-27B Uncensored, block-FP8 (28.

... so, yeah.

Finally got 3.8-Flash-Next running on my M4Pro 48GB Mac with https://huggingface.co/ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-GGUF Dense 3.8-27B is just faster... and maybe better due to quantization lev

SupersonicLabs/Julia-1 · Hugging Face

New open source Jev like model for running on local devices from a group called Supersonic Labs. It's a 144M param local non-generative local classifier. From their site: Julia 1 opens our research in

What do people do with their upscaled images?

local-air-stablediffusion

I see nearly everyone talks about upscaling their image and video gens to 4K, 8K and perhaps beyond. Now nearly every WF comes with an upscale portion tied to it either after decode or even from the l

Which of the 16gb VRAM qwen3.8 27b’s is the best?

I’m having a hard time finding out which one gives you fastest speed, maximum context with best possible quality. I can run unsloth qwen3.8 27b iq4_xs with 65k q8 kv, context without MTP and vision of

At what point do LLMs start bootstrapping themselves and generating the next LLM

I suppose technically if that happens it will signal the true start of a singularity because from that point on progress will be exponential and not dependant on humans. right now you still need huge

DistribAI v2

DistribAI is a platform for distributed training! You can train massive or tiny models across tiny or massive amounts of consumer devices with ease! DistribAI is a platform I've been working on for a

Improved and fixed template for GPT-OSS (again). Includes preserve_thinking and fix for Unsloth-induced bug

I posted an updated GPT-OSS template a couple of months ago, which was based on Unsloth's version. It turns out that both Unsloth's version (and, thus, mine) contain a very serious bug that can degrad

My Reading Library: Evaluating LLMs on Android Tasks

Can LLM agents actually get through a day in the life of a normal user? That question got me reading papers on Android agents and mobile benchmarks over the past few months. A few patterns kept showin

Qwen3.8-27B IQ3_XXS vs Qwen3.6-35B-A3B Q4_K_M

Which one is better for difficult tasks like web scrapping, coding, using tools? Looking for any benchmarks because i couldn't actually find one after quite some digging submitted by /u/Loose_Doubt367

A Field-Deployable GNSS-based Navigation Stack for Outdoor Mobile Robots

arXiv:2609.28933v1 Announce Type: new Abstract: Outdoor robots require more than an accurate receiver and a path-tracking law: the navigation system must preserve geometric consistency from geographic

local-aiarxiv-cs-ro

A Rapid Pipeline for Training and Deploying ML Models on WeBe Band

arXiv:2609.29084v1 Announce Type: new Abstract: Developing optimized machine-learning algorithms for edge devices with limited computational and memory resources is challenging, time-consuming, and hi

A Simple Gripper Interface for Simulator-Agnostic Cloth Manipulation

arXiv:2609.29340v1 Announce Type: new Abstract: This paper presents a grasping model for cloth manipulation specifically tailored to ease the deployment of robotic control methods. The model is robust

local-aiarxiv-cs-ro

Accidental discovery? or known method i'm missig? - Q's on compiling in sparse engrams and ideas swimming in my head

I set out to test portable Engrams and accidentally ended up testing compiled external memory instead. Am I onto something useful or reinventing a known idea? I've been building a small open research

ADATEX4D: adaptive texture capacity allocation for 4D gaussian splatting

arXiv:2609.29963v1 Announce Type: cross Abstract: Textured Gaussians improve local appearance capacity, but assigning the same texture resolution to every primitive wastes storage on low-detail or wea

AlphaDiverse: Post-Training Local Quantitative Research Agents for Diverse Exploration in Alpha Factor Mining

arXiv:2609.29014v1 Announce Type: new Abstract: Large language model (LLM)-based multi-agent systems can automate alpha factor mining, but their reliance on external APIs limits control over cost, ava

Canopy: Exploiting Piecewise Smooth Tree Priors for Multi-Fidelity Bandits

arXiv:2609.30017v1 Announce Type: cross Abstract: Many LLM inference problems, including model routing, prefix-cache management, prompt trimming, and test-time search, can be viewed as optimization ov

Chinese local governments are offering subsidies like computing vouchers, rent waivers, and dedicated funding to lure AI filmmakers as part of China's AI push (Reuters)

Reuters: Chinese local governments are offering subsidies like computing vouchers, rent waivers, and dedicated funding to lure AI filmmakers as part of China's AI push — When Zhu Zhili was looking for

local-aitechmeme

CoSWA-YOLOv12: Scale-Invariant Tiny Object Detection and Segmentation of Malaria Parasites

arXiv:2609.29527v1 Announce Type: cross Abstract: Automated microscopy could widen access to malaria diagnosis in low-resource settings, but the deadliest species, P. falciparum, presents in its early

Cross-Modal Emotion Understanding: A Transformer-GAT Approach for Dialogue Emotion Recognition

arXiv:2609.29556v1 Announce Type: new Abstract: Multimodal emotion recognition is a key research area in affective computing, with applications in sentiment analysis, intelligent customer service, and

Cross-Task Generalization in Handwriting-Based Alzheimer's Screening via Vision Language Adaptation

arXiv:2511.05841v2 Announce Type: replace-cross Abstract: Alzheimer's disease (AD) is a prevalent neurodegenerative disorder for which early detection is critical. Handwriting, which can be disrupted

Does per-frame early exit pay? A compute-matched study of dynamic depth for on-device speech enhancement

arXiv:2609.29867v1 Announce Type: cross Abstract: Deep learning-based speech enhancement is increasingly deployed on-device in hearing aids, headsets, and earbuds. Most of these devices, however, can

Edge AI on Constrained Devices for Binary Sleep-Wake Classification in Dynamic Environments

arXiv:2609.29163v1 Announce Type: new Abstract: This paper presents an Edge AI-based system for detecting sleep and wake states in non-stationary mobile environments using resource-constrained embedde

Efficient Continuous DEM Reconstruction under Limited Target-Resolution Supervision

arXiv:2609.29864v1 Announce Type: new Abstract: High-resolution digital elevation models (DEMs) support Earth observation applications, but paired training references are often available only at coars

FMCW-LIO: A Doppler LiDAR-Inertial Odometry

arXiv:2609.29374v1 Announce Type: cross Abstract: Conventional LiDAR-inertial odometry (LIO) or simultaneous localization and mapping (SLAM) methods heavily rely on geometric features of environments,

FounRef: Robust, Structure-Preserving, and Fast Metric Refinement of Frozen Monocular Foundation Priors with Sparse Anchors

arXiv:2609.29224v1 Announce Type: new Abstract: Dense metric depth from cameras is essential to real-world 3D applications, yet achieving accuracy, faithful surface geometry, and fast inference simult

Frame-to-Panorama Localization and Context-Aware Sampling for Scene-Specific Ship Detection in a Smart Marina Testbed

arXiv:2609.29447v1 Announce Type: cross Abstract: Smart maritime infrastructures provide continuous access to heterogeneous sensing streams, enabling repeated experimentation, digital-twin development

GeoDose-CP: Graph-Local Conformal Inference for Continuous-Treatment Earth Observation

arXiv:2609.28895v1 Announce Type: cross Abstract: Reliable intervention-oriented uncertainty quantification from Earth observation (EO) remains challenging when continuous treatment shifts, spatial de

GLM 5.3 Flash just stops during long reasoning (ollama cloud old max plan)

This keeps happening and has been happening for over a month now. Since ollama has zero support I'm hoping someone else has figured out a work around for the issue. I'm using the latest version of ope

How do you use subagents & multiple agent with local models, and how many?

Running qwen3.8 27b nvfp4 on vllm at max context only gives around 8 agents with 32k context each. That doesnt seem like much; what use cases do people use multi-agent frameworks and find it helpful f

I benchmarked tool-call reliability on qwen2.5-coder against pi, Hermes, and Goose - all three got 0%

A while back I posted here about a CLI agent I'm building that parses tool calls out of a model's plain-text output instead of trusting native function-calling to work. Finally ran the actual numbers.

I’m turning my Mac Mini M4 into an always-on home server — what should I run on it?

I recently started using my Mac Mini M4 as an always-on home server. It stays powered on most of the time, and right now I’m running my Discord bot on it. I’m thinking of gradually turning it into my

Image Fidelity is Not Field Fidelity: Joint Thermodynamic Reconstruction and Error Localization in Neural Tomography

arXiv:2609.28868v1 Announce Type: new Abstract: Neural fields for scientific tomography are optimized from 2D images, but the actual quantity of interest is often a latent 3D physical field. Because t

Jev-Mobile: Jev as an Executor for Mobile GUI Agents

arXiv:2609.30186v1 Announce Type: new Abstract: Vision-language models (VLMs) have become a common foundation for autonomous mobile GUI agents, but most existing systems rely on the VLM for both plann

Kev 4B topped out in every Tetris game I ran. Mica v0.1 4B cleared about 4x more lines and survived two of them to the end

I had Mica (my 4B decision model) and Kev 4B play the same Tetris games, same seed and same piece order, one RTX 3090. For context, this is a side project. Training and all the experiments ran on rent

Leakage-Safe Machine Learning for Hydrogen Embrittlement Detection in 316L Stainless Steel: A Region-Held-Out Evaluation of Texture and Deep Features in SEM Micrographs

arXiv:2609.28567v1 Announce Type: new Abstract: Scanning electron microscopy (SEM) is routinely used to characterize the microstructural changes caused by hydrogen embrittlement (HE) in structural ste

Lightweight Vision Transformer-Based U-Net for Brain Tumor Segmentation from MRI

arXiv:2609.29785v1 Announce Type: new Abstract: Accurate brain tumor segmentation from Magnetic Resonance Imaging is essential for diagnosis, treatment planning, and surgical guidance. Although Convol

M5 Ultra 80Core GLM-5.3-Flash on DwarfStar Speeds

I've been playing around with various models on the M5 Ultra 256GB 80-core Mac Studio. These are the results over many rounds of agentic inferencing. I'm happy with the performance. Glad to have the l

Meet Observer, an agent that uses local LLMs to monitor your screen, so you don't have to

Hey r/ollama ! I'm Roy, solo dev of Observer. Observer is a free open-source agent that uses small local LLMs to monitor your screen, so you don't have to. This is the demo of the agent that controls

MeshHeal: Two-Timescale Self-Healing for Gray Failures in Decentralized LLM Agent Networks

arXiv:2609.29015v1 Announce Type: new Abstract: Decentralized LLM-based multi-agent systems coordinate through local interactions, but an agent can remain responsive while its task-solving quality per

MEVL-STP: Multi-Encoder and Vision Language Model for Arbitrarily Shaped Scene Text Spotting

arXiv:2609.28857v1 Announce Type: new Abstract: Scene text spotting remains challenging for arbitrarily shaped text instances such as curved signs and dense multi-oriented characters in natural images

MILO: Efficient Many-shot In-Context Learning with Block-wise Low-rank Compression

arXiv:2609.29913v1 Announce Type: new Abstract: Many-shot in-context learning (ICL) enables large language models (LLMs) to adapt to complex tasks by conditioning on thousands of demonstration example

local-aiarxiv-cs-cl

Minimally Invasive Steering of Language Models

arXiv:2609.30218v1 Announce Type: cross Abstract: Pre-logit steering adapts a frozen language model to a test-time reward by adding vectors to its final hidden states. Unregularized reward optimizatio

Operator Packages, Proposer Strength, and Construction-Family Plateaus in Office-Scale Verified Search

arXiv:2609.29636v1 Announce Type: cross Abstract: Verified search, in which a language model proposes programs, a hard evaluator scores them, and selection keeps the best, has recently moved mathemati