Search: “local-ai”

Which of the 16gb VRAM qwen3.8 27b’s is the best?

I’m having a hard time finding out which one gives you fastest speed, maximum context with best possible quality. I can run unsloth qwen3.8 27b iq4_xs with 65k q8 kv, context without MTP and vision of

27 Sept 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

At what point do LLMs start bootstrapping themselves and generating the next LLM

DGX agent

I suppose technically if that happens it will signal the true start of a singularity because from that point on progress will be exponential and not dependant on humans. right now you still need huge

local-air-localllama

26 Sept 2026

DistribAI v2

DistribAI is a platform for distributed training! You can train massive or tiny models across tiny or massive amounts of consumer devices with ease! DistribAI is a platform I've been working on for a

Improved and fixed template for GPT-OSS (again). Includes preserve_thinking and fix for Unsloth-induced bug

I posted an updated GPT-OSS template a couple of months ago, which was based on Unsloth's version. It turns out that both Unsloth's version (and, thus, mine) contain a very serious bug that can degrad

My Reading Library: Evaluating LLMs on Android Tasks

Can LLM agents actually get through a day in the life of a normal user? That question got me reading papers on Android agents and mobile benchmarks over the past few months. A few patterns kept showin

Qwen3.8-27B IQ3_XXS vs Qwen3.6-35B-A3B Q4_K_M

Which one is better for difficult tasks like web scrapping, coding, using tools? Looking for any benchmarks because i couldn't actually find one after quite some digging submitted by /u/Loose_Doubt367

A Field-Deployable GNSS-based Navigation Stack for Outdoor Mobile Robots

arXiv:2609.28933v1 Announce Type: new Abstract: Outdoor robots require more than an accurate receiver and a path-tracking law: the navigation system must preserve geometric consistency from geographic

local-aiarxiv-cs-ro

A Rapid Pipeline for Training and Deploying ML Models on WeBe Band

arXiv:2609.29084v1 Announce Type: new Abstract: Developing optimized machine-learning algorithms for edge devices with limited computational and memory resources is challenging, time-consuming, and hi

A Simple Gripper Interface for Simulator-Agnostic Cloth Manipulation

arXiv:2609.29340v1 Announce Type: new Abstract: This paper presents a grasping model for cloth manipulation specifically tailored to ease the deployment of robotic control methods. The model is robust

local-aiarxiv-cs-ro

Accidental discovery? or known method i'm missig? - Q's on compiling in sparse engrams and ideas swimming in my head

I set out to test portable Engrams and accidentally ended up testing compiled external memory instead. Am I onto something useful or reinventing a known idea? I've been building a small open research

ADATEX4D: adaptive texture capacity allocation for 4D gaussian splatting

arXiv:2609.29963v1 Announce Type: cross Abstract: Textured Gaussians improve local appearance capacity, but assigning the same texture resolution to every primitive wastes storage on low-detail or wea

AlphaDiverse: Post-Training Local Quantitative Research Agents for Diverse Exploration in Alpha Factor Mining

arXiv:2609.29014v1 Announce Type: new Abstract: Large language model (LLM)-based multi-agent systems can automate alpha factor mining, but their reliance on external APIs limits control over cost, ava

Canopy: Exploiting Piecewise Smooth Tree Priors for Multi-Fidelity Bandits

arXiv:2609.30017v1 Announce Type: cross Abstract: Many LLM inference problems, including model routing, prefix-cache management, prompt trimming, and test-time search, can be viewed as optimization ov

Chinese local governments are offering subsidies like computing vouchers, rent waivers, and dedicated funding to lure AI filmmakers as part of China's AI push (Reuters)

Reuters: Chinese local governments are offering subsidies like computing vouchers, rent waivers, and dedicated funding to lure AI filmmakers as part of China's AI push — When Zhu Zhili was looking for

local-aitechmeme

CoSWA-YOLOv12: Scale-Invariant Tiny Object Detection and Segmentation of Malaria Parasites

arXiv:2609.29527v1 Announce Type: cross Abstract: Automated microscopy could widen access to malaria diagnosis in low-resource settings, but the deadliest species, P. falciparum, presents in its early

Cross-Modal Emotion Understanding: A Transformer-GAT Approach for Dialogue Emotion Recognition

arXiv:2609.29556v1 Announce Type: new Abstract: Multimodal emotion recognition is a key research area in affective computing, with applications in sentiment analysis, intelligent customer service, and

Cross-Task Generalization in Handwriting-Based Alzheimer's Screening via Vision Language Adaptation

arXiv:2511.05841v2 Announce Type: replace-cross Abstract: Alzheimer's disease (AD) is a prevalent neurodegenerative disorder for which early detection is critical. Handwriting, which can be disrupted

Does per-frame early exit pay? A compute-matched study of dynamic depth for on-device speech enhancement

arXiv:2609.29867v1 Announce Type: cross Abstract: Deep learning-based speech enhancement is increasingly deployed on-device in hearing aids, headsets, and earbuds. Most of these devices, however, can

Edge AI on Constrained Devices for Binary Sleep-Wake Classification in Dynamic Environments

arXiv:2609.29163v1 Announce Type: new Abstract: This paper presents an Edge AI-based system for detecting sleep and wake states in non-stationary mobile environments using resource-constrained embedde

Efficient Continuous DEM Reconstruction under Limited Target-Resolution Supervision

arXiv:2609.29864v1 Announce Type: new Abstract: High-resolution digital elevation models (DEMs) support Earth observation applications, but paired training references are often available only at coars

FMCW-LIO: A Doppler LiDAR-Inertial Odometry

arXiv:2609.29374v1 Announce Type: cross Abstract: Conventional LiDAR-inertial odometry (LIO) or simultaneous localization and mapping (SLAM) methods heavily rely on geometric features of environments,

FounRef: Robust, Structure-Preserving, and Fast Metric Refinement of Frozen Monocular Foundation Priors with Sparse Anchors

arXiv:2609.29224v1 Announce Type: new Abstract: Dense metric depth from cameras is essential to real-world 3D applications, yet achieving accuracy, faithful surface geometry, and fast inference simult

Frame-to-Panorama Localization and Context-Aware Sampling for Scene-Specific Ship Detection in a Smart Marina Testbed

arXiv:2609.29447v1 Announce Type: cross Abstract: Smart maritime infrastructures provide continuous access to heterogeneous sensing streams, enabling repeated experimentation, digital-twin development

GeoDose-CP: Graph-Local Conformal Inference for Continuous-Treatment Earth Observation

arXiv:2609.28895v1 Announce Type: cross Abstract: Reliable intervention-oriented uncertainty quantification from Earth observation (EO) remains challenging when continuous treatment shifts, spatial de

GLM 5.3 Flash just stops during long reasoning (ollama cloud old max plan)

This keeps happening and has been happening for over a month now. Since ollama has zero support I'm hoping someone else has figured out a work around for the issue. I'm using the latest version of ope

How do you use subagents & multiple agent with local models, and how many?

Running qwen3.8 27b nvfp4 on vllm at max context only gives around 8 agents with 32k context each. That doesnt seem like much; what use cases do people use multi-agent frameworks and find it helpful f

I benchmarked tool-call reliability on qwen2.5-coder against pi, Hermes, and Goose - all three got 0%

A while back I posted here about a CLI agent I'm building that parses tool calls out of a model's plain-text output instead of trusting native function-calling to work. Finally ran the actual numbers.

I’m turning my Mac Mini M4 into an always-on home server — what should I run on it?

I recently started using my Mac Mini M4 as an always-on home server. It stays powered on most of the time, and right now I’m running my Discord bot on it. I’m thinking of gradually turning it into my

Image Fidelity is Not Field Fidelity: Joint Thermodynamic Reconstruction and Error Localization in Neural Tomography

arXiv:2609.28868v1 Announce Type: new Abstract: Neural fields for scientific tomography are optimized from 2D images, but the actual quantity of interest is often a latent 3D physical field. Because t

Jev-Mobile: Jev as an Executor for Mobile GUI Agents

arXiv:2609.30186v1 Announce Type: new Abstract: Vision-language models (VLMs) have become a common foundation for autonomous mobile GUI agents, but most existing systems rely on the VLM for both plann

Kev 4B topped out in every Tetris game I ran. Mica v0.1 4B cleared about 4x more lines and survived two of them to the end

I had Mica (my 4B decision model) and Kev 4B play the same Tetris games, same seed and same piece order, one RTX 3090. For context, this is a side project. Training and all the experiments ran on rent

Leakage-Safe Machine Learning for Hydrogen Embrittlement Detection in 316L Stainless Steel: A Region-Held-Out Evaluation of Texture and Deep Features in SEM Micrographs

arXiv:2609.28567v1 Announce Type: new Abstract: Scanning electron microscopy (SEM) is routinely used to characterize the microstructural changes caused by hydrogen embrittlement (HE) in structural ste

Lightweight Vision Transformer-Based U-Net for Brain Tumor Segmentation from MRI

arXiv:2609.29785v1 Announce Type: new Abstract: Accurate brain tumor segmentation from Magnetic Resonance Imaging is essential for diagnosis, treatment planning, and surgical guidance. Although Convol

M5 Ultra 80Core GLM-5.3-Flash on DwarfStar Speeds

I've been playing around with various models on the M5 Ultra 256GB 80-core Mac Studio. These are the results over many rounds of agentic inferencing. I'm happy with the performance. Glad to have the l

Meet Observer, an agent that uses local LLMs to monitor your screen, so you don't have to

Hey r/ollama ! I'm Roy, solo dev of Observer. Observer is a free open-source agent that uses small local LLMs to monitor your screen, so you don't have to. This is the demo of the agent that controls

MeshHeal: Two-Timescale Self-Healing for Gray Failures in Decentralized LLM Agent Networks

arXiv:2609.29015v1 Announce Type: new Abstract: Decentralized LLM-based multi-agent systems coordinate through local interactions, but an agent can remain responsive while its task-solving quality per

MEVL-STP: Multi-Encoder and Vision Language Model for Arbitrarily Shaped Scene Text Spotting

arXiv:2609.28857v1 Announce Type: new Abstract: Scene text spotting remains challenging for arbitrarily shaped text instances such as curved signs and dense multi-oriented characters in natural images

MILO: Efficient Many-shot In-Context Learning with Block-wise Low-rank Compression

arXiv:2609.29913v1 Announce Type: new Abstract: Many-shot in-context learning (ICL) enables large language models (LLMs) to adapt to complex tasks by conditioning on thousands of demonstration example

local-aiarxiv-cs-cl

Minimally Invasive Steering of Language Models

arXiv:2609.30218v1 Announce Type: cross Abstract: Pre-logit steering adapts a frozen language model to a test-time reward by adding vectors to its final hidden states. Unregularized reward optimizatio

Operator Packages, Proposer Strength, and Construction-Family Plateaus in Office-Scale Verified Search

arXiv:2609.29636v1 Announce Type: cross Abstract: Verified search, in which a language model proposes programs, a hard evaluator scores them, and selection keeps the best, has recently moved mathemati

out of these two options what will give the best performance?

I am new to this and a week or so ago I setup a local ai box, it is an amd 9950x with 64gb ddr5 6000 ram, 2 rtx 5090s (on motherboard that does pcie gen 5 x8 per card). It is working fine but I have b

Outcome-Sensitive Motion Search for Impact-Aware Dexterous Catching

arXiv:2609.29020v1 Announce Type: new Abstract: Skilled humans can catch fast-moving objects softly by coordinating interception, velocity matching, and follow-through to mitigate impact. Learning suc

local-aiarxiv-cs-ro

Paging the Experts: A Reproducible Characterization of Flash-Backed MoE Inference on iPhone

arXiv:2609.29032v1 Announce Type: cross Abstract: Sparse activation reduces mixture-of-experts computation without eliminating the need to store all experts. We present Routide, a Swift/MLX runtime th

PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides

arXiv:2609.29718v1 Announce Type: cross Abstract: Coding agents are beginning to act in the visual world. They now build webpages, GUIs, games, 3D scenes, diagrams, and documents. Success in such visu

PSA for M5Ultra owners running LLMs: set your prefill step to 8192

Prefill step size affects both PP performance and your drafter fetching logits for MTP (affects dflash as well, mlx-vlm needs to be patched slightly to support chunked prefill for dflash). It also nee

PTC-Bias: Phoneme-Level Temporal Competition for Bias Retrieval and Post-Decoding Correction in Speech LLMs

arXiv:2609.28727v1 Announce Type: new Abstract: Contextual biasing improves rare-word recognition in speech large language models (SpeechLLMs), but efficiently exploiting large bias lists remains chal

local-aiarxiv-cs-cl

PUBG Ally: A Conversational Embodied Agent as an AI Teammate

arXiv:2609.29837v1 Announce Type: new Abstract: We introduce PUBG Ally, an embodied agent for PUBG: BATTLEGROUNDS that can reason, act autonomously, and play alongside players as a voice-enabled teamm

Representation World Model: Learning States, Transition and Executable Plans in Representation

arXiv:2609.29171v1 Announce Type: cross Abstract: We propose the Representation World Model (RWM), which learns states, transitions, and executable plans directly in representation space. Unlike exist