Search: “local-ai”

Micro-Collaborative Poisoning: A Distributed Attack on RAG Systems

arXiv:2609.21573v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) improves large language models by grounding outputs in external knowledge sources, but this dependency also creat

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Newer updates from the last post: Use Local LLM within VScode agent chat

DGX agent

github repo: https://github.com/athulg93/vscode-localllm Alright, So i have made some major updates to this extension Update the git flow: Found out that there were some issues and the / part was a me

local-air-ollama

21 Sept 2026

ollama cloud legacy pro plan VS new pro plan

i have been using ollama cloud on old pro plan for monthes and this month i want to cancel my sub for personal reasons that i will not use ai for a month maybe. wondering if canceling plan and the upg

P^3-SAM: SAM with Perceptual Parallel Prompt for Few-Shot Strip Steel Surface Defect Segmentation

arXiv:2609.21424v1 Announce Type: new Abstract: Few-shot semantic segmentation (FSS) of strip steel surface defects (S^3D) has posed significant challenges distinct from natural scenes. Unlike natural

PSEE: Progressive Sensor Event Expansion for Point-Supervised Temporal Action Localization

arXiv:2609.21462v1 Announce Type: new Abstract: Temporal action localization (TAL) in wearable sensor streams identifies action classes and temporal boundaries, enabling finer-grained activity underst

Quantization-Aware Kalman Estimation for Diffusion Sampling

arXiv:2609.21407v1 Announce Type: new Abstract: Quantization offers a practical path to deploying diffusion models with reduced memory and computation, but aggressive compression can cause quantized o

Refining Ground Truth Poses in Autonomous Driving Datasets via Neural Rendering

arXiv:2504.15776v2 Announce Type: replace Abstract: Public autonomous driving datasets underpin the training and benchmarking of perception, mapping, and localization algorithms, yet residual inaccura

Riemannian Neural Hamiltonian Flows: Geodesic Symplectic Transport and Interpretability

arXiv:2609.21647v1 Announce Type: new Abstract: Hamiltonian normalizing flows are attractive generative models because their phase-space maps are invertible and volume preserving, but most neural cons

Riemannian Simultaneous Inference for Tangent Vector Field Regression

arXiv:2609.21910v1 Announce Type: cross Abstract: We consider nonparametric tangent vector field regression on a Riemannian manifold without boundary. Because responses at different points lie in diff

Samsone: A Family of Open Small Audio Language Models for On-Device Inference

arXiv:2609.21666v1 Announce Type: cross Abstract: The success of Large Audio Language Models has driven the development of massive multimodal networks exceeding billions of parameters. However, the de

SP-MoMamba: Superpixel-driven Mixture of State Space Experts for Efficient Image Super-Resolution

arXiv:2605.25892v2 Announce Type: replace Abstract: State space models (SSMs) have emerged as an efficient paradigm for single-image super-resolution (SR) due to their linear complexity and long-range

SpecQuant: Speculative Decoding with Multi-Parent Quantization for Adaptive LLM Inference

arXiv:2609.21704v1 Announce Type: new Abstract: Running large language models (LLMs) locally continues to be limited by restrictions of compute and memory on consumer hardware. The popular acceleratio

TERMon: Detecting Persistent Behavioral Threats in Edge AI via Hardware-Native Ternary Runtime Monitor

arXiv:2609.21713v1 Announce Type: cross Abstract: Edge AI accelerators are increasingly deployed in safety-critical environments, where model outputs may control physical actuators, make access-contro

The EventCV Library for Event-Based Robotic Vision

arXiv:2609.21330v1 Announce Type: new Abstract: Event cameras detect per-pixel brightness changes asynchronously on microsecond timescales, with high dynamic range and low power draw. These are desira

local-aiarxiv-cs-ro

The Weight Is Over - Interactive Diffusion on Consumer GPUs

arXiv:2609.21849v1 Announce Type: cross Abstract: On-device inference is booming, but the momentum is almost all in language models. Diffusion pipelines are memory hungry, latency-sensitive, and requi

TierKV: Long-Context On-Device LLMs via Predictive Multi-Tier KV Caching

arXiv:2609.21172v1 Announce Type: new Abstract: Large language models (LLMs) are moving onto mobile devices for increasingly diverse workloads over text, images, video, and audio. These applications o

Touvigation: Embodied Adaptive Object Acquisition for Blind and Low-Vision Users in Unfamiliar Indoor Environments

arXiv:2609.21828v1 Announce Type: cross Abstract: Blind and low-vision users often face challenges when locating and physically acquiring objects in unfamiliar indoor environments. Existing vision-lan

Traffic Sign Recognition for Autonomous Driving Using Branched YOLOv2 and Geometric Features

arXiv:2609.22060v1 Announce Type: new Abstract: Traffic sign recognition (TSR) is an important perception task for autonomous driving and advanced driver-assistance systems, where a system must both l

Transferable knowledge graphs with executable learned operators for algorithm design

arXiv:2603.27922v2 Announce Type: replace Abstract: Procedural knowledge in algorithm design is embedded in source code and rebuilt for each new domain. We introduce Generative Executable Algorithm Kn

Transformers Discover Molecular Structure Without Graph Priors

arXiv:2510.02259v2 Announce Type: replace Abstract: Computational simulations play a central role in scientific discovery, and machine learning (ML) has emerged as a promising alternative to tradition

Transsion's Speaker-Attributed Multilingual ASR System for the MLC-SLM 2026 Challenge

arXiv:2609.20833v1 Announce Type: new Abstract: This paper presents the Transsion Speech Team submission to Task 1 of the MLC-SLM 2026 Challenge, which focuses on speaker-attributed transcription for

local-aiarxiv-cs-cl

Uncensor an LLM without touching weights: inject a tiny trained KV-cache bank (~18MB) and unload it anytime

I shipped something I've been building for the last few weeks : phantom-kv , a refusal-removal system for large language models that doesn't touch a single weight. Instead of editing the model, it loa

World Modeling in Transformers

arXiv:2609.21748v1 Announce Type: new Abstract: Behavioral failures can make a transformer appear to lack a world model even when it has learned faithful representations of its environment. We demonst

Automating EDD (eval-driven development) with Coding Harness Agents

You can now automate EDD (eval-driven development) with Coding Harness Agents > build a baseline LLM-based application > score every change with judge evals > keep what improves, reject what regresses

DEV-TV

TV for the developer internet GitHub, Hacker News, dev.to, Hugging Face, and release notes, presented as channels you tune into, each auto-cycling its own stories, instead of five tabs to remember to

Do NOT trust StepFun's Plan subscriptions., They stole >$100 from me with no warning, and I have not heard back from support at all.

I know cloud subscription plans are not exactly the core focus of r/LocalLLaMA, so I want to be clear about why I’m posting this here. I’ve been building my own local text-based RPG/game harness and u

Does Ollama Still Have Support Staff?

I have opened two tickets, one around a suspected problem and one around one I verified and then sent exact diagnostics over. The initial response was sent to their AI support, which just tried to tel

I gave Jev, Laya, finetuned ModernCE and Qwen3.5 the controls to Doom

I gave Jev, Laya, a finetuned ModernCE-base-nli and a finetuned Qwen3.5-4B the controls to Doom. Thanks to TypeSafe AI for Jev access. The video lines up the starts of four separate games with the sam

I made a service for hosting multiple audio diffusion models on a single GPU

local-air-stablediffusion

Hi Stable Diffusion People! I recently got into local audio generation but I didn't want to use ComfyUI for it (although I absolutely love it for image generation!) but I started to run out of room on

laya.cpp: Optimized laya near-instant decision making

After seeing u/Nandakishor_ml’s post introducing Laya, I wanted to see how fast it could run in a standalone C++ implementation. Credit to u/Nandakishor_ml for the architecture, training and open-sour

RTX 5090 random black screen + 100% fans + hard lock; sometimes no POST until AC power is removed — gaming, ComfyUI and Ollama

RTX 5090 random black screen + 100% fans + hard lock; sometimes no POST until AC power is removed — gaming, ComfyUI and Ollama I am looking for help diagnosing a very intermittent but increasingly fre

Seeing how differently people prompt LLMs is funny

So my brother and I both use LLMs for coding. I've started using a local GLM 5.3 Flash instance - q4 qat. My brother uses GPT-6-Astra as his daily driver. He has mentioned repeatedly to me that his ap

What is JEV and what is it used for?

I am seeing this JEV everywhere since yesterday in Localllama and it is passing past my head on what it is? So like what is it? Some new LLM? Or is it something else? submitted by /u/Hot_Example_4456

Does Ollama Cloud report cached tokens now?

Since Ollama Cloud switched their plans to token-based pricing, did they start reporting cache read tokens, or their claim about 'transparency' was just PR? I was thinking about getting a subscription

General warning about Clore.AI

Hello, I know some of us may be tempted to rent out our expensive GPUs to recoup some of the cost of self-hosting, and it should be obvious that this can be a risky decision. I decided to try hosting

i built an all in one app around ollama because my own setup was getting ridiculous

full disclosure, i am the developer of locally uncensored :) i use ollama myself and honestly ollama was never really the problem. the problem was everything around it. one app for local chat, another

Massive token savings... Without token usage. GLM-5.2-cloud

Okay, this one seems probably really odd (or maybe not), but most harnesses operate within token spaces. That is, every tool output, even batching of tool outputs, go back up into inference calls. Lea

Modello senza limiti

Da un po mi sono ritrovato in garage un hp z840 da 64gb ddr5 montate (ora) e 2 processori con una gpu un po scarsina una nvidia quadro k680 (da aggiornare) avrei bisogno di un consiglio: quale modello

NYX AI, a local-first AI workspace for Windows with AppContainer integration

I’m one of the co-founders of NYX AI. It’s a Windows app that connects to local models through Ollama/lm studio or supported cloud providers, giving AI tools to work with documents, previews, spreadsh

Ollama pricing vs Openrouter

The math don’t math. I’m paying way more on ollama for glm5.3 flash games Han I am on Openrouter. I made 153 requests for 47cents on Openrouter. On ollama it was 147 requests for $1.67. Math dont math

Qwen3.8-27B, up to 144 tok/sec on M5 Max. Let that sink in. ⚡️✨🚀 Excited to partner with @inco_ai to bring you their Splash inference engin…

Qwen3.8-27B, up to 144 tok/sec on M5 Max. Let that sink in. ⚡️✨🚀 Excited to partner with @inco_ai to bring you their Splash inference engine in LM Studio on day 0! Get it running now: https://lmstudio

local-ailm-studio--x

Qwen3.8-Flash-Next at 1M context on Strix Halo: 38 tok/s decode, 18 min prefill (halogen 0.12.0)

Hi. I saw some feedback that halogen was degrading at context depth. So I fixed that. Served through the image, same machine, same session, same prompts, 0.11.10 vs 0.12.0: decode at 1,004,581 tokens

Radeon RX 10800 XT can outperform the RTX 5090 by 15-25% in 4K gaming and local AI

https://en.gamegpu.com/news/zhelezo/radeon-rx-10800-xt-mozhet-obojti-rtx-5090-na-15-25-v-igrakh-v-v-4k-i-lokalnom-ii The more competition, the better! submitted by /u/Lumpy_Phase_9539 [link] [comments

Ternary-Bonsai-2-27B-PQ2_0 is not completely lobotomized

I decided to run prism-ml/Ternary-Bonsai-2-27B-PQ2_0 through my own set of UNSCIENTIFIC benchmarks. I needed something to compare it to, so I decided I would compare with another 27B model by filesize

Von: Open-source 395M 'System One' model

Took me a while since I'm on a family trip and have limited hardware, but here it is! Von: Open-source 'System One' drop-in replacement for TypeSafe's JEV. https://github.com/wfzyx/von https://hugging

Which Ollama model will be best for coding?

I was wondering if there are any good coder models for 8GB VRAM RTX 5060. My specifications: 8GB RTX 5060 8GB DDR4 RAM 256 GB SSD I know the configuration is a bottleneck for sure. Though I don't have

A Simulation Platform for AUV Fault Recovery: Exploring LLM-Based Diagnostic Strategies

arXiv:2609.20620v1 Announce Type: cross Abstract: Autonomous underwater vehicles (AUVs) operating beyond reliable communications must recover from failures without human intervention. We investigate a

18 Sept 2026

Accelerating Visual Policy Learning with Sampling-Based Model Predictive Control

arXiv:2609.20575v1 Announce Type: cross Abstract: Learning visual policies for locomotion and manipulation requires coordinating contact with the environment and can incur substantial computation and