local ai

Cultural Alignment in Large Language Models Using Soft Prompt Tuning

arXiv:2503.16094v2 Announce Type: replace Abstract: Large Language Model (LLM) alignment is commonly achieved through supervised fine-tuning or reinforcement learning, both of which require labeled or

local-aiarxiv-cs-cl

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Detecting Hallucination in LLMs: Tracing the Topological Signatures of Impaired Context Sharing

DGX agent

arXiv:2609.21096v1 Announce Type: new Abstract: In this work, we examine the topology of information flow patterns within attention graphs to effectively distinguish hallucinated from non-hallucinated

local-aiarxiv-cs-ai

21 Sept 2026

Elastic Threshold Attention: Learned Contextual Sparsity for Long-Context Decoding

arXiv:2609.20888v1 Announce Type: new Abstract: Massive KV caches can cause severe memory-bandwidth bottlenecks during long-context decoding. Sparse attention methods mitigate this via selective loadi

Hemmingway-1: An AI that writes like a person (Qwen3.8-27B finetune)

https://preview.redd.it/d7brwofkhuqh1.png?width=1400&format=png&auto=webp&s=9a0079ebc2710faff9a73378dac58c6dd67e3cec link: https://huggingface.co/Altworld/Hemmingway-1 submitted by /u/paf1138 [link] [

I reached 1,000+ telemetry events across 38 deployments — what should I be thinking about now?

I've been building an open-source AI workflow automation platform for a while now, mostly as a solo project. I recently checked the telemetry dashboard and was honestly surprised to see 1,062 telemetr

I’m testing whether a local 9B/14B coding agent can recover from its own failed code changes — work in progress

I’m building a personal local coding-agent project called Cody, using local 9B/14B models through Ollama. This is still a work in progress. It has not passed its full graduation process yet, and the l

Just interviewed a creative legend. ↓ @ingi_erlingsson is a 20-year creative vet. He built the world-renown Golden Wolf creative agency from…

Just interviewed a creative legend. ↓ @ingi_erlingsson is a 20-year creative vet. He built the world-renown Golden Wolf creative agency from the ground up. Sold it to @doodles. Became Doodles’ Chief C

local-aicomfyui--x

Learned Parametric Emotion Editing: Real-Time Affective Filtering for On-Device Social Media Video

arXiv:2609.21624v1 Announce Type: new Abstract: Problematic internet use affects a growing share of the population, yet common interventions, e.g., time limits, blocking, forced breaks, are coercive a

MarsFM: Shading-Regularized Flow Matching for Martian Relief Estimation

arXiv:2609.21095v1 Announce Type: new Abstract: We present MarsFM, an image-conditioned latent flow-matching model for local Martian relief estimation from single-band HiRISE RED orthoimagery. The met

Micro-Collaborative Poisoning: A Distributed Attack on RAG Systems

arXiv:2609.21573v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) improves large language models by grounding outputs in external knowledge sources, but this dependency also creat

Newer updates from the last post: Use Local LLM within VScode agent chat

github repo: https://github.com/athulg93/vscode-localllm Alright, So i have made some major updates to this extension Update the git flow: Found out that there were some issues and the / part was a me

ollama cloud legacy pro plan VS new pro plan

i have been using ollama cloud on old pro plan for monthes and this month i want to cancel my sub for personal reasons that i will not use ai for a month maybe. wondering if canceling plan and the upg

P^3-SAM: SAM with Perceptual Parallel Prompt for Few-Shot Strip Steel Surface Defect Segmentation

arXiv:2609.21424v1 Announce Type: new Abstract: Few-shot semantic segmentation (FSS) of strip steel surface defects (S^3D) has posed significant challenges distinct from natural scenes. Unlike natural

PSEE: Progressive Sensor Event Expansion for Point-Supervised Temporal Action Localization

arXiv:2609.21462v1 Announce Type: new Abstract: Temporal action localization (TAL) in wearable sensor streams identifies action classes and temporal boundaries, enabling finer-grained activity underst

Quantization-Aware Kalman Estimation for Diffusion Sampling

arXiv:2609.21407v1 Announce Type: new Abstract: Quantization offers a practical path to deploying diffusion models with reduced memory and computation, but aggressive compression can cause quantized o

Refining Ground Truth Poses in Autonomous Driving Datasets via Neural Rendering

arXiv:2504.15776v2 Announce Type: replace Abstract: Public autonomous driving datasets underpin the training and benchmarking of perception, mapping, and localization algorithms, yet residual inaccura

Riemannian Neural Hamiltonian Flows: Geodesic Symplectic Transport and Interpretability

arXiv:2609.21647v1 Announce Type: new Abstract: Hamiltonian normalizing flows are attractive generative models because their phase-space maps are invertible and volume preserving, but most neural cons

Riemannian Simultaneous Inference for Tangent Vector Field Regression

arXiv:2609.21910v1 Announce Type: cross Abstract: We consider nonparametric tangent vector field regression on a Riemannian manifold without boundary. Because responses at different points lie in diff

Samsone: A Family of Open Small Audio Language Models for On-Device Inference

arXiv:2609.21666v1 Announce Type: cross Abstract: The success of Large Audio Language Models has driven the development of massive multimodal networks exceeding billions of parameters. However, the de

SP-MoMamba: Superpixel-driven Mixture of State Space Experts for Efficient Image Super-Resolution

arXiv:2605.25892v2 Announce Type: replace Abstract: State space models (SSMs) have emerged as an efficient paradigm for single-image super-resolution (SR) due to their linear complexity and long-range

SpecQuant: Speculative Decoding with Multi-Parent Quantization for Adaptive LLM Inference

arXiv:2609.21704v1 Announce Type: new Abstract: Running large language models (LLMs) locally continues to be limited by restrictions of compute and memory on consumer hardware. The popular acceleratio

TERMon: Detecting Persistent Behavioral Threats in Edge AI via Hardware-Native Ternary Runtime Monitor

arXiv:2609.21713v1 Announce Type: cross Abstract: Edge AI accelerators are increasingly deployed in safety-critical environments, where model outputs may control physical actuators, make access-contro

The EventCV Library for Event-Based Robotic Vision

arXiv:2609.21330v1 Announce Type: new Abstract: Event cameras detect per-pixel brightness changes asynchronously on microsecond timescales, with high dynamic range and low power draw. These are desira

local-aiarxiv-cs-ro

The Weight Is Over - Interactive Diffusion on Consumer GPUs

arXiv:2609.21849v1 Announce Type: cross Abstract: On-device inference is booming, but the momentum is almost all in language models. Diffusion pipelines are memory hungry, latency-sensitive, and requi

TierKV: Long-Context On-Device LLMs via Predictive Multi-Tier KV Caching

arXiv:2609.21172v1 Announce Type: new Abstract: Large language models (LLMs) are moving onto mobile devices for increasingly diverse workloads over text, images, video, and audio. These applications o

Touvigation: Embodied Adaptive Object Acquisition for Blind and Low-Vision Users in Unfamiliar Indoor Environments

arXiv:2609.21828v1 Announce Type: cross Abstract: Blind and low-vision users often face challenges when locating and physically acquiring objects in unfamiliar indoor environments. Existing vision-lan

Traffic Sign Recognition for Autonomous Driving Using Branched YOLOv2 and Geometric Features

arXiv:2609.22060v1 Announce Type: new Abstract: Traffic sign recognition (TSR) is an important perception task for autonomous driving and advanced driver-assistance systems, where a system must both l

Transferable knowledge graphs with executable learned operators for algorithm design

arXiv:2603.27922v2 Announce Type: replace Abstract: Procedural knowledge in algorithm design is embedded in source code and rebuilt for each new domain. We introduce Generative Executable Algorithm Kn

Transformers Discover Molecular Structure Without Graph Priors

arXiv:2510.02259v2 Announce Type: replace Abstract: Computational simulations play a central role in scientific discovery, and machine learning (ML) has emerged as a promising alternative to tradition

Transsion's Speaker-Attributed Multilingual ASR System for the MLC-SLM 2026 Challenge

arXiv:2609.20833v1 Announce Type: new Abstract: This paper presents the Transsion Speech Team submission to Task 1 of the MLC-SLM 2026 Challenge, which focuses on speaker-attributed transcription for

local-aiarxiv-cs-cl

Uncensor an LLM without touching weights: inject a tiny trained KV-cache bank (~18MB) and unload it anytime

I shipped something I've been building for the last few weeks : phantom-kv , a refusal-removal system for large language models that doesn't touch a single weight. Instead of editing the model, it loa

World Modeling in Transformers

arXiv:2609.21748v1 Announce Type: new Abstract: Behavioral failures can make a transformer appear to lack a world model even when it has learned faithful representations of its environment. We demonst

Automating EDD (eval-driven development) with Coding Harness Agents

You can now automate EDD (eval-driven development) with Coding Harness Agents > build a baseline LLM-based application > score every change with judge evals > keep what improves, reject what regresses

DEV-TV

TV for the developer internet GitHub, Hacker News, dev.to, Hugging Face, and release notes, presented as channels you tune into, each auto-cycling its own stories, instead of five tabs to remember to

Do NOT trust StepFun's Plan subscriptions., They stole >$100 from me with no warning, and I have not heard back from support at all.

I know cloud subscription plans are not exactly the core focus of r/LocalLLaMA, so I want to be clear about why I’m posting this here. I’ve been building my own local text-based RPG/game harness and u

Does Ollama Still Have Support Staff?

I have opened two tickets, one around a suspected problem and one around one I verified and then sent exact diagnostics over. The initial response was sent to their AI support, which just tried to tel

I gave Jev, Laya, finetuned ModernCE and Qwen3.5 the controls to Doom

I gave Jev, Laya, a finetuned ModernCE-base-nli and a finetuned Qwen3.5-4B the controls to Doom. Thanks to TypeSafe AI for Jev access. The video lines up the starts of four separate games with the sam

I made a service for hosting multiple audio diffusion models on a single GPU

local-air-stablediffusion

Hi Stable Diffusion People! I recently got into local audio generation but I didn't want to use ComfyUI for it (although I absolutely love it for image generation!) but I started to run out of room on

laya.cpp: Optimized laya near-instant decision making

After seeing u/Nandakishor_ml’s post introducing Laya, I wanted to see how fast it could run in a standalone C++ implementation. Credit to u/Nandakishor_ml for the architecture, training and open-sour

RTX 5090 random black screen + 100% fans + hard lock; sometimes no POST until AC power is removed — gaming, ComfyUI and Ollama

RTX 5090 random black screen + 100% fans + hard lock; sometimes no POST until AC power is removed — gaming, ComfyUI and Ollama I am looking for help diagnosing a very intermittent but increasingly fre

Seeing how differently people prompt LLMs is funny

So my brother and I both use LLMs for coding. I've started using a local GLM 5.3 Flash instance - q4 qat. My brother uses GPT-6-Astra as his daily driver. He has mentioned repeatedly to me that his ap

What is JEV and what is it used for?

I am seeing this JEV everywhere since yesterday in Localllama and it is passing past my head on what it is? So like what is it? Some new LLM? Or is it something else? submitted by /u/Hot_Example_4456

Does Ollama Cloud report cached tokens now?

Since Ollama Cloud switched their plans to token-based pricing, did they start reporting cache read tokens, or their claim about 'transparency' was just PR? I was thinking about getting a subscription

General warning about Clore.AI

Hello, I know some of us may be tempted to rent out our expensive GPUs to recoup some of the cost of self-hosting, and it should be obvious that this can be a risky decision. I decided to try hosting

i built an all in one app around ollama because my own setup was getting ridiculous

full disclosure, i am the developer of locally uncensored :) i use ollama myself and honestly ollama was never really the problem. the problem was everything around it. one app for local chat, another

Massive token savings... Without token usage. GLM-5.2-cloud

Okay, this one seems probably really odd (or maybe not), but most harnesses operate within token spaces. That is, every tool output, even batching of tool outputs, go back up into inference calls. Lea

Modello senza limiti

Da un po mi sono ritrovato in garage un hp z840 da 64gb ddr5 montate (ora) e 2 processori con una gpu un po scarsina una nvidia quadro k680 (da aggiornare) avrei bisogno di un consiglio: quale modello

NYX AI, a local-first AI workspace for Windows with AppContainer integration

I’m one of the co-founders of NYX AI. It’s a Windows app that connects to local models through Ollama/lm studio or supported cloud providers, giving AI tools to work with documents, previews, spreadsh