local ai

b11586: cuda : warnings cleanup (#30420)

local-aillama-cpp-releases

cuda : warnings cleanup Signed-off-by: Adrien Gallouët angt@huggingface.co Update ggml/src/ggml-cuda/common.cuh Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co Signed-off-by: Adrien

13 Oct 2026

Mac mini for running LLMs and AI agents 24/7: Prioritize RAM or CPU/GPU performance?

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

I’m planning to get a Mac mini mainly to run local LLMs and AI agents 24/7. I plan to run models up to 27B parameters with Q4 quantization, and maybe not for coding, maybe just for everday task and mo

local-air-localllama

13 Oct 2026

Netflix’s documentary of Huggingface discussion

It just popped on my feed. I watched the teaser in the Netflix app and a few things jumped out The constant use of anthromorphism using terms like altruism and sacrifice when in engineering literally

13 Oct 2026

A Local Agentic AI Framework to Generate Edge Case Scenarios for Safety Assurance

arXiv:2610.13479v1 Announce Type: new Abstract: Generating edge case scenarios is crucial for training, testing and safety assuring autonomous systems. This identifies hazardous failures to increase s

A Privileged Teacher That Only Scores Cannot Search: Critique-Conditioned On-Policy Self-Distillation for Reasoning

arXiv:2610.13744v1 Announce Type: new Abstract: On-policy self-distillation promises to replace the sparse outcome signal of verifiable-reward RL with dense token-level credit: a teacher conditioned o

Agentic Peer-to-Peer Networks: From Content Distribution to Capability and Action Sharing

arXiv:2603.03753v2 Announce Type: replace-cross Abstract: The ongoing shift of Artificial Intelligence (AI) from centralized cloud application programming interfaces (APIs) to local inference on edge

APEX: Asynchronous Prefix Denoising for Extreme Compression

arXiv:2610.12843v1 Announce Type: cross Abstract: Fewer latent tokens promise cheaper diffusion. Yet aggressive latent compression creates a reconstruction-generation dilemma: adding channels improves

Beyond the Final Embedding: Retrieving Memories from Token-Level Evidence

arXiv:2610.13277v1 Announce Type: cross Abstract: Memory-augmented assistants retrieve evidence from stored conversations and documents to answer queries. Most embedding-based retrievers compare singl

Continually Post-training Small Models via Synthetic Self-distillation

arXiv:2610.13113v1 Announce Type: cross Abstract: Continual post-training faces a dual challenge of acquisition and retention: models must learn new capabilities while preserving prior knowledge. Whil

CORAL-KV: Compact Cross-Layer Prediction and Residual Coding for Autoregressive Video KV Caches

arXiv:2610.12514v1 Announce Type: cross Abstract: Autoregressive video diffusion models maintain a growing attention key-value (KV) cache, making memory a key bottleneck for long video generation. Rec

DeltaLLM: Delta-Key Sparse Attention for Edge LLMs

arXiv:2507.19608v2 Announce Type: replace Abstract: On-device LLM inference is increasingly important for edge platforms but remains challenging due to high computational and memory demands and tight

Distributed Harmonic-Covariance Feedback for Hole Closure in Planar Robot Swarms

arXiv:2610.12637v1 Announce Type: new Abstract: We consider hole closure in a planar multi-agent system whose sensing disks form a time-varying Cech complex. We propose a harmonic-covariance feedback

local-aiarxiv-cs-ro

Does Location Matter? A Black-Box Causal Audit Reveals Model-Dependent Audio Grounding in LALM Hallucination

arXiv:2610.13112v1 Announce Type: new Abstract: Large audio-language models (LALMs) frequently exhibit object hallucination, affirming absent sounds. The dominant mitigation, Audio-Aware Decoding (AAD

DP-MIND: Differentially private memory-guided Long context Inference

arXiv:2610.13132v1 Announce Type: new Abstract: LLM-as-a-Service has become a dominant paradigm for accessing large language models without requiring local deployment. However, the process raises seve

Efficient Audio-Visual Speech Enhancement via Reinforcement Learning-Based Neural Architecture Search

arXiv:2610.12796v1 Announce Type: cross Abstract: Audio-visual speech enhancement (AVSE) improves speech intelligibility in noisy environments but often relies on computationally expensive models unsu

Enriched Holomorphic Neural Networks for 2D and 3D Laplace Problems

arXiv:2610.12541v1 Announce Type: new Abstract: Boundary-value problems for the Laplace equation develop singular behaviour near corners, edges and junctions that smooth approximators resolve poorly.

epGen: open LoRA for LTX-2.5 that gives every sound in the video its own audio track (generation + separation, weights on HF)

local-air-stablediffusion

LTX-2.5 makes a video with one mixed soundtrack. Our LoRA also outputs one track per captioned sound, in the same run. Prompt 'a jeep, its engine growling' and 'a taxi, its horn honking' and you get t

Explore DNA with DeepMind’s AlphaGenome and in-browser MedGemma 1.5 4B via WebGPU

Hey everyone, Sharing an educational tool called AskCyph Health Explorer to explore how single-letter DNA mutations lead to disease, how they alter 3D anatomy, inheritance probabilities, and available

Exploring Attention Sinks in Text-to-Image Transformers from Diffusion and Autoregressive Models

arXiv:2610.13337v1 Announce Type: cross Abstract: Attention sinks are tokens or positions that consistently receive disproportionate attention mass, often beyond what their semantic content would sugg

GeoGR: Spatial-Semantic Token Compression and Group Routing for Efficient 3D VLMs

arXiv:2610.13035v1 Announce Type: cross Abstract: Multi-view representations enable pretrained image and video vision-language models to understand 3D scenes, but their long visual token sequences mak

Global Consistency Repair for Natural-Language Claim Sets

arXiv:2601.13600v2 Announce Type: replace Abstract: NLP systems increasingly aggregate claims from retrieved passages, documents, and generated reasoning steps. Yet current factuality methods mostly v

graphsignal-top: a `top` for inference GPUs in the open-source Graphsignal profiler, kernels ranked by time, live, with readable names

A few weeks ago we posted the open-source Graphsignal profiler here: wrap vllm serve / sglang serve / whatever in graphsignal-run and it serves everything it measures as JSON, mainly so an agent can r

HAFixAgent: History-Aware Agentic Program Repair

arXiv:2511.01047v4 Announce Type: replace-cross Abstract: Automated program repair (APR) has recently shifted toward large language models and agent-based systems, while prior work shows that reposito

Hide and Seek: HIDE Concepts to SEEK explanations for black box models

arXiv:2610.13935v1 Announce Type: cross Abstract: Interpreting machine learning model predictions is a central challenge, particularly for black-box vision models. Concept-based attribution methods in

History never repeats itself but it often rhymes Hint: Transformer rhymes with Diffusion Transformer

History never repeats itself but it often rhymes Hint: Transformer rhymes with Diffusion Transformer We were able to fine tune an open weight model (Qwen3.5-9B) on proprietary internal data at @coinba

local-aicomfyui--x

🚀 Introducing MiniCPM-V 4.7, our new open-source MLLM series! Advancing the Performance–Efficiency Pareto Frontier. It brings strong multim…

🚀 Introducing MiniCPM-V 4.7, our new open-source MLLM series! Advancing the Performance–Efficiency Pareto Frontier. It brings strong multimodal capabilities to iOS and Android devices with extreme eff

local-aiclem-delangue--x

Lecture: Building a GPU Compiler From Scratch. Lowering PyTorch Graphs to CUDA via Multi-Level IRs (GPU_MODE video + article)

https://preview.redd.it/3ekngxk224vh1.png?width=1080&format=png&auto=webp&s=9bfe5c92033e17d5b2fb4529f1320c99455a138b I built a GPU compiler and wrote an article about it, focusing on concepts shared b

LLC: lightweight Open WebUI alt now with Agents+MCP+RAG+Image Editing

Quick context: LocalLightChat (LLC) is a chat frontend for local LLMs. Download it, run it, that's it. No installation (unless you want to), no dependencies, and it runs on pretty much anything, inclu

Machine Unlearning for Federated Socially Fair k-Means Clustering

arXiv:2610.13717v1 Announce Type: new Abstract: Federated clustering can support applications such as patient stratification across hospitals and customer segmentation across distributed financial dat

New anime vit tagger

local-air-stablediffusion

Compared to the original release, a large base anime dataset was used. Roughly 110k photos from nature to museums were also used. All photography photos that were added were scanned for humans. They a

Not Just an Evaluation: A Case Study of Discourse Particle Sensitivity in Language Models

arXiv:2610.13794v1 Announce Type: new Abstract: Discourse particles subtly shape the flow of discourse by reflecting conversational context and interlocutor attitudes, often leaving the truth-conditio

PartiGen: Part-Aware Representations for Language-Conditioned Humanoid Motion Generation

arXiv:2610.13373v1 Announce Type: new Abstract: Translating language into humanoid motion requires coordinating body parts, determining motion duration, and producing references suitable for robot exe

local-aiarxiv-cs-ro

Probabilistic Ship Trajectory Forecasting using Transformer Models on AIS Data

arXiv:2610.13557v1 Announce Type: new Abstract: Anticipation of vessel trajectories is an essential task when navigating at sea. This applies to both human navigators and autonomous surface vessels. T

Receipt scanner that runs a fine-tuned 0.8B vision model on the phone (free) - detailed cost tracking

I wanted to track grocery spending per item without sending my receipts to anyone, so I built an Android app around a small vision model that reads a photo of a receipt into JSON: store, date, total,

Scaling Agentic Data for Long-Horizon Terminal Intelligence

arXiv:2610.13166v1 Announce Type: new Abstract: Terminal agents are moving beyond local operations toward completing real-world professional tasks. Short trajectories can demonstrate commands and tool

Semantic Views: Certified Reuse of LLM Labels Across Semantic Queries

arXiv:2610.12768v1 Announce Type: cross Abstract: Semantic query engines evaluate natural-language filters with a large language model, and every evaluation is a costly oracle call. Optimizers that re

Spatial Context or Memory? Sizing the Inputs of Neural Surrogates for Partially Observed Fields

arXiv:2610.12723v1 Announce Type: new Abstract: Neural surrogates that forecast a physical field from sparse, noisy sensors read a window of nearby sensors and a history of past snapshots. Practitione

Structural Automata for Neural Semantic Parsing

arXiv:2610.13896v1 Announce Type: new Abstract: Neural semantic parsers generate meaning representations token by token, yet well-formedness depends on references, scope, and graph relations that unfo

Trajectory-Aware Policy Optimization: Closing the State Distribution Gap in Long-Horizon LLM RL

arXiv:2610.13020v1 Announce Type: new Abstract: Reinforcement learning (RL) has become a dominant paradigm for enhancing LLMs' reasoning capabilities. Yet long-horizon autoregressive rollouts introduc

User Trajectory Prediction Unifying Global and Local Temporal Information

arXiv:2508.02161v2 Announce Type: replace Abstract: Trajectory prediction is essential for formulating proactive strategies that anticipate user mobility and support advance preparation. Therefore, ho

2x 3090, 3x 3060 potential (smart and informed) future upgrade paths (send help)

I'm trying to figure out the best long-term upgrade path for my setup. Right now my GPUs are spread across several consumer PCs: Main: 5900X, 32GB DDR4, 2× RTX 3090 24GB. Secondary: i3-10320, 16GB DDR

I built a lightweight tool that automatically frees up VRAM for gaming and restores your local LLMs afterward

I run local LLMs pretty much around the clock, but I also enjoy gaming on the same PC. Having models sitting in VRAM while gaming isn't exactly ideal, and constantly unloading and reloading them manua

M5 Ultra 256GB or 2x DGX Spark? Which one?

Currently contemplating adding either M5 Ultra 256GB or dual DGX Spark in addition to existing 5090. I have been researching for past few days and have zeroed in on dual sparks because higher throughp

Update: Kroma, A Krea-2 Fine Tune

local-air-stablediffusion

[ I'm posting this on behalf of u/LodestoneRock since for some reason his post on this sub keep getting auto removed by Reddit. ] Hey everyone, First of all, thank you to everyone for supporting this

I was curious about how omni decision models could be used in rescue workers bodycams or smart glasses, so I decided to build a quick demo. …

I was curious about how omni decision models could be used in rescue workers bodycams or smart glasses, so I decided to build a quick demo. I went with @liquidai d1-omni-600M since it supports both vi

local-aiclem-delangue--x

microsoft doubles down on local ai with nvidia, but with a cost

https://preview.redd.it/uyjw2lcrvkuh1.png?width=1536&format=png&auto=webp&s=ce991be22faec3de5cbaf39119c14782b6ed0af3 link to article TLDR; new microsoft surface and nvidia rtx spark laptops are starti

Recommendations for Local AI Long-Term Memory and User Personalization Modules

I am developing a Windows-based local AI virtual spouse application that supports adult roleplay. My goal is to run it without a server or external AI APIs. I am looking for existing open-source modul

local-air-ollama

Typesafe ai raised 870m $ on hype (jev)

https://typesafe.ai/blog/series-ai Meanwhile one of the reddit members apparently developed the same architecture a year ago: https://www.reddit.com/r/LocalLLaMA/s/8zQXqCNDlb Looks like ai valuation n