Search: “local-ai”

A Privileged Teacher That Only Scores Cannot Search: Critique-Conditioned On-Policy Self-Distillation for Reasoning

arXiv:2610.13744v1 Announce Type: new Abstract: On-policy self-distillation promises to replace the sparse outcome signal of verifiable-reward RL with dense token-level credit: a teacher conditioned o

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

Agentic Peer-to-Peer Networks: From Content Distribution to Capability and Action Sharing

DGX agent

arXiv:2603.03753v2 Announce Type: replace-cross Abstract: The ongoing shift of Artificial Intelligence (AI) from centralized cloud application programming interfaces (APIs) to local inference on edge

local-aiarxiv-cs-ai

12 Oct 2026

APEX: Asynchronous Prefix Denoising for Extreme Compression

arXiv:2610.12843v1 Announce Type: cross Abstract: Fewer latent tokens promise cheaper diffusion. Yet aggressive latent compression creates a reconstruction-generation dilemma: adding channels improves

Beyond the Final Embedding: Retrieving Memories from Token-Level Evidence

arXiv:2610.13277v1 Announce Type: cross Abstract: Memory-augmented assistants retrieve evidence from stored conversations and documents to answer queries. Most embedding-based retrievers compare singl

Continually Post-training Small Models via Synthetic Self-distillation

arXiv:2610.13113v1 Announce Type: cross Abstract: Continual post-training faces a dual challenge of acquisition and retention: models must learn new capabilities while preserving prior knowledge. Whil

CORAL-KV: Compact Cross-Layer Prediction and Residual Coding for Autoregressive Video KV Caches

arXiv:2610.12514v1 Announce Type: cross Abstract: Autoregressive video diffusion models maintain a growing attention key-value (KV) cache, making memory a key bottleneck for long video generation. Rec

DeltaLLM: Delta-Key Sparse Attention for Edge LLMs

arXiv:2507.19608v2 Announce Type: replace Abstract: On-device LLM inference is increasingly important for edge platforms but remains challenging due to high computational and memory demands and tight

Distributed Harmonic-Covariance Feedback for Hole Closure in Planar Robot Swarms

arXiv:2610.12637v1 Announce Type: new Abstract: We consider hole closure in a planar multi-agent system whose sensing disks form a time-varying Cech complex. We propose a harmonic-covariance feedback

local-aiarxiv-cs-ro

Does Location Matter? A Black-Box Causal Audit Reveals Model-Dependent Audio Grounding in LALM Hallucination

arXiv:2610.13112v1 Announce Type: new Abstract: Large audio-language models (LALMs) frequently exhibit object hallucination, affirming absent sounds. The dominant mitigation, Audio-Aware Decoding (AAD

DP-MIND: Differentially private memory-guided Long context Inference

arXiv:2610.13132v1 Announce Type: new Abstract: LLM-as-a-Service has become a dominant paradigm for accessing large language models without requiring local deployment. However, the process raises seve

Efficient Audio-Visual Speech Enhancement via Reinforcement Learning-Based Neural Architecture Search

arXiv:2610.12796v1 Announce Type: cross Abstract: Audio-visual speech enhancement (AVSE) improves speech intelligibility in noisy environments but often relies on computationally expensive models unsu

Enriched Holomorphic Neural Networks for 2D and 3D Laplace Problems

arXiv:2610.12541v1 Announce Type: new Abstract: Boundary-value problems for the Laplace equation develop singular behaviour near corners, edges and junctions that smooth approximators resolve poorly.

Exploring Attention Sinks in Text-to-Image Transformers from Diffusion and Autoregressive Models

arXiv:2610.13337v1 Announce Type: cross Abstract: Attention sinks are tokens or positions that consistently receive disproportionate attention mass, often beyond what their semantic content would sugg

GeoGR: Spatial-Semantic Token Compression and Group Routing for Efficient 3D VLMs

arXiv:2610.13035v1 Announce Type: cross Abstract: Multi-view representations enable pretrained image and video vision-language models to understand 3D scenes, but their long visual token sequences mak

Global Consistency Repair for Natural-Language Claim Sets

arXiv:2601.13600v2 Announce Type: replace Abstract: NLP systems increasingly aggregate claims from retrieved passages, documents, and generated reasoning steps. Yet current factuality methods mostly v

graphsignal-top: a `top` for inference GPUs in the open-source Graphsignal profiler, kernels ranked by time, live, with readable names

A few weeks ago we posted the open-source Graphsignal profiler here: wrap vllm serve / sglang serve / whatever in graphsignal-run and it serves everything it measures as JSON, mainly so an agent can r

HAFixAgent: History-Aware Agentic Program Repair

arXiv:2511.01047v4 Announce Type: replace-cross Abstract: Automated program repair (APR) has recently shifted toward large language models and agent-based systems, while prior work shows that reposito

Hide and Seek: HIDE Concepts to SEEK explanations for black box models

arXiv:2610.13935v1 Announce Type: cross Abstract: Interpreting machine learning model predictions is a central challenge, particularly for black-box vision models. Concept-based attribution methods in

LLC: lightweight Open WebUI alt now with Agents+MCP+RAG+Image Editing

Quick context: LocalLightChat (LLC) is a chat frontend for local LLMs. Download it, run it, that's it. No installation (unless you want to), no dependencies, and it runs on pretty much anything, inclu

Machine Unlearning for Federated Socially Fair k-Means Clustering

arXiv:2610.13717v1 Announce Type: new Abstract: Federated clustering can support applications such as patient stratification across hospitals and customer segmentation across distributed financial dat

Not Just an Evaluation: A Case Study of Discourse Particle Sensitivity in Language Models

arXiv:2610.13794v1 Announce Type: new Abstract: Discourse particles subtly shape the flow of discourse by reflecting conversational context and interlocutor attitudes, often leaving the truth-conditio

PartiGen: Part-Aware Representations for Language-Conditioned Humanoid Motion Generation

arXiv:2610.13373v1 Announce Type: new Abstract: Translating language into humanoid motion requires coordinating body parts, determining motion duration, and producing references suitable for robot exe

local-aiarxiv-cs-ro

Probabilistic Ship Trajectory Forecasting using Transformer Models on AIS Data

arXiv:2610.13557v1 Announce Type: new Abstract: Anticipation of vessel trajectories is an essential task when navigating at sea. This applies to both human navigators and autonomous surface vessels. T

Receipt scanner that runs a fine-tuned 0.8B vision model on the phone (free) - detailed cost tracking

I wanted to track grocery spending per item without sending my receipts to anyone, so I built an Android app around a small vision model that reads a photo of a receipt into JSON: store, date, total,

Scaling Agentic Data for Long-Horizon Terminal Intelligence

arXiv:2610.13166v1 Announce Type: new Abstract: Terminal agents are moving beyond local operations toward completing real-world professional tasks. Short trajectories can demonstrate commands and tool

Semantic Views: Certified Reuse of LLM Labels Across Semantic Queries

arXiv:2610.12768v1 Announce Type: cross Abstract: Semantic query engines evaluate natural-language filters with a large language model, and every evaluation is a costly oracle call. Optimizers that re

Spatial Context or Memory? Sizing the Inputs of Neural Surrogates for Partially Observed Fields

arXiv:2610.12723v1 Announce Type: new Abstract: Neural surrogates that forecast a physical field from sparse, noisy sensors read a window of nearby sensors and a history of past snapshots. Practitione

Structural Automata for Neural Semantic Parsing

arXiv:2610.13896v1 Announce Type: new Abstract: Neural semantic parsers generate meaning representations token by token, yet well-formedness depends on references, scope, and graph relations that unfo

Trajectory-Aware Policy Optimization: Closing the State Distribution Gap in Long-Horizon LLM RL

arXiv:2610.13020v1 Announce Type: new Abstract: Reinforcement learning (RL) has become a dominant paradigm for enhancing LLMs' reasoning capabilities. Yet long-horizon autoregressive rollouts introduc

User Trajectory Prediction Unifying Global and Local Temporal Information

arXiv:2508.02161v2 Announce Type: replace Abstract: Trajectory prediction is essential for formulating proactive strategies that anticipate user mobility and support advance preparation. Therefore, ho

2x 3090, 3x 3060 potential (smart and informed) future upgrade paths (send help)

I'm trying to figure out the best long-term upgrade path for my setup. Right now my GPUs are spread across several consumer PCs: Main: 5900X, 32GB DDR4, 2× RTX 3090 24GB. Secondary: i3-10320, 16GB DDR

11 Oct 2026

I built a lightweight tool that automatically frees up VRAM for gaming and restores your local LLMs afterward

I run local LLMs pretty much around the clock, but I also enjoy gaming on the same PC. Having models sitting in VRAM while gaming isn't exactly ideal, and constantly unloading and reloading them manua

11 Oct 2026

M5 Ultra 256GB or 2x DGX Spark? Which one?

Currently contemplating adding either M5 Ultra 256GB or dual DGX Spark in addition to existing 5090. I have been researching for past few days and have zeroed in on dual sparks because higher throughp

11 Oct 2026

I was curious about how omni decision models could be used in rescue workers bodycams or smart glasses, so I decided to build a quick demo. …

I was curious about how omni decision models could be used in rescue workers bodycams or smart glasses, so I decided to build a quick demo. I went with @liquidai d1-omni-600M since it supports both vi

local-aiclem-delangue--x

microsoft doubles down on local ai with nvidia, but with a cost

https://preview.redd.it/uyjw2lcrvkuh1.png?width=1536&format=png&auto=webp&s=ce991be22faec3de5cbaf39119c14782b6ed0af3 link to article TLDR; new microsoft surface and nvidia rtx spark laptops are starti

Recommendations for Local AI Long-Term Memory and User Personalization Modules

I am developing a Windows-based local AI virtual spouse application that supports adult roleplay. My goal is to run it without a server or external AI APIs. I am looking for existing open-source modul

local-air-ollama

Typesafe ai raised 870m $ on hype (jev)

https://typesafe.ai/blog/series-ai Meanwhile one of the reddit members apparently developed the same architecture a year ago: https://www.reddit.com/r/LocalLLaMA/s/8zQXqCNDlb Looks like ai valuation n

We built Many Agents give AI agents their own cloud computers and let them work for you 🚀

Hey everyone! 👋 After months of building, we’re finally opening the first spots for **Many Agents**, a new product from Dome. The idea is simple: **What if you could create your own team of AI agents

local-air-ollama

A 24KB stand-alone HTML-LLM that can generate consistent stories

https://preview.redd.it/7sknv6omnguh1.png?width=1023&format=png&auto=webp&s=4aef1dc464d008b00f104519eb5399ba6132ad69 Want to try? Just go here and click 'New seed' a lot. You will get different storie

AtomWorld-Mirror: Macro-Step World Modeling of Critical Evolution Backbones for Materials Dynamics

arXiv:2610.11527v1 Announce Type: new Abstract: Atomistic simulation is a fundamental tool for studying long-term materials evolution, from diffusion and defect dynamics to interfacial reactions and f

Boosting the Local Invariance for Better Adversarial Transferability

arXiv:2503.06140v3 Announce Type: replace Abstract: Transfer-based attacks pose a significant threat to real-world applications by directly targeting victim models with adversarial examples generated

local-aiarxiv-cs-cv

Bridging KV-Cache Quantization and Linear Attention: From Theory to Pretrained Weight Migration

arXiv:2610.11214v1 Announce Type: cross Abstract: KV-cache quantization and linear attention are two representative approaches to tackling the storage and computational costs of Transformers. KV-cache

Budgeted Multi-Source Counterfactual Annotation for Off-Policy Evaluation

arXiv:2610.10974v1 Announce Type: cross Abstract: Off-policy evaluation (OPE) estimates the value of a target policy from logged data, but limited behavior-policy coverage can force high-variance rewe

Causal-fate dynamics of unrealized influence

arXiv:2610.11422v1 Announce Type: cross Abstract: Many dynamical systems generate influences whose consequences are not fully exhausted in the realized trajectory at the moment they arise. Such conseq

Census-Based Population Autonomy For Distributed Robotic Teaming

arXiv:2511.02147v2 Announce Type: replace Abstract: Collaborating teams of robots show promise due to their ability to complete missions more efficiently and with improved robustness, attributes that

local-aiarxiv-cs-ro

Characterizing Overconfident Failure in LLM-Based Code Generation

arXiv:2610.11300v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used for automated code generation, but generated programs can appear syntactically plausible while stil

Class Machine Unlearning for Complex Data via Concepts Inference and Data Poisoning

arXiv:2405.15662v2 Announce Type: replace Abstract: Machine unlearning aims to remove the influence of specified training data or knowledge from a trained model without requiring full retraining. This

Conformal Data Contamination Tests for In-distribution Data Acquisition

arXiv:2507.13835v2 Announce Type: replace-cross Abstract: The amount of quality data in many machine learning tasks is limited to what is available locally to data owners. The set of quality data can