local ai

HARISSA: Inference-Time Self-Checks for Efficient and Safe Local Language Model Deployment

arXiv:2609.38006v1 Announce Type: new Abstract: Running a language model locally offers advantages in privacy, latency, and cost, but local hardware fits only small models, which are less capable than

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

I love decision models popularized by @typesafeai 's JEV but I also want to run it locally, especially for sensitive info. So as soon as @ol…

DGX agent

The user expresses enthusiasm for the decision‑modeling approach introduced by @typesafeai’s JEV tool, emphasizing a preference for local deployment to protect sensitive data. After learning that @oll

local-aiollama--x

30 Sept 2026

Invariant Atoms: Sparse Coordinates of Local Semantic Geometry in Language Model Representations

arXiv:2609.36451v1 Announce Type: cross Abstract: Large language models often preserve meaning despite substantial changes in wording, style, and syntax, while small semantic edits can systematically

local-aiarxiv-cs-cl

KV-Kaizen: Learning Context-Adaptive Cache Compression Choices

arXiv:2609.37988v1 Announce Type: new Abstract: As the context size of text processed with an LLM grows, the size of KV caches can outstrip the memory allocated for the original model weights. This im

Learned Compression of SAR Phase-History Data: A Rate-Honest Feasibility Study on GOTCHA

arXiv:2609.35848v1 Announce Type: new Abstract: On-board compression of synthetic aperture radar (SAR) phase history is bandwidth-critical, and block-adaptive quantization (BAQ) remains the operationa

Less Supervision, Better Generalization: Weakly Supervised Fake Region Localization in Diffusion-Edited Images

arXiv:2609.36882v1 Announce Type: new Abstract: Localizing AI-edited regions is essential for interpretable forensic analysis, but remains challenging due to subtle and spatially distributed artifacts

Look Closer: Patch-wise Supervision for AI-Generated Image Detection

arXiv:2609.37937v1 Announce Type: new Abstract: How much of an image does a detector need to see? Small RGB regions can retain useful evidence of image synthesis even when they reveal little of the fu

Loss-Guided Pretraining Data Selection for Time-Series Foundation Models

arXiv:2609.37255v1 Announce Type: cross Abstract: Time series foundation models (TSFMs) are pretrained on heterogeneous collections containing billions of observations, yet their training windows are

Mira: Memory-Efficient MoE Inference Using Adaptive Caching and Predictive Expert Staging

arXiv:2609.38090v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models are a compelling architecture for scaling model capacity, making them especially attractive for deployment on resource-c

MoCA-Video: Motion-Aware Concept Alignment for Consistent Video Editing

arXiv:2506.01004v3 Announce Type: replace-cross Abstract: Unlike traditional video editing or inpainting, video semantic mixing fuses a reference concept with a moving target entity to produce a hybri

Modelo en MacBook Pro m3

Hola a todos! Tengo un MacBook Pro m3 con 16gb de RAM. No me siento cómodo con los modelos que he probado y me gustaría saber qué modelo os sentís cómodo y para que lo usáis Muchas gracias! submitted

Multi-task learning for the automatic grading of enlarged perivascular space burden using MRI

arXiv:2609.37387v1 Announce Type: new Abstract: Enlarged perivascular spaces (PVS) visible in brain magnetic resonance imaging (MRI) are increasingly thought to be linked to poor brain health. PVS are

MVG-WAM: Multiple View Geometry-Aware World-Action Modeling for Robotic Manipulation

arXiv:2609.37793v1 Announce Type: new Abstract: World-Action Models (WAMs) couple visual dynamics with action prediction, bringing the rich priors of pretrained video models to robotic manipulation. H

local-aiarxiv-cs-ro

NeuronEye: Query-Guided Visual Concept Activation for Vision-Language Reasoning

arXiv:2609.38098v1 Announce Type: new Abstract: Current vision-language models (VLMs) encode visual information in dense hidden states where object identity, spatial layout, and local attributes are i

ollama multi gpu installer bugs

I've been struggling with the ollama update process. I have both nvidia and amd GPUs in my system. I have two instances of ollama running on different ports for this to work around issues. AMD 7800xt

Ollama now supports Jev-like decision models all locally. Use decision models like Nimble for tasks like ticket triaging, model routing, and…

Ollama now supports Jev-like decision models all locally. Use decision models like Nimble for tasks like ticket triaging, model routing, and content moderation. ollama pull nimble Here’s Nimble playin

local-aiollama--x

@ollama Tested Tev1, Nimble and Laya on my pacman-arena game setup: code: https://github.com/hakan-gecili/pacman-arena/tree/main

Hakan Gecili (@HakanGecili2) reported testing the AI models Tev1, Nimble, and Laya within his Pacman‑Arena game environment. The source code for this setup is available on GitHub at https://github.com

local-aiollama--x

On-Policy Visual Evidence Distillation

arXiv:2609.36838v1 Announce Type: cross Abstract: Visual agents solve problems by interleaving reasoning with image operations, and on-policy distillation (OPD) provides guidance from a strong teacher

On Trajectory-Aware Training for Masked Diffusion Language Models

arXiv:2609.37974v1 Announce Type: cross Abstract: Masked diffusion models (MDMs) generate text by unmasking several tokens per step, but they are trained and sampled under different conditions. The mo

PreferenceFlow: Test-Time Guidance of Flow-Matching Robot Policies from Human Interventions

arXiv:2609.36872v1 Announce Type: new Abstract: Flow-matching policies can represent complex robot behaviors but remain susceptible to local errors under distribution shift at deployment. Many reinfor

local-aiarxiv-cs-ro

Pretrain Once, Route Anywhere: Towards a Foundation Model for LLM Routing

arXiv:2609.37362v1 Announce Type: new Abstract: Large language model (LLM) routing aims to assign each query to the most suitable model from a heterogeneous candidate pool, improving the quality--effi

Privacy-Friendly Cohort Determination: Sealed, CSP-Independent In-Browser ML Inference of Professional Segments for Identity-Less Advertising

arXiv:2609.36153v1 Announce Type: cross Abstract: B2B advertising targets a viewer's professional attributes (employer size and industry, function, seniority) and has obtained them by matching identit

Quitting for Openrouter. Am I crazy?

I'm tired of watching my compute budget and topping off my Ollama account. It feels like I can use a mix with more flash models on Openrouter (things not all available at Ollama) and control my spend

ReCaVSR: One-Step Streaming Diffusion Video Super-Resolution with Recycled Latents and Learned Cache Routing

arXiv:2609.37831v1 Announce Type: new Abstract: Real-time diffusion-based video super-resolution (VSR) is in high demand for online streaming, yet stringent latency requirements often compromise gener

Receptive-field-constrained stimulus optimization for human early and intermediate visual cortex

arXiv:2609.36391v1 Announce Type: cross Abstract: An ongoing challenge in sensory neuroscience is to characterize the feature dimensions encoded by cortical populations. Recent approaches probe featur

Reconstructing the Vocal Tract with Differentiable Acoustic Simulation

arXiv:2609.36737v1 Announce Type: cross Abstract: The vocal tract is the region of the human body responsible for filtering one's voice to create speech. In this paper, we present a differentiable and

local-aiarxiv-cs-cl

Reducing compounded round trips with aggressively structured compaction.

Ollama’s new limits and max plans are worrying me, so I’ve been going harder on my harness. (Thanks to everyone who’s signed up for the waitlist so far.) Wanted to share how my v1.10.0 will dramatical

RESCUE: Repairing Language Model Errors to Sparse Circuits via Reinforcement Learning

arXiv:2609.36813v1 Announce Type: new Abstract: Large language models (LLMs) exhibit strong general capabilities that mechanistic interpretability has attributed to sparse computational circuits. Howe

RLX: A Unified Multi-Backend Tensor Compiler and Distributed Runtime in Rust

arXiv:2609.37916v1 Announce Type: cross Abstract: Production machine learning (ML) stacks often split graph compilation and kernel execution across different layers and languages, making backend behav

Scalable Diffusion SBI for Compositional Inference under Simulator Misspecification

arXiv:2609.36950v1 Announce Type: new Abstract: Simulation-based inference is challenging when many heterogeneous observations must be composed, hierarchical latent structure must be preserved, and th

SKILLLITE: Evidence-Guided Malicious Skill Auditing with Compact LLMs

arXiv:2609.36879v1 Announce Type: cross Abstract: As LLM-based agents perform increasingly complex tasks, Agent Skills have emerged as a flexible mechanism for extending their capabilities. An Agent S

Spatiotemporal Hyperedges for EEG Seizure Detection and Prediction

arXiv:2609.37730v1 Announce Type: new Abstract: Seizure detection and prediction from EEG are clinically important but challenging because seizures are rare, temporally localized, and propagate as coo

Targeting Pivotal Decisions for Credit Assignment in Agentic Reinforcement Learning

arXiv:2609.36178v1 Announce Type: cross Abstract: Group Relative Policy Optimization (GRPO) has become a promising approach for training large language model agents. However, its uniform assignment of

TaRL: Learning General and Physical Rewards from Tactile Demonstrations

arXiv:2609.36785v1 Announce Type: new Abstract: Contact-rich manipulation requires robots to sequence precise contacts, maintain stable grasps, and apply directed forces. Reinforcement learning (RL) c

local-aiarxiv-cs-ro

Task-Oriented Visual Feature Compression via Residual Vector Quantization for Device-Edge Multimodal Inference

arXiv:2609.37090v1 Announce Type: new Abstract: Large multimodal models (LMMs) support diverse visual understanding and reasoning tasks but are often impractical to run entirely on resource-constraine

The Commit-Abstain Circuit: Why Language Models Hallucinate Instead of Abstaining

arXiv:2609.32964v2 Announce Type: replace Abstract: Language models (LMs) often hallucinate by committing to confident answers rather than abstaining, even when they do not have enough information to

Towards Scalable Context-Aware Single-Cell Spatial Transcriptomics Prediction from Histology Images

arXiv:2609.36429v1 Announce Type: new Abstract: Predicting gene expression from H&E-stained histology images offers a scalable alternative to costly spatial transcriptomics, yet most existing methods

Traversing the solution space of neural networks with Hessian Null Space Continuation

arXiv:2609.38081v1 Announce Type: new Abstract: On a single task, deep networks can learn many solutions, depending on their optimizer, training data, architecture, and hyperparameters. Many of these

UltraReal Upscaling LoRA for Klein9B (New Version)

local-air-stablediffusion

A LoRA designed to reduce the typical smooth/plastic AI look and bring natural texture and realism to your images. What's new in V5 (KL9_V5_Pro): Summary: This version gives the best natural texture s

UniAfford: Token-Routed Multitask Learning for Generalizable 2D-3D Affordance Perception

arXiv:2609.37264v1 Announce Type: cross Abstract: Affordance perception aims to localize actionable regions supporting embodied interaction, yet 2D and 3D affordance grounding have evolved as separate

VLALight: A Vision-Language-Action Model for Traffic Signal Control

arXiv:2609.36934v1 Announce Type: new Abstract: Traffic signal control (TSC) is essential for improving urban mobility and reducing congestion. Although roadside cameras are widely deployed at signali

We just open-sourced the world's fastest WebGPU kernels for local AI on Hugging Face

The collection includes kernels for more than 200 common ML operations, all of which can run entirely locally in your browser on WebGPU. We're also working to upstream these optimizations to Transform

local-air-localllama

What AI model can I run??

Processor Intel(R) Core(TM) Ultra 5 226V (2.10 GHz) Installed RAM 16.0 GB (15.7 GB usable) Graphics card Intel(R) Arc(TM) 130V GPU (8GB) (128 MB) Storage 273 GB of 954 GB used System type 64-bit opera

What Shared Prefixes Hide: Trajectory Dropout for On-Policy Distillation

arXiv:2609.33455v2 Announce Type: replace Abstract: On-policy distillation (OPD) trains a student model on its own trajectories using dense token-level feedback from a stronger teacher model. Since ea

Where Should Physics Enter a Molecular Crystal Generator?

arXiv:2609.36398v1 Announce Type: cross Abstract: Generative models make molecular crystal structure prediction fast, but their samples still exhibit geometric and packing violations. Physics can be i

Why MLLMs Struggle to Count: Overcoming Individuation and Aggregation Bottlenecks with ConvStack

arXiv:2609.37096v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) consistently struggle with fine-grained visual counting, yet the underlying causes remain poorly understood. In

A profile of Mariano-Florentino Cuéllar, Anthropic's first global affairs chief, who had helped shape California's first AI safety law in 2025 (Brandon Pho/Mission Local)

Brandon Pho / Mission Local: A profile of Mariano-Florentino Cuéllar, Anthropic's first global affairs chief, who had helped shape California's first AI safety law in 2025 — In a hot and dry border to

local-aitechmeme

29 Sept 2026

A Solvable Theory of Pre-training Data Poisoning: Regime-Dependent Scaling Exponents

arXiv:2609.32288v1 Announce Type: new Abstract: Pre-training data poisoning of large language models is usually studied using targeted backdoors and their survival through safety post-training, which