Search: “local-ai”

Routing Without Training: Controllable-Ratio LLM Offloading via Reliability Gating

arXiv:2607.20481v1 Announce Type: new Abstract: Local-cloud collaboration is a practical way to deploy large language models under resource constraints, but existing methods often rely on trained rout

Local Ai

Spectral Transformation for Layer-wise Global Rank Discovery in Federated LoRA for Vision Transformers

DGX agent

arXiv:2607.21074v1 Announce Type: new Abstract: Fine-tuning Vision Transformers (ViTs) with low-rank adapters (LoRA) promises better communication efficiency under federated setup, yet existing aggreg

local-aiarxiv-cs-lg

24 Jul 2026

Spent two weeks on a kernel that benchmarked 29x faster. End to end it's maybe 6-10%, and it's not even wired in yet.

I've been building a C99 inference engine from scratch (no Python, no BLAS, just gcc and make) that runs BitNet's ternary models on CPU. A few weeks ago I got obsessed with the matmul kernel - wrote a

Test-Time Scaling via Error Localization

arXiv:2607.21453v1 Announce Type: new Abstract: Scaling inference-time computation has emerged as a reliable method to improve the performance of large language models on complex reasoning and program

The demand for GLM-5.2 and other frontier-level open models has been surging on Ollama's cloud. We're adding capacity in anticipation for so…

The demand for GLM-5.2 and other frontier-level open models has been surging on Ollama's cloud. We're adding capacity in anticipation for some very large models next week! To make sure Ollama's infras

local-aiollama--x

Toward Continuous Assurance for the Democratization of AI Agent Creation in Industry

arXiv:2607.21495v1 Announce Type: new Abstract: AI agents are increasingly created inside organizations by non-engineering users through low-code, no-code, and conversational development environments.

Towards Privacy-Preserving Federated Prompt Tuning under Data Heterogeneity: A Subspace-Decomposed Expert Approach

arXiv:2607.21417v1 Announce Type: new Abstract: Federated prompt tuning (FPT) enables collaborative adaptation of vision--language models (VLMs) using lightweight prompts. Existing methods often addre

VibeVoice-ASR-BitNet Technical Report

arXiv:2607.21075v1 Announce Type: cross Abstract: We present VibeVoice-ASR-BitNet, a compressed variant of VibeVoice-ASR optimized for real-time inference on edge CPUs. We apply heterogeneous quantiza

local-aiarxiv-cs-cl

What I learned using Ollama on a real Paperless archive: model choice was not the main problem

I maintain Tagvico, an open-source companion for Paperless-ngx. I added Ollama because document text is exactly the kind of data many people do not want to send to a hosted model. The surprising failu

What's the last model trained on human-data only?

From my understanding, most current LLMs are trained on trillions and trillions of tokens of mostly AI-generated data. Are there any recent models that are trained purely (or as close as possible) on

which model to use on local 24gb mac mini M4 pro

So, i have been building some apps that should run on the local every user system, tried gemma4 although its fast and great at reasoning its not as good in instructions following and tool calling. tri

Wisdom of LLM Crowds: Aggregation and Contamination in Language Model Ensembles

arXiv:2607.18269v2 Announce Type: replace Abstract: The wisdom of crowds -- the finding that aggregating judgments across individuals often outperforms the best individual -- has been extensively stud

A caveman qwen3.6 27B

Just saw this on huggingface: https://huggingface.co/ProCreations/grug-27b The benchmarks claim that it's quite a bit better than qwen3.6 27B original and that they reduced the amount of necessary tok

A local-first harness for multi-agent workflows

Hey all, I’ve been working on this in my spare time and finally feel ready to share it outside my own circles. Arbiter is a single binary for running agents locally. I originally built it because I wa

ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU

arXiv:2607.19191v1 Announce Type: new Abstract: We present ABot-World-0, an action-conditioned video world model for real-time, long-horizon closed-loop interaction, supported by a multi-source data i

Absurd claim: the distilled model outperforms the originals

As an AI community of LLM experts, are we really going to stay silent while US officials make absurd claims to push anti-consumer laws? Not only does the release timeline between Fable and K3 make hig

Active Inference as a Convex Markov Decision Process

arXiv:2607.20152v1 Announce Type: cross Abstract: Active Inference (AIF) frames adaptive behavior as the minimization of expected free energy (EFE), combining epistemic and pragmatic objectives within

AdaHome: An Adaptive Smart Home Assistant using Local Small Language Models

arXiv:2607.18034v2 Announce Type: replace Abstract: Smart home assistants interpret a wide range of user commands, from explicit device control to underspecified and preference dependent requests. Whi

An Exploratory Analysis of Pain Localization via Explainable Computational Modeling

arXiv:2607.19726v1 Announce Type: new Abstract: Automatic pain localization, which involves identifying the anatomical origin of pain from peripheral physiological signals without patient self-report,

Appearance Pointers -- Multimodal Region Control of Diffusion Transformers

arXiv:2607.19344v1 Announce Type: new Abstract: Controllable image generation remains challenging for creative professionals, who often require precise regional control over materials, object identiti

blank square in ollama local ai app

I have this android smartwatch that has plenty of storage and ram and I wanna try to run some local ai on it, but shortly after opening the app there is this blank square blocking me from doing anythi

Brewing Stronger Features: Dual-Teacher Distillation for Multispectral Earth Observation

arXiv:2602.19863v3 Announce Type: replace Abstract: Foundation models are transforming Earth Observation (EO), yet the diversity of EO sensors and modalities makes a single universal model unrealistic

Built a local RAG app that answers questions from your own PDFs, fully offline

Been wanting to build this for a while, finally sat down and did it. It's a Flask app where you upload a PDF, it chunks and embeds it, and then you can ask questions and get answers pulled only from t

CNS-Edit++: Category-Agnostic 3D Editing with Coupled Neural Shape Representation

arXiv:2607.16577v2 Announce Type: replace Abstract: This paper presents a latent-space 3D shape editing framework built upon a coupled neural shape (CNS) representation and a neural feature volume opt

Decoupled Pipeline with Proposal Reranking and Score Fusion for Positive-Unlabeled Marine Species Detection

arXiv:2607.18700v1 Announce Type: new Abstract: The FathomNetCLEF 2026 competition combines underwater object detection and fine-grained marine species classification under a positive-unlabeled evalua

DeforM: Reasoning-Guided Physics-Aware Video Generation via Spatial-Temporal Masking

arXiv:2607.18664v1 Announce Type: new Abstract: Video generation models achieve high visual quality but often struggle to generate physics-aware videos. Unlike rigid-body motion, which can be describe

Development of an automated, reliable, and clinically meaningful artificial intelligence (AI) tool for diagnosing cardiac disease from conventional cardiovascular magnetic resonance (CMR) images

arXiv:2607.20087v1 Announce Type: new Abstract: Aims: Cardiovascular magnetic resonance (CMR) imaging enables non-invasive assessment of myocardial structure, function, and pathology, but requires sub

Did Alice Do Wrong? Cross-Cultural Differences in Student Perceptions of Generative AI Use in University Computing Education

arXiv:2607.19699v1 Announce Type: cross Abstract: The rise of generative AI (GenAI) in higher education has prompted urgent debates surrounding academic integrity and ethical use. This study examines

Edge Intelligence in Civil Aviation: Paradigms, Techniques, and Applications

arXiv:2607.19676v1 Announce Type: new Abstract: Civil aviation is safety critical and its operations, from flight decks and towers to ramps and maintenance, generate massive, heterogeneous data at the

Edge-Local and Qubit-Efficient Quantum Graph Learning for the NISQ Era

arXiv:2602.16018v2 Announce Type: replace-cross Abstract: Graph neural networks (GNNs) are a powerful framework for learning representations from graph-structured data, but their direct implementation

FedLSG: LLM-Enhanced Semantic Calibration for Federated Graph Backdoor Defense

arXiv:2607.19674v1 Announce Type: cross Abstract: Federated Graph Neural Networks (FedGNNs) are highly vulnerable to backdoor poisoning, yet existing defenses typically rely on rule-based approaches t

From Classification to Localization and Clinical Validation: Large-Scale Development of a Deep Learning System for Thoracic Disease Detection on Chest Radiographs in Thailand

arXiv:2607.09305v2 Announce Type: replace-cross Abstract: Chest radiography (CXR) remains the most widely used thoracic imaging modality, yet expert interpretation is constrained by a severe shortage

Generalized Least Squares Kernelized Tensor Factorization

arXiv:2412.07041v4 Announce Type: replace-cross Abstract: Recovering incomplete multidimensional tensor-structured data is a fundamental task in many real-world applications. Smoothness-constrained lo

GeoTrace: Geometry-Aware Trajectory Token Compression for Video Large Language Models

arXiv:2607.09080v2 Announce Type: replace Abstract: Although Video Large Language Models (Video LLMs) have shown strong performance in video understanding, their efficiency is still limited by the lar

Glass Surface Detection: Leveraging Reflection Dynamics in Flash/No-flash Imagery

arXiv:2511.16887v5 Announce Type: replace Abstract: Glass surfaces are ubiquitous in daily life, typically appearing colorless, transparent, and lacking distinctive features. These characteristics mak

I Made a Local Huggingface On My NAS

https://preview.redd.it/u8alj38wr0fh1.png?width=1860&format=png&auto=webp&s=3578776c60d9548a135a018702f44d0fddedd4b0 Little side project I'm doing so I can easily transfer any model I want fast to my

I run GLM-4.5-Air (110B) on 16Gb ram consumer machine and Qwen3-30B at 20 tok/s

In the past few months I’ve experimenting heavily and tortured my old 2016 Desktop PC to run the biggest Local LLM I can fit. I documented the whole process and research and I’ve published a repositor

IMMoE: Incomplete Multi-View Anomaly Detection via Mixture of View Experts Fusion

arXiv:2607.19032v1 Announce Type: new Abstract: Existing Multi-view Anomaly Detection (MAD) methods assume that all views are completely available and model each view separately. However, in real indu

In-the-Flow Agentic System Optimization for Effective Planning and Tool Use

arXiv:2510.05592v2 Announce Type: replace Abstract: Outcome-driven reinforcement learning has advanced reasoning in large language models (LLMs), but prevailing tool-augmented approaches train a singl

Interesting reasoning by phi4-mini-reasoning

https://preview.redd.it/joxxvyzhf1fh1.png?width=2386&format=png&auto=webp&s=a55c09d11eb080b83d3b66b59013a09118913c9d Freshly installed, just asked it 'who are you'. Why does this happen? 😄 submitted b

Koopman Dreamer: Spectrally Constrained Latent Dynamics for Stable World-Model Imagination

arXiv:2607.19719v1 Announce Type: new Abstract: Latent world models improve sample efficiency in continuous control by optimizing policies over imagined latent trajectories, but common neural transiti

LaSEr-Edit: Localized Span-level Error Editing with Energy-based Localization

arXiv:2407.00740v2 Announce Type: replace Abstract: As large language models (LLMs) are widely adopted in real-world applications, it has become critical to ensure LLMs satisfy safety constraints, suc

local-aiarxiv-cs-cl

LAVIFT: Latent-Action-Guided Vision Fine-Tuning for Surgical Interaction Recognition

arXiv:2607.19889v1 Announce Type: new Abstract: Understanding instrument-tissue interactions is essential for context-aware surgical AI and autonomous robotic surgery. Pretrained vision-language model

Lipschitzian SLLNs for random functions

arXiv:2607.20411v1 Announce Type: cross Abstract: We prove strong laws of large numbers for locally Lipschitz functions in the Lipschitz pseudometric. Our results hold under either a topological or a

Local Stability and Gaussian Smoothing of Quantized Neural Networks

arXiv:2607.20153v1 Announce Type: new Abstract: We study Gaussian averaging as a smooth surrogate for quantized neural models. Under bounded local oscillation, we derive a local dimension-dependent bo

Look Before You Edit: Attention-Guided Camera Placement and Multi-View Alignment for 3D Gaussian Splatting Editing

arXiv:2607.19777v1 Announce Type: new Abstract: Text-driven 3D scene editing with 3D Gaussian Splatting (3DGS) typically applies a 2D diffusion editor to views rendered from fixed training cameras, li

MoGe-3: Fine-Detail Monocular Geometry Estimation with Self-Guided Sparse Volumetric Refinement

arXiv:2607.17967v2 Announce Type: replace Abstract: Monocular geometry estimation has recently achieved impressive performance across diverse scenes. However, state-of-the-art models still face notabl

NVIDIA AI Supercomputer Comes Online at Naval Postgraduate School

NVIDIA founder and CEO Jensen Huang today visited the Naval Postgraduate School in Monterey, California, to commission an NVIDIA DGX GB300 system — bringing one of the world’s most powerful AI platfor

local-ainvidia-blog