local ai

ItoTTS: two natural English voices in 4.89 MB for a $5 ESP32-S3

Hi everyone! I'm part of the Lokutor team. Last week we presented Oído here, and the response was amazing. We've received dozens of videos and messages from you guys saying you love it. Thank you! Now

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Law And Order: Tax Law Autoformalization

DGX agent

arXiv:2610.02792v1 Announce Type: new Abstract: Legal systems are increasingly implemented through software, yet scalable methods for translating legal texts into accurate symbolic representations rem

local-aiarxiv-cs-ai

5 Oct 2026

Learning Closure of Dynamical Systems with Kernel Ridge Regression

arXiv:2610.02564v1 Announce Type: cross Abstract: We develop a closure modeling framework for identifying missing components of dynamical systems using Kernel Ridge Regression (KRR). The framework add

Learning from Repaired Reasoning: Root-Cause-Guided On-Policy Distillation

arXiv:2610.03515v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) uses reference solutions as privileged hindsight to supervise student-generated reasoning trajectories. However, refe

local-aiarxiv-cs-cl

Less Talk. More Breakout: Kolibri-1 Turns Probabilities into Actions, Playing Breakout - With under 25ms latency per move.

Got Kolibri-1 to play Breakout completely on its own, no fine-tuning. The more we explore u/Aleph__Alpha’s Kolibri the more it get's exciting and its potential. Less talk. More Breakout is one such ex

LiteEMG-FM: An Efficient and Deployable Foundation Model for Robust EMG Sensing

arXiv:2610.02497v1 Announce Type: new Abstract: Electromyography (EMG) signals vary substantially across individuals, body regions, recording sessions, and sensing hardware, limiting the generalizatio

nokia-applied-research/AnyJev: Turn any LLM into a Jev-style decision model

Haven't seen posted here. The research project matters because it proves you can pull trustworthy decisions straight out of an LLM's internal state in a single forward pass (no generation loop, no par

Ollama's local qwen3.5:9b as Copilot CLI agent

I wanted to test how well local models perform in agentic development with Copilot CLI. I started ollama launch copilot --model qwen3.5:9b. I gave it simple instruction in autopilot mode to create a f

local-air-ollama

On-Board Anomaly Detection for Efficient Marine Environmental Monitoring

arXiv:2610.03649v1 Announce Type: cross Abstract: Marine ecosystems are impacted by various threats such as oil spills, algal blooms, and sediment floods, which disrupt habitats, wildlife, and human a

On-Premises Multi-Course RAG Tutoring for Business Education: Hardware-Software Trade-offs in a Campus AI Tutor

arXiv:2610.02510v1 Announce Type: new Abstract: Campus AI tutors based on retrieval-augmented generation (RAG) must ground answers in assigned course materials while keeping textbooks and student dial

PewDiePie getting banned twice by OpenAI while making a local model is top-tier comedy 💀

So PewDiePie decides to fine-tune a local AI model called Ajax on his own computer. Pretty normal stuff for local model fans. To make his dataset, he uses OpenAI's API. OpenAI catches him using their

RIPPLE in Still Water: Zero-Shot Clustering in Federated Learning with Wavelet Scattering Transform

arXiv:2610.03054v1 Announce Type: new Abstract: Clustered Federated Learning (FL) partitions a client population into groups of similar local distributions and trains one specialized model per cluster

Scale-Recursive Rectified Flows for Few-Step Precipitation Ensembles

arXiv:2610.02611v1 Announce Type: cross Abstract: Fine-resolution precipitation estimates support flood risk assessment and water management, but coarse satellite products cannot resolve rainfall with

SideKernel: A Usable microVM Sandbox for AI Coding Agents on macOS

arXiv:2610.02456v1 Announce Type: cross Abstract: AI coding agents are untrusted system components, yet they require autonomy on the developer machines they run on. This contradiction is a security pr

T3lescope: Arbitrary-Resolution High-Fidelity Generative Surface Reconstruction from Images

arXiv:2610.03308v1 Announce Type: new Abstract: We reconstruct high-fidelity 3D scene meshes from posed multi-view images without per-scene optimization, across scales ranging from single objects to l

Text-Centric Post-Training for Omni-Modal Reasoning

arXiv:2610.02819v1 Announce Type: new Abstract: Improving joint audio-visual reasoning in Omni Large Language Models typically incurs substantial data construction and training costs. Our diagnostics

local-aiarxiv-cs-cl

When Does Synthetic Relational Data Teach Models to Use Relations? Tracing Predictive Structure from Pretraining Data to Model Behavior

arXiv:2610.03057v1 Announce Type: new Abstract: Relational foundation models are increasingly pretrained on synthetic databases, yet downstream benchmarks reveal little about why one synthetic corpus

World-Calibrated Proposal-to-Action Flow for Vision-Language-Action Models

arXiv:2610.02323v1 Announce Type: cross Abstract: Flow-based Vision-Language-Action (VLA) policies generate action chunks by transporting samples from a task-agnostic isotropic Gaussian source. As thi

Writerslogic at PAN 2026: Process over Content for Robust Detection under Domain Shift

arXiv:2610.03565v1 Announce Type: new Abstract: We describe the Writerslogic systems for three PAN at CLEF 2026 shared tasks (Reasoning Trajectory Detection, Voight-Kampff Generative AI Detection, and

local-aiarxiv-cs-cl

ZeBROD: Zero-Retraining Based Recognition and Object Detection Framework

arXiv:2512.04888v4 Announce Type: replace Abstract: Object detection constitutes the primary task within the domain of computer vision. It is utilized in numerous domains. Nonetheless, object detectio

Can someone explain how JEV is different from a simple embeddings model?

How is JEV any different from using an embeddings model? I really will appreciate if someone can explain this to me - because I have yet to see the difference. I'll even give you my JEV server for fre

Is Strix Halo (GMKtec EVO-X2, etc.) the closest thing we have to a 'dream' local LLM box?

I've been looking at the <32B model space and keep coming back to an interesting question. A few years ago, projects like Hummingbird+ suggested that cheap custom accelerators (FPGA-based) might becom

Least sycophantic modern open LLM?

So Kimi K2 is outdated, and so is GPT OSS 120b. Which of the modern open weights models can boast the least sycophancy? I need this both for creative/research assistant usage (sycophancy led me down b

Upgrading from 1xR9700 to 2xR9700. Thoughts on build before buying?

Currently have a R9700 build with 64GB RAM. Want to get a second one for both speed and the ability to run Qwen3.8-Flash-Next at Q4/higher quants of 3.8 27B. Looking for thoughts or any improvements b

v0.40.0

What's Changed Models run on MLX on Apple Silicon by default In this release, on Apple Silicon devices, model architectures supported by the MLX runtime will automatically run on MLX. ollama pull qwen

local-aiollama-releases

v0.40.0-rc1: mlx: match publisher tokenizer semantics (#18779)

mlx: match publisher tokenizer semantics Honor pretokenizer stage order, split behavior, Unicode boundaries, added-token normalization, and ranked BPE merges. Handle empty added tokens and empty Metas

local-aiollama-releases

Anyone using a local AI meeting notes setup instead of Fathom?

Meeting notes are one of the last parts of my workflow that still depend heavily on cloud tools. I've used Fathom and lately Bluedot. Bluedot works well for me because there's no meeting bot and I get

Clef Flash: https://ollama.com/library/clef-flash Clef: https://ollama.com/library/clef

Clef Flash (9 billion‑parameter) is a multimodal model hosted on Ollama that converts a given state and a schema of typed questions into actionable decisions. Its counterpart, Clef, is also available

.@Cloudflare's decision models are available on Ollama! Decision models allow you to classify an image, label a bug report or route a suppor…

.@Cloudflare's decision models are available on Ollama! Decision models allow you to classify an image, label a bug report or route a support ticket to the right team. Clef (27B): ollama pull clef Cle

Come let your LLMs play World of Warcraft

I hosted my own world of warcraft private server then built a client that you can play in the browser on PC or mobile at https://jankcraft.xyz/ for free. Afterwards, I created a custom MCP and agent h

I tried building a small RAG search node for Qwen3.8 27B using a fake AliExpress Mini PC... and Intel sent me back to 2018.

I love Qwen3.8 27B so much that I decided to show my gratitude to the Alibaba ecosystem by building a dedicated RAG/search node using a cheap Mini PC from AliExpress. Turns out, my ecosystem loyalty g

mlsubgen — subtitles in 45 languages for your videos, entirely on your own machine

Full disclaimer: I've leaned heavily on Fable to develop this, but I've tested it thoroughly on my own library for a couple of months before putting it on GitHub. I live in Thailand, and it started as

ollama pull clef open models for all. start building with @ollama and @cloudflare clef decision models today

ollama pull clef open models for all. start building with @ollama and @cloudflare clef decision models today .@Cloudflare's decision models are available on Ollama! Decision models allow you to classi

Replacing vector databases with SQLite and SIMD hypervectors in under 1.2GB VRAM (Hillock)

Disclosure: I am the creator of this project. After days of lurking and building up enough karma, I can finally post here. Every time I tried running local RAG on my own machine, I hit the exact same

Sopro V2 Turbo 2610: cleaner cloned voices, same 120M model, same CPU speed

Follow-up to last month's post. One of the main issues people ran into was roughness or break-up on some cloned voices. 2610 is an interim update focused mostly on improving that. Reduced roughness an

The cognitive cost of constantly adapting to ChatGPT is starting to add up : cognitive scientist/PhD student lived experience

I use ChatGPT a lot. Probably a lot more than is reasonable. I read David Robinson’s Atlantic piece today about leaving OpenAI and his criticism of its culture of trial-and-error / “iterative deployme

local-air-chatgpt

The ultimate guide to multi-harness RL

Hi folks, it's Lewis here from the post-training team at Hugging Face. We've been exploring how to train open models in different coding harnesses and wrote up a looong guide on how we solved this usi

Two ~300B MoE models, each on ONE 128 GB mini PC (AMD Strix Halo): GLM-5.3-Flash at ~580 tok/s prefill, MiMo-V2.6-Flash up to 44 tok/s decode. EXL3 weights + open ROCm engine

We built an engine, Kyojin, on top of ExLlamaV3 for Strix Halo (gfx1151, ROCm), and packed two 300B-class MoE models so each fits one 128 GB machine. First release, all measured on Ryzen AI Max+ 395.

3/ @zainhas and @parthsareen (Agents at @ollama) took the breakout stage on evaluating open models against production traffic (not just benc…

AI researchers Zainhas and Parthsareen from Ollama delivered a breakout presentation on October 2, 2026, focusing on evaluating open-source models under real‑world production traffic rather than just

local-aitogether-ai--x

A Framework for Egocentric and Exocentric Procedural Understanding via Temporal Segmentation and Semantic Abstraction

arXiv:2610.00069v1 Announce Type: cross Abstract: Long-horizon ego/exo data contains rich procedural evidence, but are redundant, noisy, and costly to process or retain. We propose a compact framework

Adaptive Conformal Prediction for Image Regression Models with Application to an Inertial Confinement Fusion Emulator

arXiv:2610.00535v1 Announce Type: cross Abstract: Uncertainty quantification is critical in scientific machine learning, where black-box, image-based models are increasingly deployed in high-stakes se

Certainty Is Not Just Correctness: Rethinking Token-Level Certainty in LLM Reasoning

arXiv:2610.00296v1 Announce Type: cross Abstract: Token-level certainty is widely used as a proxy for correctness in LLM training and inference. However, the performance of certainty-based methods dep

Clef Decision Models are now on @ollama

Clef Decision Models are now on @ollama introducing 𝚌𝚕𝚎𝚏: our first models trained by @cloudflare's workers ai team. today, we're releasing two fast and accurate decision models that top the benchmark

CODesign: Consistency from Data to Trajectory in All-Atom Protein Binder Co-Design

arXiv:2610.01773v1 Announce Type: cross Abstract: The central challenge in de novo protein design is generating plausible, mutually compatible structures and sequences, such that each designed sequenc

Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understanding

arXiv:2610.01754v1 Announce Type: cross Abstract: Video Anomaly Detection (VAD) aims to temporally localize abnormal events in videos. Most existing approaches rely on dataset-specific training and cu

Compositional Embedding Architecture for Physical Field Prediction in Componentized Aerospace Systems

arXiv:2610.00237v1 Announce Type: cross Abstract: Spacecraft thermal design requires repeated evaluation of how variations in the number and spatial arrangement of heat-generating components and in th

Counterfactual Auditing of Bias in Open-Source Large Language Models for Clinical Triage

arXiv:2610.01963v1 Announce Type: new Abstract: Emergency department (ED) triage is a high-stakes prioritization task in which demographic, socioeconomic, and system-context information may improperly

Crusoe AI Talks returns to SF. Wed Oct. 7: Join @ollama's @jmorgan and @TrajectoryLabs' @MichaelElabd for a candid conversation with Crusoe'…

Crusoe AI Talks returns to SF. Wed Oct. 7: Join @ollama's @jmorgan and @TrajectoryLabs' @MichaelElabd for a candid conversation with Crusoe's Erwan Menard on how the calculus is shifting as closed and