local ai

Intern-S2-397B (multimodal, reasoning, coding, and scientific agent capabilities)

Model: https://huggingface.co/internlm/Intern-S2-397B Collection: https://huggingface.co/collections/internlm/intern-s2 From Intern Large Models on 𝕏: https://x.com/intern_lm/status/209942518458737097

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

Is there a better small model than Qwen3.5 4B for a fast local AI assistant?

DGX agent

I'm currently using Qwen3.5 4B as the brain of my local AI assistant because my hardware is relatively limited. One thing I really like about it is the speed. On my system, I'm getting around 40–50 to

local-air-localllama

14 Sept 2026

LG-PF: Lightweight Confidence-Guided Polarization Image Fusion

arXiv:2609.12787v1 Announce Type: new Abstract: Polarization image fusion combines the stable luminance and structural information of the total- intensity image S0 with the material-sensitive details

Nvidia announces the RTX Pro 5500 Blackwell Workstation Edition, offering comparable specs to the RTX 5090 but with 84GB of GDDR7 memory, vs. RTX 5090's 32GB (Zhiye Liu/Tom's Hardware)

Zhiye Liu / Tom's Hardware: Nvidia announces the RTX Pro 5500 Blackwell Workstation Edition, offering comparable specs to the RTX 5090 but with 84GB of GDDR7 memory, vs. RTX 5090's 32GB — The GeForce

local-aitechmeme

On-Device Language Models for Privacy-Preserving Stress Prediction: A Multimodal Evaluation on Mobile Health

arXiv:2609.11961v1 Announce Type: new Abstract: Stress is a pervasive determinant of mental health and a key target for mobile health interventions. On-device language models (ODLMs) offer privacy-pre

One Simple Trick for Improving the Performance of Energy-Limited Local Inference and Training

arXiv:2609.11936v1 Announce Type: cross Abstract: Energy supply and heat dissipation are two of the main challenges with modern GPU deployments. While typically discussed in the context of new datacen

[P] Built a 100% Client-Side Vision Pipeline for Real-Time Chessboard & Multi-Board Detection (Chrome/Firefox Extension) [P]

local-air-machinelearning

Hi everyone, Inspired by tools like Chessvision.ai, I wanted to take a different architectural approach and build a browser extension (ChessInsights AI) that performs chessboard detection and piece re

Perplexity Portable Computer Is Now Available on Windows, Powered by NVIDIA RTX

As local models become more capable, AI agents can handle more work directly on a PC while keeping sensitive information on the device. Portable Computer is a local version of the agent Perplexity Com

local-ainvidia-blog

R9V Update: now ~100 tok/s in TG on Qwen3.8 Flash Next IQ4_XS on x2 R9700 + 128GB RAM. Fixed crashes with n-gram SSD streaming, improved diagnostics, plus pinned images. Q4_K_XL now supported, 50 tok/s TG.

Pushed out this new update, hopefully decreases the instances of crashes. I torture tested this one for ~12 hours after my fixes and found no instability. Q4 K XL needs more fine tuning, which I will

RefMods - A little easier to create, edit, and use with Fantastic Minimax H3 Promptbuilder

local-air-stablediffusion

Repo here- https://github.com/Adudeguyman/ComfyUI-Fantastic-MiniMaxH3-PromptBuilder Alrighty, back again with an update to my (manual, no LLM connected) Fantastic MiniMax H3 Prompt Builder. Yeah it's

Space as an Interventional Invariant: Cross-Modal Predictive Geometry for Stratified Cities and Em-Spaced Intelligence

arXiv:2609.11959v1 Announce Type: cross Abstract: Space is a foundational concept across mathematics, physics, spatial cognition, urban science, and embodied intelligence, yet these fields often treat

local-aiarxiv-cs-cl

The Battery Price of edge AI: A study of the Environmental Impact of LLM Inference on Mobile Devices

arXiv:2609.11940v1 Announce Type: cross Abstract: The rapid diffusion of generative artificial intelligence raises privacy, latency, and performance concerns that motivate a shift toward 'local-first'

Trajectory Bundle Method in SE(3) for Black-Box Fixed-Wing Aircraft Trajectory Optimization

arXiv:2609.12248v1 Announce Type: new Abstract: Dynamically feasible trajectory optimization for rigid-body systems is naturally formulated on the special Euclidean group SE(3) but is challenging when

local-aiarxiv-cs-ro

v0.34.1-rc0: MLX: version bump (#18235)

**Release:** `v0.34.1‑rc0` (release candidate). **Repository:** `ollama/ollama`. **Key changes:** The release bumps the MLX library version, adds support for `ModelOpt` global scales in Mixture-of-Exp

local-aiollama-releases

What are the current best retail GPUs for max VRAM at a reasonable price?

I am considering dumping my ChatGPT Plus subscription and go full local, but to do so I would first need to reach a decent result for quality (and reasonable speed). My 4090 fried itself out of nowher

3k$ 128GB VRAM + 256GB RAM DDR4 Server

I finished my home inference server. First I tried Lenovo p620 workstation and while it’s a good value overall it pissed me off with a ton of proprietary Lenovo shit to deal with and I return it in th

Are there any experimental small models (9B or less) which are out or currently being trained using engram/n-grams?

Not sure if anyone out there is working on this, don't see any on huggingface to try out. It might be too new at the moment, but it would be cool to see the difference between a tiny model trained wit

DS 4.1 and the new Harness

I gave DS V4.1 Flash an HLE problem with a bash tool + 2 hours. Hour 1: it wrote three MILP solvers. (225,200) Hour 2: it downloaded the HLE dataset from Hugging Face, found the question, read the ans

internlm/Intern-S2 · Hugging Face

from internlm: We introduce Intern-S2-397B, our most capable multimodal foundation model for scientific intelligence and long-horizon agents. Intern-S2-397B scales along three critical dimensions: pre

Many concerns this weekend about slowing down AI, some targeting open models. We need to be responsible. But we can't let this slow down, or…

Many concerns this weekend about slowing down AI, some targeting open models. We need to be responsible. But we can't let this slow down, or worse, prohibit open models. It's the wrong risk. Open mode

Rumik OSS 1 - 3B parameters TTS model focused on Indian Languages

local-air-stablediffusion

Just stumbled upon this. Seems to be a new 3B TTS model mainly focused on Indian languages (22 Indic languages + English). Apparently supports code-switching, romanized text, emotion/delivery control

Small models are truly capable of the majority of conversational use cases and even a majority of difficult reasoning ones. Amazing work @Av…

Small models are truly capable of the majority of conversational use cases and even a majority of difficult reasoning ones. Amazing work @Avanika15 @JonSaadFalcon + team and great feature in @FT ! dre

Swarm inference AI

I’m developing this https://swarm.dafonet.com If someone want to collaborate? I’m looking for people with capabilities to test it in different infraestructures. Best regards Gabriel Giani submitted by

TaoMate H3 3 Step LoRA now working in ComfyUI

local-air-stablediffusion

For anyone using MiniMax H3 in ComfyUI I made the official TaoMate H3 3 Step LoRA available in a ComfyUI compatible safetensors format. No retraining, no merge, no extra fine tuning. The model itself

2×RTX 3090 + EPYC box running qwen3.8-flash-next at ~38 tok/s

What I have: - CPU: EPYC 7551 (32c/64T, Zen 1) - Board: Supermicro H11SSL-i (SP3), Rev 2.0 - RAM: 128 GB DDR4-2133 (all 8 channels full) - GPU: 2x RTX 3090 (48 GB total, PCIe 3.0) - 1500 W PSU What I

Amp users can now use Ollama's cloud models with Amp's new BYOK model routing. No limits or fees for BYOK. Build remote agents, controllable…

Amp users can now use Ollama's cloud models with Amp's new BYOK model routing. No limits or fees for BYOK. Build remote agents, controllable from everywhere! Amp is now free to use when you bring your

bartowski/Qwen3.8-27B-GGUF · Hugging Face - Updated (Per-tensor layout)

Blog Post : Per-tensor layout maps for GGUF quantization Reddit thread : New tensor type layouts for my GGUF uploads EDIT : Model card has updated things such as Graph, table, text, etc., submitted by

Beyond Confidence: Stability-Aware Test-Time Adaptation for LLM Reasoning

arXiv:2609.11393v1 Announce Type: new Abstract: Test-time adaptation has emerged as a lightweight alternative to costly post-training for improving the reasoning capabilities of Large Language Models

Can Edge-Deployable Vision-Language Models Identify Species?

arXiv:2609.11916v1 Announce Type: new Abstract: Camera traps often run in the field on edge hardware with limited or no connectivity, making small, locally-deployable vision-language models (VLMs) --

Can someone point me in the right direction of what model(s) to look at for a newer user?

I have a full M5 Pro Macbook Pro with 48GB of RAM, I'm just getting into this local space. Like many of you, the costs of using frontier/cloud models is getting kinda silly. I don't have any insane ne

Demystifying the Privacy-Utility Trade-off in LLM Interactions

arXiv:2609.10992v1 Announce Type: new Abstract: The integration of Large Language Models into daily tasks relies on context-rich instructions, inevitably exposing sensitive user information. Current p

Engineering teacher hoping to ditch ChatGPT premium

I'm a teacher looking into running an LLM locally. I've been using ChatGPT for a lot of this work, so I started looking at Ollama because I understand it's designed to run LLMs locally. That said, I'm

Exploring Multimodal Prompt for Visualization Authoring with Large Language Models

arXiv:2504.13700v2 Announce Type: replace-cross Abstract: Recent advances in large language models (LLMs) have shown great potential in automating the process of visualization authoring through simple

I built a Firefox extension that translates Netflix subtitles locally with Ollama

I recently moved to Japan and ran into an issue where a lot of anime on Netflix only has Japanese subtitles here. I wanted something similar to the subtitle translation extensions that already exist,

Physics-Informed Neural Networks to Infer the Perpendicular Energy Conductivity in the Scrape-Off Layer of Stellarator Devices

arXiv:2609.11628v1 Announce Type: cross Abstract: In this work, we develop an inverse Physics-Informed Neural Network (PINN) framework to infer the dependence of the scrape-off layer (SOL) perpendicul

tencent/AuK-Flash · Hugging Face

AuK-Flash: Fast 4-Step Speech Generation and Editing arXiv : https://arxiv.org/abs/2609.08936 Full Paper : https://arxiv.org/pdf/2609.08936 GitHub : https://github.com/Tencent-Hunyuan/AuK Project : ht

A Dynamic Toolkit for Transmission Characteristics of Precision Reducers with Explicit Contact Geometry

arXiv:2604.02387v3 Announce Type: replace Abstract: Precision reducers couple contact geometry, bearing support, structural deformation, and loading history. This paper presents a dynamic toolkit conn

local-aiarxiv-cs-ro

AgentHijack: Visual Patch Attacks on Multimodal Computer-Use Agents

arXiv:2609.09212v1 Announce Type: cross Abstract: This paper presents an end-to-end evaluation framework for image-triggered command injection against computer-use agents (CUAs). The goal is to test w

Anyone else getting insane billing for glm flash?

I tried GLM flash a few weeks ago and expected the token weekly limits to be comparable to DS flash. For some reason, it was a huge use of my limits. Am I the only one with this issue? I did send a su

Beyond Word Error Rate: A Switch Aware Evaluation of ASR and Audio Language Models on English Yoruba Code-Switched Speech

arXiv:2609.11786v1 Announce Type: new Abstract: Automatic speech recognition (ASR) systems and audio language models (audio LMs) now report low error rates on monolingual benchmarks, but their behavio

local-aiarxiv-cs-cl

Bidirectional Multimodal Fusion of Sky Images and Time-Series for Solar Forecasting with Large Language Models

arXiv:2609.11135v1 Announce Type: new Abstract: Short-term photovoltaic (PV) power and global horizontal irradiance (GHI) forecasts are essential for effective dispatch, reserve scheduling, and grid o

BruNet: A Cross-Domain Transfer Framework for Bruise Segmentation

arXiv:2609.11463v1 Announce Type: new Abstract: Segmenting bruises is a challenging task in medical imaging due to limited data and annotations, diffuse boundaries, and highly variable appearance. In

CEM-TUDASR: Computationally efficient multi-modality transformer based unsupervised domain adaptive super-resolution approach

arXiv:2609.11201v1 Announce Type: new Abstract: Wireless Capsule Endoscopy (WCE) enables non-invasive visualization of the gastrointestinal tract, but its miniaturized optics, sensor limitations, and

ChatGPT Desktop (the Codex app) can now be configured to use Ollama models. Download or update to Ollama 0.34 to get started.

ChatGPT Desktop (the Codex app) now supports integration with Ollama models, allowing users to run local LLMs within the application. To utilize this feature, simply download or upgrade to Ollama vers

ContractEval: Query-Conditioned Execution Matching for Procedural Instruction Conformance

arXiv:2609.09458v1 Announce Type: new Abstract: As LLM agents move from answering questions to carrying out procedures, failures can be unwarranted rather than visibly wrong: the final response looks

Cross-Lingual Clinical Annotation Projection as Constrained Text Generation: A Six-Language Study

arXiv:2609.11450v1 Announce Type: new Abstract: Background: To determine whether cross-lingual clinical annotation projection can be formulated as a text-preserving, document-level generative task tha

local-aiarxiv-cs-cl

Customize which models appear in ChatGPT's model selector in settings. Both local and cloud models can be selected.

Ollama offers a feature that lets users customize the list of language models shown in ChatGPT’s model selector within the settings panel. The customization allows inclusion of both locally hosted mod

DINO-Med: A Unified Patch-Based Adaptation Framework for Multi-Modal Medical Image Analysis Applied to Liver Fibrosis Staging

arXiv:2609.11380v1 Announce Type: new Abstract: Adapting natural-image foundation models like DINOv3 to multi-modal medical imaging is challenging due to the significant domain gap between natural col