local ai

For those of us running Ollama on whatever hardware we already have: r/LowEndLocalAI

One of the things I like most about Ollama is how low it makes the barrier to experimenting with local models. The downside is that once you move away from high-end hardware, finding the right informa

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

FourierSampler: Unlocking Non-Autoregressive Potential in Diffusion Language Models via Frequency-Guided Generation

DGX agent

arXiv:2601.23182v2 Announce Type: replace Abstract: Despite the non-autoregressive potential of diffusion language models (dLLMs), existing decoding strategies demonstrate positional bias, failing to

local-aiarxiv-cs-cl

25 Aug 2026

FrugalSOT - Frugal Search Over the Models

arXiv:2608.21621v1 Announce Type: new Abstract: In on-device NLP tasks, limited resources of embedded hardware, such as the Raspberry Pi 5, require efficient inference strategies. This paper introduce

GCA: Global Centroid Alignment in Federated Learning

arXiv:2608.22593v1 Announce Type: new Abstract: Autoencoder (AE)-based federated learning (FL) is attractive for anomaly detection when clients have limited local data. However, conventional FL exchan

GenCoord: Skill-Path Commitments under Private Information

arXiv:2608.22055v1 Announce Type: new Abstract: Suppose one embodied agent knows what must be built, while its teammate alone knows which transformation its workcell can perform. Neither local view de

GeoQ: Geometry-Aware Conditional Quantile Error Estimation for Scientific Surrogate Models

arXiv:2608.21652v1 Announce Type: new Abstract: Neural-network surrogate models are increasingly used to accelerate scientific simulations, but their deployment in extrapolative and autoregressive set

Grounding Isn't Knowing: Do VLMs Need Object Localization for Spatial Reasoning?

arXiv:2608.23074v1 Announce Type: new Abstract: Vision-language models (VLMs) can answer spatial questions, yet the mechanisms connecting object grounding to spatial reasoning remain poorly understood

GuidedFlow: An Attention-Guided Framework for Anomaly Detection in Additive Manufacturing

arXiv:2608.22789v1 Announce Type: new Abstract: Additive Manufacturing (AM) plays a vital role in the ongoing industrial revolution. However, quality control remains crucial and challenging due to pri

Headlong: An open source agent microharness featuring persistent agency and recursive LLMs

An RLM agent microharness that 'persistently' thinks continuously. What could go wrong :) Introducing Headlong, an open source microharness for persistent agents: self-guided agents that think continu

HiMA-MDD: A Hierarchical Multi-Agent Harness for Interpretable Multimodal Depression Detection in Clinical Interviews

arXiv:2608.21868v1 Announce Type: new Abstract: Depression assessment from multimodal clinical interviews requires integrating dispersed evidence from multiple symptoms into a coherent PHQ-8 profile.

How many of you are using Kiwix/offline Wikipedia for training?

We are seeing every so often people mentioning using Kiwix or offline Wikipedia for training. It is not something Kiwix is actively involved in (as in, people found us rather than the other way around

How to run LLMs as regular guy with low resources?

Hello everyone. I hope is all well with you all. I been around this sub for a few months and been quietly reading and I have seen how many of you are spending $10k on the Mac M5 and I am assuming you

Improving an ollama model with rag and raft

Building a local AI agent hierarchy on a budget — RAG, quantization, and testing whether fact-grounding pushes small models toward real creativity I don't have a CS background, a GPU, or much of a bud

LakeHopper: Knowledge-Aware Adaptation of Column Type Annotators across Data Lakes

arXiv:2602.08793v2 Announce Type: replace Abstract: Column Type Annotation (CTA), which assigns a semantic type to a table column, underpins data integration, cleaning, and search over data lakes. Sta

local-aiarxiv-cs-cl

Leveraging Remote Traffic Data for Local Air Pollutant Estimation: A Scenario-Based Machine Learning Study Across London Monitoring Sites

arXiv:2608.23219v1 Announce Type: new Abstract: Vehicular traffic is a major source of air pollution; however, the contribution of remotely acquired traffic information to local machine-learning (ML)

Macro-Action Topological Navigation under Noisy Localization using Reinforcement Learning

arXiv:2608.23055v1 Announce Type: new Abstract: Navigating large, photorealistic 3D apartments from raw pixels is widely considered infeasible for plain reinforcement learning. We build an agent that

Method not allowed error

For some reason I can only use Ollama through home wi-fi, everytime I try to use it while using my phone as a modem I get an error. Vpn doesn't help. Edit: problem fixed, works perfectly if VPN is in

Minimal Local Simulation Foundations for LLM- and VLM-Driven Agents in 2D and 3D Environments

arXiv:2608.22833v1 Announce Type: cross Abstract: Large language models (LLMs) and vision-language models (VLMs) are expanding the range of behaviors that can be represented in agent-based simulations

Misanthrope: A Privacy-Preserving Keypoint Detector

arXiv:2608.23012v1 Announce Type: new Abstract: Image matching is a core component of applications such as Simultaneous Localization and Mapping (SLAM), Visual Localization, and Structure from Motion

Mode Seeking meets Mean Seeking for Fast Long Video Generation

arXiv:2602.24289v2 Announce Type: replace Abstract: Scaling video generation from seconds to minutes faces a critical bottleneck: while short-video data is abundant and high-fidelity, coherent long-fo

More Accurate or More Efficient? Evaluating Locally Deployed Compact Open-Weight Language Models for Mathematical Reasoning

arXiv:2608.22048v1 Announce Type: new Abstract: Large language models are increasingly deployed on local hardware for privacy, cost, and accessibility reasons. Yet many evaluations emphasize accuracy

Nvidia NemoClaw flaw let attackers poison the model behind a developer’s AI agent

Researchers at nonhuman identity security company Oasis Security Ltd. today disclosed a vulnerability in Nvidia Corp.’s NemoClaw that hands an attacker full control of the local model server powering

local-aisiliconangle

Nvidia unveils the Jetson Orin Nano 2 edge AI computer that it says doubles inference performance, with 78 TOPS of AI compute and an eight-core Arm CPU (Eugene Demaitre/The Robot Report)

Eugene Demaitre / The Robot Report: Nvidia unveils the Jetson Orin Nano 2 edge AI computer that it says doubles inference performance, with 78 TOPS of AI compute and an eight-core Arm CPU — As AI mode

local-aitechmeme

Obstacle Avoidance of UAV in Dynamic Environments Using Direction and Velocity-Adaptive Artificial Potential Field

arXiv:2512.07609v3 Announce Type: replace-cross Abstract: The conventional Artificial Potential Field (APF) is fundamentally limited by the local minima issue and its inability to account for the kine

local-aiarxiv-cs-ro

One Inverse Step is a Convex Program: Bayes-Limit Calibration of Diffusion Inversion

arXiv:2608.23094v1 Announce Type: cross Abstract: One implicit DDIM inversion step is the cheapest probe of whether a pretrained diffusion model encodes local manifold geometry. It is the stationarity

Operational digital twin clinics enable task-based evaluation of embodied AI

arXiv:2608.21416v1 Announce Type: cross Abstract: Embodied artificial intelligence (AI) must be tested in the clinical environments where it will operate, but building realistic, robot-testable settin

OptiSight: Bridging Semantic Reasoning and Geometric Control for Embodied Navigation

arXiv:2608.23354v1 Announce Type: cross Abstract: Autonomous indoor navigation requires both semantic understanding and precise geometric control. We propose OptiSight, a hybrid framework that combine

Ornith1.5-9B uncensored doesn't work

Pretty simple, I tried almost anything I could find with Q4K_M and it refused any harmful test prompt I could find, does anyone know a decent versione/how fo make It work? submitted by /u/circumcised_

PatchWrite: One Line, Not One Section -- Compile-Gated, Validity-Preserving Editing for AI-Drafted Manuscripts

arXiv:2608.23001v1 Announce Type: new Abstract: Automated manuscript pipelines often regenerate an entire section to repair a local defect, allowing unrelated metrics and citations to change even when

PEAfowl: Perception-Enhanced Multi-View Vision-Language-Action for Bimanual Manipulation

arXiv:2601.17885v2 Announce Type: replace-cross Abstract: Bimanual manipulation in cluttered scenes requires policies that remain stable under occlusions, viewpoint changes and scene variations. Exist

Portable Computer is available today for all Perplexity Pro and Max subscribers with an @NVIDIA DGX Spark. Get started: https://www.perplexi…

Perplexity AI announced on August 25 2026 the launch of a “Portable Computer” feature, available immediately to all Perplexity Pro and Max subscribers who are using NVIDIA’s DGX Spark hardware. The se

local-aiperplexity--x

Programmable k-local Ising interactions and shallow optical Kolmogorov--Arnold networks through repeated data encounters

arXiv:2508.17440v3 Announce Type: replace-cross Abstract: Photonic processors are naturally suited to linear transformations, but independently programmable higher-order interactions usually require n

ProxyFormer: A Dual-Stream Proxy Architecture for Ultra-Long Context and High-Resolution Generation

arXiv:2608.23463v1 Announce Type: new Abstract: The quadratic growth of attention computation and key-value (KV) cache with respect to sequence length is a central bottleneck for ultra-long-context la

Read, Write, Relax: Why Neural PDE Surrogates Need Both Global and Local Processing

arXiv:2608.21677v1 Announce Type: cross Abstract: Recent mesh-based simulation advances have, in no small part, relied on neural surrogates of two distinct families: global models that route informati

Recovering Weighted Tangent Geometry from a Single-Scale Score Field

arXiv:2608.22334v1 Announce Type: cross Abstract: Near a smooth data manifold, one tangent space summarizes local geometry. At a branch point, the corresponding first-order object is instead a measure

Residual-based attention in physics-informed neural networks

arXiv:2307.00379v2 Announce Type: replace Abstract: Driven by the need for more efficient and seamless integration of physical models and data, physics-informed neural networks (PINNs) have seen a sur

RiskWorld: Object-Centric Latent World Modeling for Autonomous Driving Risk Identification

arXiv:2608.21414v1 Announce Type: cross Abstract: Autonomous driving risk identification aims to determine which observed object is likely to become safety-critical to the ego vehicle. Existing approa

Role-Specialized Mixture-of-Agents with Open-Weight LLMs for Clinical Prediction

arXiv:2608.22176v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly applied to clinical prediction tasks such as in-hospital mortality and readmission from electronic health

SAEM: Stage-Aware Expert Management for Memory-Efficient MoE Inference in Chain-of-Thought Reasoning

arXiv:2608.21614v1 Announce Type: new Abstract: Chain-of-thought (CoT) prompting improves LLM reasoning by decomposing complex problems into intermediate steps, but its sequential nature increases dec

SAFE-G: Structure-aware Faithful Evidence-guided Generation for Knowledge-based Visual Question Answering

arXiv:2608.21796v1 Announce Type: cross Abstract: Knowledge-based Visual Question Answering (KB-VQA) aims to answer queries that necessitate reasoning over external knowledge sources beyond the visual

SAGE: Stability-Aware Graph-Based Ensemble Feature Selection for Explainable Postpartum Depression Risk Prediction

arXiv:2608.22809v1 Announce Type: new Abstract: Postpartum depression (PPD) poses a major burden on maternal and child health, especially in low- and middle-income countries where prevalence exceeds 1

Semantic Substrate Dynamics Theory: An Operator-Theoretic Framework for Geometric Semantic Drift

arXiv:2602.18699v2 Announce Type: replace-cross Abstract: Studies of semantic drift report heterogeneous signals, including embedding displacement, neighbor change, distributional divergence, and recu

Significant improvements to Row-Bot recently. Looking for feedback.

v4.5.0: Added native desktop control, agent execution budgets, concurrency limits, loop protection, and safer local embedding fallback. v4.6.0: Rebuilt agents around durable parent-led orchestration.

Small Reasoning Models are Instruction Followers in Function Calling

arXiv:2608.22472v1 Announce Type: new Abstract: Function calling represents the core capability of agentic large language models (LLMs). Existing research has focused on enhancing LLMs function-callin

System access project

I am not a huge fan of AI, but my friends like to joke and say I am torturing computers because I use all sorts of virtual machines, commands, and once split in half a 1000 defective laptop (accident)

tencent/WeMM-Embedding 9B/4B/2B

WeMM-Embedding-9B is a universal multimodal embedding model built on Qwen3.5. It accepts text, images, videos, visual documents, and interleaved multimodal inputs, and returns a 4,096-dimensional L2-n

Today we’re launching Portable Computer on @NVIDIA DGX Spark. Portable Computer is a fully local version of Perplexity Computer, where the e…

Today we’re launching Portable Computer on @NVIDIA DGX Spark. Portable Computer is a fully local version of Perplexity Computer, where the entire runtime: orchestrator LLM, subagent LLM, agent harness

local-aiperplexity--x

Token/s down 50% after upgrade

Upgraded ollama from .32.6 to .32.15 ran a test on my qwen3:30b and it went from 90+ t/s down to 45+t/s System has 4 and v620 pro and one rtx3090 Before it was only using the amd, now it's using all 5