local ai

out of these two options what will give the best performance?

I am new to this and a week or so ago I setup a local ai box, it is an amd 9950x with 64gb ddr5 6000 ram, 2 rtx 5090s (on motherboard that does pcie gen 5 x8 per card). It is working fine but I have b

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

Outcome-Sensitive Motion Search for Impact-Aware Dexterous Catching

DGX agent

arXiv:2609.29020v1 Announce Type: new Abstract: Skilled humans can catch fast-moving objects softly by coordinating interception, velocity matching, and follow-through to mitigate impact. Learning suc

local-aiarxiv-cs-ro

25 Sept 2026

Paging the Experts: A Reproducible Characterization of Flash-Backed MoE Inference on iPhone

arXiv:2609.29032v1 Announce Type: cross Abstract: Sparse activation reduces mixture-of-experts computation without eliminating the need to store all experts. We present Routide, a Swift/MLX runtime th

PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides

arXiv:2609.29718v1 Announce Type: cross Abstract: Coding agents are beginning to act in the visual world. They now build webpages, GUIs, games, 3D scenes, diagrams, and documents. Success in such visu

PSA for M5Ultra owners running LLMs: set your prefill step to 8192

Prefill step size affects both PP performance and your drafter fetching logits for MTP (affects dflash as well, mlx-vlm needs to be patched slightly to support chunked prefill for dflash). It also nee

PTC-Bias: Phoneme-Level Temporal Competition for Bias Retrieval and Post-Decoding Correction in Speech LLMs

arXiv:2609.28727v1 Announce Type: new Abstract: Contextual biasing improves rare-word recognition in speech large language models (SpeechLLMs), but efficiently exploiting large bias lists remains chal

local-aiarxiv-cs-cl

PUBG Ally: A Conversational Embodied Agent as an AI Teammate

arXiv:2609.29837v1 Announce Type: new Abstract: We introduce PUBG Ally, an embodied agent for PUBG: BATTLEGROUNDS that can reason, act autonomously, and play alongside players as a voice-enabled teamm

Representation World Model: Learning States, Transition and Executable Plans in Representation

arXiv:2609.29171v1 Announce Type: cross Abstract: We propose the Representation World Model (RWM), which learns states, transitions, and executable plans directly in representation space. Unlike exist

ReVNM: Learning-Based Visual Navigation from a Remote Camera

arXiv:2609.28976v1 Announce Type: new Abstract: Visual Navigation Models (VNMs) enable robots to navigate from egocentric visual observations without geometric localization and planning, but long-rang

SAGE: Mitigating Long-Horizon Reasoning Biases via Topological Guidance

arXiv:2609.30192v1 Announce Type: new Abstract: Long-horizon reasoning remains a central challenge for large language models (LLMs) under sparse-reward regimes. We argue that this brittleness arises f

Same Bit Width, Different Outcomes: Post-Training Quantization of Text-to-Speech Across Architectures

arXiv:2609.28974v1 Announce Type: cross Abstract: Post-training quantization (PTQ) reduces the cost of on-device text-to-speech (TTS), but published evaluations cover one system or method. We evaluate

Splash on a 40-core M5 Max: +20% decode by tuning the kernels for your own chip

FYI the engine's default kernel rules were measured on smaller chips (16/20-core M5s and a 32-core M4 Max), so a 40-core M5 Max runs guesses. Splash's repo includes a developer tool, “make tune-kernel

Temporal Gradient Inversion for Private Trajectory Reconstruction in Embodied Reinforcement Learning

arXiv:2609.30258v1 Announce Type: new Abstract: Distributed learning in embodied reinforcement-learning agents offers a degree of privacy by retaining raw sensor data on-device and transmitting only p

The Mechanics of Delta Learning: Target Design for Generalizable Scientific Machine Learning

arXiv:2609.28782v1 Announce Type: new Abstract: In scientific machine learning, Delta-learning trains models on residual errors relative to physical baselines, assuming that more accurate baselines wi

Tired of RAM prices, so I have been pooling spare RAM across old devices to run bigger local models

Been dealing with the same thing a lot of people here probably are - RAM prices keep climbing and buying a single machine with enough memory for the models I actually want to run just isn't realistic

TP-CRIV: A Framework for Third-Party Challenge-Response Identity Verification of AI Models

arXiv:2609.29264v1 Announce Type: cross Abstract: Artificial intelligence (AI) models are increasingly deployed through remote services, making model misappropriation a growing concern. Existing appro

What IDE to use for local models

Hi people, I am looking for a lightweight IDE or plugin that won't inject large context at initiation. I tried Cline and native VS Code but they inject such heavy initial context that it fills up my g

A Non-Invasive Cloud-Based Migration Strategy for Post-Quantum Cybersecurity in Smart HVAC Systems: Architecture, Implementation, and Empirical Evaluation

arXiv:2609.27828v1 Announce Type: cross Abstract: Legacy smart HVAC controllers rely on vendor-cloud TLS secured by ECDH and RSA, both broken by Shor's algorithm, and typical 10-15 year lifespans mean

Agentic Governance and Adversarial Verification for Policy-Constrained LLM Healthcare Appeal Generation

arXiv:2609.27844v1 Announce Type: new Abstract: Claim denial management costs U.S. healthcare approximately $260 billion annually in administrative overhead. Large Language Models (LLMs) and Retrieval

Anchor-Free Hidden-Target Seeking via Certified Self-Calibration under Correlated Odometry

arXiv:2609.27905v1 Announce Type: new Abstract: We study hidden-target seeking in an anchor-free regime where neither the vehicle, the relay, nor the target has an accessible global pose. The vehicle

AnchorReasoning: A Visual Grounding and Causal Reasoning Dataset in Long-Tail Autonomous Driving Scenarios

arXiv:2609.28366v1 Announce Type: cross Abstract: Vision-language models (VLMs) offer a promising approach to long-tail autonomous driving, but existing driving datasets provide limited supervision fo

Beginner question: How to summarize session history instead of sending the entire session JSON to a local Ollama server every time?

Hi. I’m developing my first Python project (been at it a couple weeks). I built a very basic CLI ollama client. When a user sends a prompt I append the message to session['history'], save the sessio

Bridging LLM Serving and CXL-SSDs with Chunk-Aware KV Cache Management

arXiv:2609.26828v1 Announce Type: cross Abstract: NAND-backed storage offers the capacity needed to scale LLM prefix caching, but its block I/O path incurs CPU cache contention and host-DRAM staging i

BronchoTop: Bronchoscopy Navigation via RGB-Only Topological Localization

arXiv:2609.28328v1 Announce Type: new Abstract: Accurate localization of the bronchoscope within the bronchial tree is essential for clinicians to be able to reach target lesions, perform biopsies and

Closed model, open model, or train your own? 📅 Wed, Oct 7 🕐 5 PM 📍 San Francisco At our next AI Talk, Crusoe’s @ErwanM94707 joins @ollama…

Closed model, open model, or train your own? 📅 Wed, Oct 7 🕐 5 PM 📍 San Francisco At our next AI Talk, Crusoe’s @ErwanM94707 joins @ollama's @jmorgan and @trajectorylabs's @MichaelElabd to explore this

local-aiollama--x

Collocated Shape Regulation for Soft Robots

arXiv:2609.27469v1 Announce Type: new Abstract: Controlling the shape of a continuum soft robot typically requires an accurate dynamic model and actuation of all degrees of freedom. We show that regul

Compliant with Local Controls, Collectively Discriminatory. A Governance Architecture for Multi-Agent AI in Regulated Finance

arXiv:2609.27994v1 Announce Type: cross Abstract: Financial institutions are beginning to deploy agentic workflows in credit, fraud, collections, compliance, and operational control. Governance remain

Contact-Implicit Stein Projected ADMM for Discovery of Diverse Contact-Rich Manipulation Strategies

arXiv:2609.28299v1 Announce Type: new Abstract: Contact-implicit trajectory optimization formulates contact-rich manipulation as a single constrained program; however, that single program run collapse

Controlling Collectives of AI Agents in Reasoning Space with Spatial Transformers

arXiv:2609.28247v1 Announce Type: cross Abstract: Large Language Models (LLMs) introduce an exciting new paradigm for planning and navigation in robotics, but fail on even simple multi-robot tasks as

DAVIO: Dense Monocular-Inertial SLAM with Feed-Forward Initialization and Pose-Conditioned Mapping

arXiv:2609.27702v1 Announce Type: cross Abstract: A camera and an IMU are the minimal sensor setup for metric localization and dense mapping, yet classical visual--inertial filters must wait for paral

DEAL-Grasp: Decoupled Alignment Representation for Geometry-Aware Dexterous Grasp Generation

arXiv:2609.28131v1 Announce Type: new Abstract: Synthesizing realistic articulated hand-object interactions is a fundamental problem in virtual reality, embodied intelligence, and digital human applic

EMA: Elastic and Performance Transparent Memory Across GPUs

arXiv:2609.27040v1 Announce Type: cross Abstract: Multi-GPU servers have become the standard building block of modern data centers, providing aggregated capacity through high-bandwidth interconnects.

Energy-guided Recursive Model

arXiv:2607.10128v3 Announce Type: replace Abstract: Recursive models show promise on reasoning and language tasks, yet their test-time scaling lacks a principled criterion for selecting trajectories o

From greenhouse climate to individual leaves: an organ-resolved model of lettuce growth

arXiv:2609.27118v1 Announce Type: new Abstract: Greenhouse climate management aims to improve crop production while limiting energy use. This requires knowing how a crop will respond before conditions

Fusion-Aware Direct 3D Gaussian Generation with Structured Patch Latent Flows

arXiv:2609.27779v1 Announce Type: new Abstract: Class-guided 3D object generation is important for intelligent content creation, virtual environments, and digital asset design. Although 3D Gaussian Sp

GeoRVQ: Decoder-aware geometry for residual-token prediction in physiological signals

arXiv:2609.27018v1 Announce Type: new Abstract: Residual vector quantization (RVQ) turns physiological waveforms into compact token sequences, but conventional masked modeling treats every incorrect t

Giving Credit Where It's Due: Redundancy-Aware Learning for Efficient Reasoning

arXiv:2609.27156v1 Announce Type: new Abstract: Large reasoning models can produce correct yet unnecessarily long reasoning traces. Existing methods improve reasoning efficiency with trajectory-level

local-aiarxiv-cs-cl

GLoTouch: Global-to-Local Haptic Perception Using a Parallel Gripper for Object Search, Recognition, and Grasping Without External Vision

arXiv:2609.27695v1 Announce Type: new Abstract: Perceiving objects in the environment is a fundamental capability of autonomous robots. In dark or low-light environments, external cameras often fail t

Home Server Help.

Hi - I want to build a home server for Ollama. I want to connect to the server via my laptop and mobile devices to do research and run agents. What is recommended to get this going ? submitted by /u/R

I built a presentation generator that works with Ollama — would love some feedback

Hey r/Ollama, I've been working on Presentation Forge, an open-source presentation/report generator that supports Ollama for local inference. I originally made it because I'm a university student and

I built an air-gapped, local-first synthetic data generator powered by Ollama

Hey everyone, A major issue when building test environments or fine-tuning pipelines is balancing data realism with privacy. Pasting real internal/client data into cloud endpoints is a massive complia

I made a lightweight UI for searching Ollama Models

I was having trouble searching and analyzing the different models that Ollama has available ( https://ollama.com/library ). I wanted to filter for specific model sizes and tooling capabilities, so I b

Improving Ensemble Filters with Flow Matching

arXiv:2609.28015v1 Announce Type: cross Abstract: Data assimilation estimates a dynamical state from partial and noisy observations. Classical ensemble filters are efficient but restrict analysis upda

Introducing GKE agentic migration for AI-assisted EKS-to-GKE migrations with built-in governance

Enterprises are increasingly standardizing on Google Kubernetes Engine (GKE) to run their most critical and AI-driven workloads. From Cloud Storage FUSE for high-throughput data access to custom compu

local-aigoogle-cloud-ai

Just trained Tev1 0.8B, a tiny Jev-like classifier. Here it is running completely locally on my mac with @ollama & classifying some tasks. I…

Just trained Tev1 0.8B, a tiny Jev-like classifier. Here it is running completely locally on my mac with @ollama & classifying some tasks. It's extremely fast: only ~50ms E2E latency. Video is not spe

local-aitogether-ai--x

Know-Your-Scene (KYS)-SLAM: Hierarchical Semantic-Motion Priors for Feature Matching in Stereo Visual SLAM

arXiv:2609.27509v1 Announce Type: new Abstract: Stereo visual SLAM systems built on local descriptors suffer from semantic ambiguity, instance-level confusion, and independently moving objects, each c

LAYERSCOPE: A Layerwise Characterization of Video and Multimodal Learned Representations

arXiv:2609.28086v1 Announce Type: cross Abstract: We propose LAYERSCOPE, a label-free, layerwise framework that aims to characterize a model's learned representations in video and multimodal settings.

Local AI beyond just running the model

I’ve been experimenting with local AI lately, and one thing I’m finding interesting is what comes after getting a model running. Ollama makes local model access pretty straightforward, but for an actu