Search: “local-ai”

i built an all in one app around ollama because my own setup was getting ridiculous

full disclosure, i am the developer of locally uncensored :) i use ollama myself and honestly ollama was never really the problem. the problem was everything around it. one app for local chat, another

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

Massive token savings... Without token usage. GLM-5.2-cloud

DGX agent

Okay, this one seems probably really odd (or maybe not), but most harnesses operate within token spaces. That is, every tool output, even batching of tool outputs, go back up into inference calls. Lea

local-air-ollama

19 Sept 2026

Modello senza limiti

Da un po mi sono ritrovato in garage un hp z840 da 64gb ddr5 montate (ora) e 2 processori con una gpu un po scarsina una nvidia quadro k680 (da aggiornare) avrei bisogno di un consiglio: quale modello

NYX AI, a local-first AI workspace for Windows with AppContainer integration

I’m one of the co-founders of NYX AI. It’s a Windows app that connects to local models through Ollama/lm studio or supported cloud providers, giving AI tools to work with documents, previews, spreadsh

Ollama pricing vs Openrouter

The math don’t math. I’m paying way more on ollama for glm5.3 flash games Han I am on Openrouter. I made 153 requests for 47cents on Openrouter. On ollama it was 147 requests for $1.67. Math dont math

Qwen3.8-27B, up to 144 tok/sec on M5 Max. Let that sink in. ⚡️✨🚀 Excited to partner with @inco_ai to bring you their Splash inference engin…

Qwen3.8-27B, up to 144 tok/sec on M5 Max. Let that sink in. ⚡️✨🚀 Excited to partner with @inco_ai to bring you their Splash inference engine in LM Studio on day 0! Get it running now: https://lmstudio

local-ailm-studio--x

Qwen3.8-Flash-Next at 1M context on Strix Halo: 38 tok/s decode, 18 min prefill (halogen 0.12.0)

Hi. I saw some feedback that halogen was degrading at context depth. So I fixed that. Served through the image, same machine, same session, same prompts, 0.11.10 vs 0.12.0: decode at 1,004,581 tokens

Radeon RX 10800 XT can outperform the RTX 5090 by 15-25% in 4K gaming and local AI

https://en.gamegpu.com/news/zhelezo/radeon-rx-10800-xt-mozhet-obojti-rtx-5090-na-15-25-v-igrakh-v-v-4k-i-lokalnom-ii The more competition, the better! submitted by /u/Lumpy_Phase_9539 [link] [comments

Ternary-Bonsai-2-27B-PQ2_0 is not completely lobotomized

I decided to run prism-ml/Ternary-Bonsai-2-27B-PQ2_0 through my own set of UNSCIENTIFIC benchmarks. I needed something to compare it to, so I decided I would compare with another 27B model by filesize

Von: Open-source 395M 'System One' model

Took me a while since I'm on a family trip and have limited hardware, but here it is! Von: Open-source 'System One' drop-in replacement for TypeSafe's JEV. https://github.com/wfzyx/von https://hugging

Which Ollama model will be best for coding?

I was wondering if there are any good coder models for 8GB VRAM RTX 5060. My specifications: 8GB RTX 5060 8GB DDR4 RAM 256 GB SSD I know the configuration is a bottleneck for sure. Though I don't have

A Simulation Platform for AUV Fault Recovery: Exploring LLM-Based Diagnostic Strategies

arXiv:2609.20620v1 Announce Type: cross Abstract: Autonomous underwater vehicles (AUVs) operating beyond reliable communications must recover from failures without human intervention. We investigate a

Accelerating Visual Policy Learning with Sampling-Based Model Predictive Control

arXiv:2609.20575v1 Announce Type: cross Abstract: Learning visual policies for locomotion and manipulation requires coordinating contact with the environment and can incur substantial computation and

AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backend

arXiv:2609.19518v1 Announce Type: new Abstract: We present AMB3R-SLAM, a real-time monocular SLAM system capable of reconstructing kilometer-scale trajectories over 10k frames on a single consumer-gra

ArtNVG: Content-Style Separated Artistic Neighboring-View Gaussian Stylization

arXiv:2412.18783v3 Announce Type: replace Abstract: As demand from the film and gaming industries for 3D scenes with target styles grows, the importance of advanced 3D stylization techniques increases

Automated Goldsmith's Mark Retrieval in Silverware

arXiv:2609.20509v1 Announce Type: new Abstract: For art historians, goldsmith marks play a critical role in the identification and dating of artifacts. In practice, experts must manually compare a que

Block Parallelism For Efficient Distributed Long-Context Diffusion Language Model Training

arXiv:2609.19242v1 Announce Type: new Abstract: Block diffusion language models (BDLMs) combine autoregressive dependencies across blocks with parallel denoising within blocks, but long-context traini

Built this yesterday with Qwen3.8-Flash-Next (NVFP4, 262K context) on a single NVIDIA DGX Spark

Planning, coding, testing = 8h total. Stack: VSCode Copilot in autopilot mode + SGLang Stats: ∼10k lines generated, ∼800k tokens consumed Sure, it's not GPT-6 Astra level, but for a 100% local ∼180B M

Can Data Attribution Filter Out Subliminal Learning? Not Reliably

arXiv:2609.20027v1 Announce Type: new Abstract: Subliminal learning allows language models to transmit behavioral traits through training data with no obvious semantic relationship to those traits, un

China’s mysterious AI company Naive AI is valued at over $1.4 billion and could release its first open-source llm model as early as this month.

According to people familiar with the matter, Naive AI, an AI startup founded in February this year by Tsinghua University professor Dai Jifeng, has completed three funding rounds totaling 400 million

Comparison of Image Processing Models in Quark Gluon Jet Classification

arXiv:2602.00141v2 Announce Type: replace-cross Abstract: Quark-gluon discrimination provides a useful test case for studying how different machine-learning architectures learn the spatial structure o

Earth Surface Immune System for Rapid Monitoring of Unknown Anomalies

arXiv:2609.20662v1 Announce Type: new Abstract: Earth surface anomalies, driven by escalating climate change, and expanding human activities, are increasing in both frequency and diversity, yet their

EPIG-Tree: Compute-Optimal Branching for Gradient-Efficient Reinforcement Learning

arXiv:2609.20004v1 Announce Type: cross Abstract: Reward-based reinforcement learning for language models, exemplified by Group Relative Policy Optimization (GRPO), collapses an entire stochastic traj

Evaluating Explanation Methods by the Predictors They Induce

arXiv:2609.20058v1 Announce Type: new Abstract: Explanations of machine learning models are usually judged by criteria that are hard to compare. We propose a simpler test: if an explanation really des

Federated Soft Clustering via Generalized Total Variation Minimization

arXiv:2609.19202v1 Announce Type: cross Abstract: We study federated soft clustering over federated learning (FL) networks of devices that each hold a private local dataset and fit a personalized Gaus

FOCAL: Fine-Grained Optimal-Transport-Driven Contrastive Alignment of Language and ECGs with Waveform Enhancement

arXiv:2505.11939v3 Announce Type: replace-cross Abstract: Electrocardiograms (ECGs) are essential non-invasive tools for diagnosing cardiovascular diseases. While recent multimodal ECG-Report contrast

FORGE: Forensic Reasoning with Grounded Evidence

arXiv:2503.15867v4 Announce Type: replace-cross Abstract: Forensic deepfake analysis demands more than binary classification: investigators need region-grounded natural language explanations they can

G^2RA-NET: Graph-based Cross-Slice Relation Modeling with Attention Gating for Medical Image Segmentation

arXiv:2609.20088v1 Announce Type: new Abstract: Medical image segmentation supports quantitative clinical analysis and computer-aided diagnosis. Recent methods for medical image segmentation have impr

GeLaCo: An Evolutionary Approach to Layer Compression

arXiv:2507.10059v2 Announce Type: replace Abstract: Large Language Models have achieved remarkable performance across a large number of tasks, but face critical deployment and usage barriers due to su

local-aiarxiv-cs-cl

Generative Verification: Rethinking the Uncertainty Signal for Active Learning of Object Detection

arXiv:2609.20262v1 Announce Type: new Abstract: Nearly every acquisition function for active object detection shares one arrangement, in that the model being improved is also the model being interroga

Geometrically-Constrained Radar-Inertial Odometry via Continuous Point-Pose Uncertainty Modeling

arXiv:2604.02745v2 Announce Type: replace Abstract: Radar odometry is crucial for robust localization in challenging environments; however, the sparsity of reliable returns and distinctive noise chara

local-aiarxiv-cs-ro

GRF-Recon: Global Ray-Field Optimization for Long-Sequence Feed-forward Reconstruction

arXiv:2609.20012v1 Announce Type: new Abstract: Feed-forward 3D reconstruction provides an efficient paradigm for scene modeling from image sequences. Scaling these models to large monocular scenarios

How Far Can Sub-3B Open Language Models Go in Zero-Shot Essay Scoring on an 8 GB Consumer GPU?

arXiv:2609.20250v1 Announce Type: new Abstract: Zero-shot essay scoring with large language models is usually demonstrated with proprietary API models, yet the settings where automated scoring is most

inclusionAI/Realtime-Venus · Hugging Face

do you want some omni? here is omni for you 1. 🧭 Overview This repository hosts two checkpoints of the Realtime-Venus system: Realtime-Venus-Omni (Realtime-Venus-Omni/): the 9B audio-visual interactio

Inference-Engine Fingerprinting Attacks are Practical: Exploring Model-Driven Environmental Discovery, Exploitation, and Escape

arXiv:2609.20614v1 Announce Type: cross Abstract: Frontier AI models are rapidly gaining the ability to exploit vulnerabilities in complex pieces of software. The risk is not theoretical, as evidenced

Information-Geometric Inverse Distillation for Enhancing Adversarial Transferability

arXiv:2502.17003v2 Announce Type: replace-cross Abstract: Transfer-based adversarial attacks rely on surrogate models to craft perturbations, yet often overfit the surrogate's decision boundary. To ad

JustMem: Just-Enough Memory Access for Long-Term Conversations

arXiv:2609.19877v1 Announce Type: new Abstract: Efficient long-term conversational memory requires retrieving sufficient evidence without indiscriminately expanding the context presented to the langua

local-aiarxiv-cs-cl

Local Sparsity Enables Unsupervised LLM Safety Detection

arXiv:2609.20129v1 Announce Type: cross Abstract: Deployment-time safety methods for large language models (LLMs) are predominantly supervised and assume access to unsafe training data. Nevertheless,

MiniMax Code goes open source

MiniMax has open-sourced the terminal version of MiniMax Code: https://github.com/MiniMax-AI/minimax-code How can developers verify the content that encoding proxies read, send, and store? This is a t

Model-Agnostic and Language-Agnostic Voice Pipeline Improvement for the Agriculture Domain

arXiv:2609.20504v1 Announce Type: cross Abstract: FarmerChat is Digital Green's AI-powered agricultural advisory assistant for smallholder farmers, who access it in their own language through text, vo

MTF-Net: Multi-Modal Temporal Feature Fusion Network for Pedestrian Intention Prediction

arXiv:2609.20178v1 Announce Type: new Abstract: Accurately predicting pedestrian intentions is crucial for ensuring safe and proactive interaction between autonomous vehicles and pedestrians. However,

Navigate or Relocate? Planning Among Movable Obstacles in Unknown Environments

arXiv:2609.19541v1 Announce Type: new Abstract: Conventional robot planning methods seek collision-free paths to a goal but fail when all paths are blocked. In these cases, the robot must determine wh

local-aiarxiv-cs-ro

Not All AI Agents Are Equal: Characterizing Resource and Performance Dynamics

arXiv:2609.19947v1 Announce Type: new Abstract: LLM-based AI agents process user requests through iterative reasoning and tool execution, often involving the invocation of remote LLM APIs with local t

Opinion Dynamics-based Coalition Formation for Federated Learning in Heterogeneous IoT Systems

arXiv:2609.19695v1 Announce Type: new Abstract: Federated learning (FL) enables privacy-preserving, on-device training across heterogeneous Internet-of-Things (IoT) deployments such as smart-city wate

Personalized Federated Hierarchical Gaussian Processes for Privacy-Preserving Modeling of Heterogeneous Distributed Systems

arXiv:2609.19337v1 Announce Type: new Abstract: We present Personalized Federated Hierarchical Gaussian Processes (pFedHGP) for probabilistic regression and classification when data are distributed ac

Physics-Informed Support Vector Kernels via Green-Function Analogies and Jackson-Chebyshev Spectral Design

arXiv:2502.11153v4 Announce Type: replace-cross Abstract: Kernel selection for regression of physical observables is often heuristic. We investigate a physics-informed strategy in which functional for

PointEvent: Rethinking Event-based Tiny Object Detection via Serialized Motion Evidence Accumulation

arXiv:2609.20066v1 Announce Type: cross Abstract: Event cameras offer high temporal resolution and motion sensitivity for tiny UAV detection, yet distant targets generate sparse and fragmented events

QoS-Aware Federated Learning for Multimodal In-Cabin Interaction in Smart Vehicles

arXiv:2609.20123v1 Announce Type: new Abstract: Modern smart vehicles leverage multimodal sensors, ranging from high-bandwidth vision systems to low-rate physiological monitors, to provide personalize