Search: “hardware”

Fine-Tuning a KV Cache Concatenation-Aware Model or Recomputing KV Caches? Why Not Both?

arXiv:2609.09768v1 Announce Type: cross Abstract: In Retrieval-Augmented Generation (RAG) systems, a large number of retrieved chunks are concatenated to form the input context so that users can recei

10 Sept 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

PELM: Power Efficient On-Device LLM Inference with Speculative Decoding and Dynamic Voltage Frequency Scaling

DGX agent

arXiv:2609.09662v1 Announce Type: cross Abstract: Deploying Large Language Models (LLMs) directly on mobile platforms at the edge is gaining traction due to a myriad of benefits, such as increased pri

local-aiarxiv-cs-cl

10 Sept 2026

RedKnot-MLA: Multi-Head Offline-Online Reuse for DeepSeek-V4 Long-Context Serving

model-releasesarxiv-cs-ai

arXiv:2609.07008v1 Announce Type: new Abstract: Multi-head latent attention (MLA) exposes many logical query heads through one packed latent KV stream. This representation is memory efficient, but it

10 Sept 2026

Scaling Post-Training Ternarisation to Qwen3-8B Capability Retention, Reproduction, Lossless Packing, and Packed Execution

arXiv:2609.09240v1 Announce Type: new Abstract: Ultra-low-bit language models promise reductions in storage and memory traffic, but a nominal '1.58-bit' label does not specify the deployed representat

10 Sept 2026

How to Learn from What a Human Would Avoid? Intervention-Aware World Models with Real-World RL for Dexterous Manipulation

arXiv:2609.06009v1 Announce Type: new Abstract: Multi-fingered dexterous manipulation remains a frontier for real-world reinforcement learning (RL) due to the high-dimensional action space and the pro

safetyarxiv-cs-ro

Learning Quantum Data Distribution via Chaotic Quantum Diffusion Model

arXiv:2602.22061v3 Announce Type: replace-cross Abstract: Generative models for quantum data pose significant challenges but hold immense potential in fields such as chemoinformatics and quantum physi

Novel Methods for Catheter and Guidewire Segmentation in X-ray Fluoroscopy under a Federated Learning Setting

model-releasesarxiv-cs-cv

arXiv:2609.06876v1 Announce Type: new Abstract: Endovascular procedures rely on real-time manipulation of thin instruments, catheters and guidewires, under X-ray fluoroscopy guidance, where accurate v

Agents

Phase-and-First-Arrival VLM Feedback for Sparse-Reward Reinforcement Learning in Surgical Manipulation

arXiv:2609.07211v1 Announce Type: new Abstract: Sparse outcome feedback limits what robots can learn from unsuccessful attempts at complex manipulation. Failed multi-stage surgical attempts can contai

agentsarxiv-cs-ro

Visible-Reachable Workspace for Perception-Aware Humanoid Design

model-releasesarxiv-cs-ro

arXiv:2609.08905v1 Announce Type: new Abstract: Workspace analysis measures where a robot can place its end effector. For visually guided manipulation, reachability alone is insufficient: a kinematica

Zero-Shot Sim-to-Real Contact-Rich Assembly via Proprioception-Anchored Cross-Modal Pretraining

arXiv:2609.07534v1 Announce Type: new Abstract: Contact-rich assembly remains challenging because it requires submillimeter spatial accuracy and reliable interpretation of forces during sustained cont

safetyarxiv-cs-ro

Tutorials

Wow, the field is moving so quickly! So impressed with what people can do with a SO-101, that we designed with @therobotstudio at @huggingfa…

tutorialsclem-delangue--x

Wow, the field is moving so quickly! So impressed with what people can do with a SO-101, that we designed with @therobotstudio at @huggingface i gave astra a robot, a paint brush, and a camera then as

8 Sept 2026

Laydee Latte - Pan Con Chocolate - Krea 2, Mimimax H3 & Mimax Music 3

local-air-stablediffusion

Over the last two weeks, I set a challenge for myself: to find out if it was possible to make a high-quality music video using a local rig and open-source AI models. So, in my free time, I’ve been exp

7 Sept 2026

My LLM framework. (people asked) (SAI)

DISCLAIMER I ramble a lot and am not good at focusing on documentation and or coherent thoughts. TLDR I did things I made a thing and it works for me. I will try to answer any questions. A few people

7 Sept 2026

Been posting individual pieces of RunAnywhere for months. Here's the whole thing in one place. RunAnywhere SDKs is a complete inference suit…

model-releasesyohei-nakajima--x

Been posting individual pieces of RunAnywhere for months. Here's the whole thing in one place. RunAnywhere SDKs is a complete inference suite for any dev who wants to run AI on the user's device. ->8

6 Sept 2026

DeepSeek-V4-Flash-Vision Q8 vs Qwen3.8-Flash-Next Q8

I'm using DS-V4-Flash-Vision with Q8_K_XL quantization locally as my everyday engine, and for some time now I've been doing a lot of comparisons with Qwen3.8-Flash-Next, also with Q8_K_XL quantization

6 Sept 2026

~22% less weight VRAM, lossless: base-3 packing for ternary GGUFs

I built a denser GGUF format for ternary models: Q2_B3 / “B3S” If you're running a ternary model like BitNet-b1.58 or Ternary-Bonsai, the weights are already restricted to -1, 0, or +1 times a block s

Hugging Face has been acquired by NVIDIA It is quite exciting to be a part of this journey! NVIDIA has been an active supporter of the llama…

model-releasesclem-delangue--x

Hugging Face has been acquired by NVIDIA It is quite exciting to be a part of this journey! NVIDIA has been an active supporter of the llama.cpp project. For more than a year now, their engineers have

Quantum Implicit Neural Representations for Novel View Synthesis

arXiv:2601.05250v2 Announce Type: replace Abstract: Quantum implicit neural representations have recently emerged as compact function approximators for continuous visual signals. In parallel, Neural R

safetyarxiv-cs-cv

When Vision Meets Graphs: A Survey on Graph Reasoning and Learning

arXiv:2609.03816v1 Announce Type: cross Abstract: Graphs are a fundamental data structure underlying many problems in the natural and social sciences. Over the past decade, Graph Neural Networks (GNNs

researcharxiv-cs-cv

Why Gated DeltaNet Survives 4-Bit Quantization: NVFP4 W4A4 for the Recurrent Half of a Hybrid 27B LLM

arXiv:2609.04098v1 Announce Type: new Abstract: Hybrid LLMs pair softmax attention with linear-attention layers such as Gated DeltaNet (GDN), whose recurrent state summarizes the context in fixed size

local-aiarxiv-cs-ai

An endless AI TV channel on a single gaming GPU — MiniMax H3, generating faster than it plays

local-air-stablediffusion

There is a video stream running on my desktop right now. It has sound, it has never repeated itself, and it will not stop. I point VLC at a local URL and it plays. One RTX 5090 does all of it — no clo

Compositional Machine Design as Program Synthesis with LLMs

model-releasesarxiv-cs-ai

arXiv:2510.14980v3 Announce Type: replace Abstract: Large language models (LLMs) have shown strong abilities in writing and revising programs, yet many program-synthesis benchmarks still evaluate prog

Design and Implementation of a Kalman Filter-Infused Algorithm for Tilt Estimation

arXiv:2609.00730v1 Announce Type: new Abstract: Accurate tilt angle estimation is important in many engineering applications, such as robotics, motion tracking, and embedded control systems. However,

researcharxiv-cs-cv

DynaNDE: Dynamic Near-Data Expert Scheduling for Batched MoE Inference

arXiv:2609.00407v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) models enable efficient scaling of large language model (LLM) inference but suffer from substantial data-movement overhead wh

Exploring Nonlinear Body Oscillations for Natural Quadruped Gaits

arXiv:2609.00539v1 Announce Type: new Abstract: Animals' body morphology shapes the gait patterns they can perform, where mechanical resonance reduces the need for active control. By tuning posture an

researcharxiv-cs-ro

OCGQuant: Outlier-Companion Grouping for NVFP4 Quantization

arXiv:2609.00066v1 Announce Type: cross Abstract: NVFP4 is an efficient microscaling format for low-bit inference, but activation outliers can still degrade quantization accuracy within NVFP4 blocks.

researcharxiv-cs-ai

Peg-in-Bench: A Modular Benchmark for High-Precision Robotic Insertion

model-releasesarxiv-cs-ro

arXiv:2609.00906v1 Announce Type: new Abstract: High-precision insertion remains a fundamental challenge in robotic manipulation due to the strict alignment requirements and contact-rich interactions

A Generalized Optimization Engine (GOE) for Edge AI Inference Acceleration

arXiv:2608.28652v1 Announce Type: new Abstract: Artificial intelligence (AI) models have demonstrated remarkable capabilities across various domains, yet their widespread deployment is impeded by sign

local-aiarxiv-cs-ai

AI-enabled Low-Cost 3D Maize Ear Morphometry Platform at Breeding Scale

arXiv:2608.30161v1 Announce Type: new Abstract: Maize ear geometry (length, width, curvature, and volume) is closely tied to yield and grain-filling outcomes, but existing high-throughput phenotyping

researcharxiv-cs-cv

Amortized Anchor Refinement for Deployable Continuous-Time 4D Gaussian Reconstruction

model-releasesarxiv-cs-cv

arXiv:2608.30218v1 Announce Type: new Abstract: Continuous-time 4D reconstruction remains impractical on standalone XR headsets. Per-scene optimization demands deployment-infeasible compute, and lower

Agents

ASTRA - Agentic System for Ticket Resolution and Analysis

arXiv:2608.28790v1 Announce Type: cross Abstract: Technical operations teams resolve large volumes of incidents by synthesizing fragmented evidence from ticket text, historical cases, system logs, and

agentsarxiv-cs-ai

Cloud and On-Premises Deployment of Uzbek Legal RAG via Targeted Retriever Fine-Tuning

arXiv:2608.29284v1 Announce Type: new Abstract: Deploying large language models for legal question answering raises challenges that general-purpose leaderboards do not capture, particularly for low-re

Deploying DeepSeek 175B Locally on a Single Consumer-Grade RTX 4060 Laptop with 32GB RAM for 200k-Scale Protein-Ligand Virtual Screening

arXiv:2608.30877v1 Announce Type: new Abstract: Recent advances in large language models (LLMs) have demonstrated exceptional performance in protein-ligand interaction prediction, but state-of-the-art

Applications

Financially Motivated Threat Actor BREEZE COMET Targets Brazil

applicationsgoogle-cloud-ai

Introduction Beginning in 2024 Mandiant investigated a string of compromises affecting Brazilian financial services, retail, and eCommerce organizations. Google Threat Intelligence Group (GTIG) tracks

Learning Agile Perceptive Traversal of Sparse 3D Structures for Humanoids

arXiv:2608.29769v1 Announce Type: new Abstract: Traversing sparse 3D structures requires humanoid robots to perceive thin, overhanging geometry while executing agile, accurate whole-body motions. We s

safetyarxiv-cs-ro

CF-YOLO: Context-Aware Feature Refinement for Camouflaged Industrial Micro-Defect Detection

model-releasesarxiv-cs-cv

arXiv:2608.28070v1 Announce Type: new Abstract: Automated detection of surface micro-defects on industrial components, such as copper tubes, is critically important for quality assurance but remains c

31 Aug 2026

Comparing Classical and Quantum Machine Learning for Regression in High Energy Physics Collision Data

arXiv:2608.28084v1 Announce Type: new Abstract: The classification and regression of particle collision events constitute a persistent computational challenge in experimental high energy physics, wher

31 Aug 2026

How important is it for Chinese LLMs to reach the Opus 4.8 level?

In mid-August, Ramp published spending data collected from 70,000 U.S. companies: Fable 5 ,the most powerful and expensive model in Anthropic’s lineup, accounts for just 11% of what those businesses s

29 Aug 2026

Ornith-1.5-35B-A3B on 8 GB VRAM: I think I've found my sweet spot

A few days ago I posted asking what people considered the best local model for an 8 GB VRAM GPU. At the time, my personal sweet spot was Qwen3.6-35B-A3B, for agentic coding with Pi.dev. Well… Thanks t

Pruning Binarized Neural Networks: A Dedicated Framework and Globally Weighted Algorithms

arXiv:2608.26233v1 Announce Type: new Abstract: Extreme compression of deep neural networks, up to full binarization, dramatically reduces memory footprint and arithmetic complexity, facilitating depl

Puro-2B: Poor Lab's Qwen2-1.5B Trained on RTX 5090 within $5090

arXiv:2608.27370v1 Announce Type: new Abstract: Language model pretraining has become almost synonymous with prohibitive cost, placing it out of reach for much of the academic and open-source communit

Applications

Quantitative mapping from conventional MRI using self-supervised physics-guided deep learning: applications to a large-scale, clinically heterogeneous dataset

arXiv:2601.05063v2 Announce Type: replace-cross Abstract: Magnetic resonance imaging (MRI) is a cornerstone of clinical neuroimaging, yet conventional MRIs provide qualitative information heavily depe

applicationsarxiv-cs-cv

[audio.cpp] Release 0.7: 62 audio model families (85+ variants), Arena UI for model comparison, MiniMax Music 3, FireRed TTS3/Audio, ControlFoley, Personaplex, and more

audio.cpp 0.7 is out :) This release adds a lot of new audio models and a new way to compare them locally. Audio.cpp is now at 62 model families and 85+ model variants. And it keeps growing! The bigge

local-air-localllama

FAMPWQ: Fisher Information-based Adaptive Mixed Precision Weight Quantization for Effective LLM Inference

arXiv:2608.24945v1 Announce Type: new Abstract: Recent years have witnessed remarkable achievements of Large Language Models (LLMs) in multiple domains, while the excessive resource requirements of LL

Narcissus: Program Synthesis Using Context-Aware LLM Approximations

arXiv:2608.25657v1 Announce Type: cross Abstract: Large language models (LLMs) excel at programming, but not when the task fixes the target language: prompted with a grammar rare in their training dat

Thermodynamic cost of inference and learning in physical neural networks

arXiv:2503.09980v4 Announce Type: replace-cross Abstract: How much of the energy consumed by artificial neural networks is set by physics rather than by implementation? For irreversible digital hardwa

safetyarxiv-cs-lg

Trust the Mass: Forced Weights in KV-Cache Eviction

arXiv:2608.25230v1 Announce Type: cross Abstract: Every deployed sparse-attention or KV-cache-eviction rule keeps a subset of the keys, discards the rest, and renormalizes the attention weights over t

A Heterogeneous Mixture of Experts Framework for Interpretable Machine Learning

arXiv:2608.24195v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) models provide a flexible framework for partitioning complex prediction problems into simpler local learning tasks through an