Search: “hardware”

Seeing is Not Believing: Breaking the Physical-to-Digital Trust Boundary in Robotics

arXiv:2609.08280v1 Announce Type: new Abstract: In multi-robot collaboration, task handovers rely on downstream verifiers performing remote attestation, which inspects sensor telemetry to ensure a rob

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

SOTA ImageGen Locally NVIDIA Cosmos3(64B) INT4 quants CUDA/MLX

DGX agent

Cosmos3 INT4 T2I + I2V on Apple Silicon — code, weights and a Grok comparison GitHub - https://github.com/gtrg55/cosmos3-quant-mlx-cuda HF weights - https://huggingface.co/JuliaML/Cosmos3-Super-Text2I

local-air-localllama

9 Sept 2026

Sub-6 GHz Over-the-Air AMC via Curriculum Fine-Tuned CNN-Transformers

arXiv:2609.07726v1 Announce Type: cross Abstract: Automatic modulation classification (AMC) models are frequently trained and validated on synthetic or channel-cabled data, leaving open the question o

safetyarxiv-cs-lg

Supervised Cross-Modal Feature Alignment for Zero-Wearable Freezing of Gait Detection in Parkinsonism

arXiv:2609.08317v1 Announce Type: new Abstract: Objective assessment of Freezing of Gait (FoG) in Parkinson's disease (PD) relies predominantly on wearable Inertial Measurement Units (IMUs). While IMU

safetyarxiv-cs-cv

Toward Sustainable Distributed LLM Inference: A Systems Synthesis and Research Agenda for an Energy-, Carbon-, and Cache-Aware llm-d Control Plane

model-releasesarxiv-cs-lg

arXiv:2609.05565v1 Announce Type: cross Abstract: Large language model (LLM) sustainability is increasingly a serving-systems problem, not only a training problem. In production, energy and carbon imp

Wearable Multimodal Human-Machine Interface for Integrated Hand Intentions Decoding in Dynamic Teleoperation

arXiv:2609.07495v1 Announce Type: new Abstract: Under ubiquitous teleoperation environments with optically challenging conditions, an interface for tele-operated grasping that combines wearability wit

Wild paper from Microsoft and colleagues. They show a new attack that reconstructs the text a local LLM generates by watching CPU cache acti…

Wild paper from Microsoft and colleagues. They show a new attack that reconstructs the text a local LLM generates by watching CPU cache activity while it detokenizes. Earlier cache attacks needed some

local-aidair-ai--x

Anyone tried self-hosting 3D object generation?

Found this post:https://www.reddit.com/r/ClaudeAI/s/At9QNEbawK of someone fully developing a game through AI writing code, generating 3D models, etc. (he is using Meshy to create the 3D models). I was

China says its AI compute capacity rose 177% YoY to 2,185 eflops by the end of June, and is targeting 9,800 eflops by 2030 via ~$532B in IT infrastructure spend (Howard Liu/South China Morning Post)

Howard Liu / South China Morning Post: China says its AI compute capacity rose 177% YoY to 2,185 eflops by the end of June, and is targeting 9,800 eflops by 2030 via ~$532B in IT infrastructure spend

safetytechmeme

For Strix Halo - Official llama.cpp isn't ideal and how to highest possible throughput

I've been making a lot of comments about optimal setup for Strix Halo (gfx1150) and from my observation, 90% of our community is using offcial llama.cpp for it, which is NOT optimized for Strix Halo a

GTIG AI Threat Tracker: From Prompting to Autonomy – The Evolution of Adversarial AI

model-releasesgoogle-cloud-ai

Executive Summary Since the release of our May 2026 report detailing adversarial misuse of artificial intelligence (AI), Google Threat Intelligence Group (GTIG) has observed forward leaning adversarie

How many agents can 2×4090 actually run at once? Three weeks of llama.cpp concurrency data — soft cap 5 @ 64k, hard cap 9, and why.

I'm the CTO of a mid-size nonprofit, and I run a local Qwen stack as a coding subagent for that work — partly on principle (a fair amount of what I handle shouldn't leave the building), partly because

I built Infercat: Share your local AI with friends over an encrypted p2p tunnel. Connect with an invite code from anywhere.

Hello LocalLLaMA Fam! I built this project because I, like many of us here, enjoy local AI and have a nice setup, but still find myself reaching for Cloud-based AI due to their convenience. My models

Qwen3.8-Flash-Next in llama.cpp vs SGLang vs FreeToken: 35s vs 258s to first token at full context. My findings on new PRs coming to engines.

Hey guys, After my CPU-only to 96GB VRAM test, I tested Qwen3.8-Flash-Next across llama.cpp, SGLang and FreeToken on the same workstation. This time I wanted to see what changes when you keep the hard

Benchmarking calories evaluation with LLMs

I wanted a quick calories counter for myself, using LLMs to evaluate the calories from pictures of meals + descriptions. I needed to pick a model so I made a quick benchmark. The setup was: - Nutritio

Blockchain-Enabled Secure Logging for Fiscal Electronic Mechanisms: Evaluation of the Greek eSEND and myDATA Tax Systems

arXiv:2609.04356v1 Announce Type: cross Abstract: This paper analyzes the implementation of blockchain-based integrity mechanisms in Greek Fiscal Electronic Mechanisms (FEMs) and the central tax infor

researcharxiv-cs-ai

Deep Learning-Driven Peptide Classification in Biological Nanopores

arXiv:2509.14029v2 Announce Type: replace Abstract: Nanopore-based single-molecule sensing is a promising route to fast, low-cost disease diagnosis and protein sequencing: as an analyte such as a pept

researcharxiv-cs-lg

// Design Docs Are All You Need // Banger paper from Google DeepMind, MIT, and colleagues. What a genuinely strange and interesting paper th…

// Design Docs Are All You Need // Banger paper from Google DeepMind, MIT, and colleagues. What a genuinely strange and interesting paper this one is. Here is the setup: They maintain a performance-mo

model-releasesdair-ai--x

Development of a Humanoid Robot Prototype for Multimodal Human-Robot Interaction

arXiv:2609.05361v1 Announce Type: new Abstract: Human-robot interaction (HRI) enables intuitive and intelligent collaboration between humans and robots in real-world environments. This paper introduce

local-aiarxiv-cs-ro

GNN-Guided Graph Coarsening and Adaptive QUBO Penalties for the Capacitated Vehicle Routing Problem with Time Windows on a Quantum Annealer

model-releasesarxiv-cs-lg

arXiv:2609.04593v1 Announce Type: new Abstract: Graph coarsening reduces the large Quadratic Unconstrained Binary Optimization (QUBO) formulations arising when vehicle-routing problems are solved by q

I made Warrior Quest, a local LLM-powered dark-fantasy RPG where the model only plays NPCs and the actual game state stays deterministic

The LLM is limited to NPC emulation. Game state, world logic, quests, and the authored story are handled by deterministic game systems rather than the LLM. I built it this way because I wanted the fre

local-air-localllama

Large Language Models with At Most One Spike per Neuron

arXiv:2609.05151v1 Announce Type: cross Abstract: Leveraging their inherent sparse event-driven computation, spiking neural networks (SNNs) offer a promising path toward energy-efficient large languag

researcharxiv-cs-cl

LayerStoRm open-source expert streaming: 1M context GLM-5.3-Flash [UD-Q4_K_XL] at 24.5 tok/s @8k on just 2× RTX 5090 + 2× RTX 5080 (186 GiB MoE on 96 GB VRAM)

LayerStoRm: GLM-5.3-Flash UD-Q4_K_XL (186 GiB) at 1M context on 2× RTX 5090 + 2× RTX 5080 (96 GB VRAM total) using RAM for the pinned experts. LayerStoRm is a (still experimental) MIT-licensed continu

local-air-localllama

ParaRNN: Parallel Training for Non-Linear RNNs (sLSTM, RWKV-7, CfC, Titans) via Triton Newton Scans [P]

model-releasesr-machinelearning

I've built and open-sourced ParaRNN, a PyTorch/Triton library that parallelizes the training of non-linear recurrent architectures across time using Newton-Raphson iterations mapped to associative pre

PRICE: A Systematic Study of LLM Adaptation Choices for Bitcoin Price Forecasting

model-releasesarxiv-cs-ai

arXiv:2609.05235v1 Announce Type: cross Abstract: Cryptocurrency markets exhibit extreme volatility and non-stationary dynamics that challenge conventional forecasting methods. Although Large Language

VDN-H3 on M5 Pro 24GB: up to ~2.6× faster H3 generation

model-releasesr-stablediffusion

I recently ported VDN-H3 (Video DeltaNet for MiniMax H3) to Vpipe and tested it on an M5 Pro 24GB. The benefit scales with both sequence length and resolution: at 832×480, VDN-H3 starts to pull ahead

2x R9700, 64 GB DDR5 is an absolute beast machine with vLLM Radiance / R9V and Qwen 3.8 27b and Flash next

I've been tinkering with local LLMs since the beginning of the year when I had an Intel Arc B580 and 32 GB of DDR5. Curiosity got the best of me and I bought the first R9700 about half a year ago, als

48 tg/s 440 prefill on my grandma's cluster (2xP40) (sort of)

TL;DR: switching KV cache to f16 may give a boost in speed if using MTP and ngrams. I have a self-built 'AI mega-cluster' with 2x P40s on a cheap Chinese motherboard and a Xeon CPU (around $1,100 to b

8 uncensored Qwen 3.8 27B variants, one base, 167 GPU hours - Abliterlitics

This comparison was requested by a few people, and certainly we were all eager to see the final results. The comparison had taken 11 days and the GPU was crunching numbers for ~167 hours. We've been c

vllm + p2p driver hack + qwen 3.8 27B vs llamacpp + qwen flash next ?

Hi everyone I'm running four rtx 4090, 64GB ram, on a threadripper pro motherboard so all PCIe x16 ports, as a homelab machine for coding. I was migrating from vllm + qwen 3.8 27B (fp8+256k kv cache)

NInfer fork: 555k context@fp4 for 5090 with YARN, reliable kv host cacheing, monitoring, jinja, opened model support

Hiya, NInfer is amazng for Qwen, but lacking for real-world-use. As adoption of issues/pr's was not really what I needed, I created a fork and hit it for this week with 3 concurrent claude code sessio

NInfer vs llama.cpp vs vLLM: quality + speed comparison for Qwen3.8-27B NVFP4 on RTX 5090

I've been running Qwen3.8-27B as a local inference server for a production content intelligence pipeline (HVAC industry stuff, lots of long-context retrieval and structured extraction). I have been wa

Qwen3.8 27b for agentic coding and next .... what?

First, I'd like to thank the Qwen and Unsloth teams for the Qwen3.8 27b UD Q4_K_XL. Fits the poor 24GB of 3090 VRAM with 100k context at Q8 and works phenomenally well! Imho if theres anything that ca

Qwen3.8 Flash Next - Templates Comparison

I was running into a lot of posts that praised both the Fixed template and the Sharp template in comparison to the stock one, so I put them to the test. It's not as extensive as it should be for a pap

Artificial Intelligence for Energy Optimization in Data Centers

arXiv:2609.03716v1 Announce Type: new Abstract: Data centers are increasingly optimized by artificial intelligence and, at the same time, increasingly loaded by it. The literature treats these as two

safetyarxiv-cs-ai

ARTiS: An Adaptive Robotic Gripper for Enhanced Tool Manipulation in Disassembly Applications

arXiv:2609.03362v1 Announce Type: new Abstract: Grasping and holding tools while using them presents a considerable challenge not only for robots but also for humans. Such a challenge is particularly

BRIDGE: An Open-Source Humanoid Platform via Morphology-Control Co-Design for Physical AI

model-releasesarxiv-cs-ai

arXiv:2609.03497v1 Announce Type: cross Abstract: Developing humanoid robots capable of leveraging human behavioral data is essential for general-purpose embodiment, yet conventional development remai

Free Pause Tokens

model-releasesarxiv-cs-ai

arXiv:2609.03807v1 Announce Type: cross Abstract: A free pause token gives a language model extra compute to form each next-token prediction (as a pause, or thinking, token does) but carries that comp

FWBC-VLA: Force-Aware Whole-Body Compensation for Contact-Rich Loco-Manipulation

arXiv:2609.03889v1 Announce Type: cross Abstract: Contact-rich loco-manipulation requires a bridge between semantic action generation and physical interaction control. Existing Vision-language-action

safetyarxiv-cs-ai

Generative Nested Sampling of Atomistic Thermodynamic Landscapes

model-releasesarxiv-cs-lg

arXiv:2609.03193v1 Announce Type: cross Abstract: Nested sampling (NS) resolves the thermodynamics of an atomistic system from a single simulation, but its practical reach is limited by the Markov-cha

It sounds like the shift back toward open weight models that I noticed among the startups in the summer batch is a genuine trend.

It sounds like the shift back toward open weight models that I noticed among the startups in the summer batch is a genuine trend. 🦙 @ollama is used by 9 million developers and 85% of the Fortune 500,

local-aiollama--x

Qwen3.8-Flash-Next: 256k context, 16tok/s on DDR4 and a Tesla T4

I've got an refurb Dell R740 running Proxmox that I put a Tesla T4 in, mainly to run some CTC local transcription work, but thought it would be fun to try DS4 when it came out, and it was appalling at

SPARC: Spine with Prismatic And Revolute Compliance for Faster Quadrupedal Bounding

arXiv:2510.01984v4 Announce Type: replace Abstract: Quadruped mammals coordinate sagittal spinal bending with axial extension and compression during dynamic locomotion. Yet most robotic quadrupeds use

Applications

Broadcom and Supermicro unify AI factory management

AI factory management is expanding beyond software and servers to encompass the physical systems supporting production workloads. Broadcom Inc. and Super Micro Computer Inc. are integrating their tech

applicationssiliconangle

Comfy H3 Sync Sound Challenge: The Winners!

model-releasesr-stablediffusion

Two weeks, one rule, and hundreds of entries from nearly 50 countries. Here's who took the four titles, and a look at everyone who made the final ten! Entries opened August 20 and closed September 1.

DeepSeek-V4-Flash vs. GLM-5.3-Flash on 2× DGX Spark

I've tried both and been having this debate with myself for the last few days, on two Asus Ascent GX10s (effectively the same as 2x DGX Spark): DeepSeek-V4-Flash-0731 (official weights) GLM-5.3-Flash

Evidential Deep Learning for Multi-Modal Anti-UAV Detection

arXiv:2609.01742v1 Announce Type: new Abstract: Anti-UAV systems increasingly fuse multiple sensors, yet their detection heads provide no per-modality reliability signal. This study evaluates whether

researcharxiv-cs-cv

FOCUS: Foot Observation Confidence for Robust Humanoid Proprioceptive Odometry

arXiv:2609.02222v1 Announce Type: new Abstract: Foot forward kinematics (FK) is widely used to improve proprioceptive legged odometry by providing reliable velocity constraints during foot support. Ex