Search: “hardware”

Quantization Damage Is Multiplicative, Not Additive

model-releasesarxiv-cs-cl

arXiv:2608.06564v1 Announce Type: cross Abstract: Quantization is how large language models are actually deployed, and below four bits it is known to hurt. What nobody can say is which of the model's

10 Aug 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

A llama.cpp PR makes Q2_0 3.0–3.6x faster on x86 CPUs, 8B decode goes 2.39 → 8.20 tok/s

DGX agent

I was going through the current llama.cpp CPU PRs and #26348 stood out because this isn't the usual +5% kernel optimization. It adds an x86 VNNI implementation for the Q2_0 × Q8_0 dot product, and the

model-releasesr-localllama

7 Aug 2026

Advancing brain tumor research with privacy-first AI

model-releasesgoogle-cloud-ai

The intersection of medicine and AI has led to remarkable innovations. However, developers now face the thorny challenge of building robust medical AI tools that have been tested and evaluated on dive

Tutorials

Dense Metric Depth Completion from Sparse Direct Time-of-Flight Sensors

arXiv:2608.04737v1 Announce Type: new Abstract: Direct Time-of-Flight (dToF) sensors provide highly accurate metric depth and are more robust than indirect ToF systems in challenging real-world condit

tutorialsarxiv-cs-cv

I ported vLLM's serving stack to C++20: 66 MiB binary, no Python at inference, output checked token-for-token against vLLM

I'm the author, so discount the enthusiasm accordingly. This is an unaffiliated community port, not endorsed by the vLLM project, which it uses to verify its correctness. What started it: I love vLLM,

Industry

OpenAI says Apple’s trade secrets lawsuit is ‘rotten to its core’

OpenAI has asked a federal judge to toss out Apple's landmark lawsuit accusing the ChatGPT maker of stealing trade secrets, describing the allegations as 'meritless.' In a motion filed yesterday to di

industrythe-verge-ai

They almost catched up on Frontier performance, so now catching up on prices

Users also report that the free version was significantly downgraded after the release of the new models this is very important for us when considering local hosting. A lot of people decided not to bu

NANQ: Noise-Floor-Aware Mixed-Precision Non-Uniform Quantization for Analog Compute-in-Memory

arXiv:2608.02700v1 Announce Type: cross Abstract: Analog compute-in-memory (CIM) enables energy-efficient neural network inference, but device variation and read noise can severely degrade low-bit qua

5 Aug 2026

Privacy-Preserving AI Verification via Minimal Information Disclosure

arXiv:2608.02774v1 Announce Type: cross Abstract: AI verification crosses a trust boundary: a verifier must learn enough to establish an authorized claim, yet the same evidence can reveal sensitive de

safetyarxiv-cs-ai

5 Aug 2026

Applications

Semantic Haptic Feedback Enhances Dexterous Robotic Teleoperation

arXiv:2608.02780v1 Announce Type: new Abstract: In robot teleoperation, haptic feedback can be used to help human operators accomplish dexterous manipulation tasks. However, existing haptic feedback m

applicationsarxiv-cs-ro

5 Aug 2026

CoLI: A Reproducible Platform for Continuum Robot Learning via Monolithic 3D Printing and Isomorphic Teleoperation

arXiv:2606.20389v2 Announce Type: replace Abstract: Continuum robots offer strong potential for manipulation tasks due to their high degrees of freedom, compliant structures, and operational safety. H

safetyarxiv-cs-ro

First Deployable Dynamic-CoM: A Unified Policy and Method-Agnostic Benchmark for Humanoid Single-Leg Balance

model-releasesarxiv-cs-ro

arXiv:2608.00500v1 Announce Type: new Abstract: Unified humanoid policies handle agile whole-body motion, yet stumble on a simple demand: staying balanced on one leg. On our single-leg-balance benchma

Gram-Space: Structure-Preserving Codebook Compression for Memory-Efficient Neuro-Symbolic AI

model-releasesarxiv-cs-lg

arXiv:2608.01528v1 Announce Type: new Abstract: Vector symbolic architectures (VSA) are widely used for reasoning in neuro-symbolic (NeSy) AI, yet high-dimensional codebooks often create severe memory

I built a DwarfStar-inspired Vulkan/Metal inference engine for Qwen3.6-35B-A3B on 16 GB machines

Disclosure: I’m the author and maintainer of QuarkStar. I built QuarkStar, a small native inference engine inspired by Antirez’s DwarfStar. QuarkStar currently supports: Qwen3.6-35B-A3B, using the sam

LEAP: Lean Environment-Feedback via Adaptive Pruning for Code RL in GPU Kernel Generation

arXiv:2608.01804v1 Announce Type: new Abstract: Post-training large language models (LLMs) via reinforcement learning (RL) has significantly advanced code generation capabilities. To bypass the heavy

safetyarxiv-cs-lg

Real-Time Visual Obstruction Detection in Surgical Augmented Reality

model-releasesarxiv-cs-cv

arXiv:2608.00232v1 Announce Type: new Abstract: Surgical augmented reality (AR) can provide contextual guidance by overlaying virtual annotations, tool cues, and procedural information onto the surgic

Tutorials

Maximum Entropy Behavior Exploration for Sim2Real Zero-Shot Reinforcement Learning

arXiv:2603.25464v2 Announce Type: replace-cross Abstract: Zero-shot reinforcement learning (RL) algorithms aim to learn a family of policies from a reward-free dataset, and recover optimal policies fo

tutorialsarxiv-cs-ai

3 Aug 2026

Local Ai

Versatile On-device Adaptation at the Edge by Unifying Few-shot, Zero-shot, Continual, and In-context Learning

arXiv:2607.29353v1 Announce Type: cross Abstract: With the ever-increasing pervasiveness of smart edge devices, the demand is growing for applications that can be tailored to users (e.g., custom keywo

local-aiarxiv-cs-ai

3 Aug 2026

Belief-Guided Decision Making with Uncertainty Gating in the Game of Go

arXiv:2607.26946v1 Announce Type: new Abstract: Recent advancements in Computer Go, driven by AlphaZero and MuZero, rely heavily on Monte Carlo Tree Search (MCTS) to correct the errors of the neural n

safetyarxiv-cs-ai

Local Ai

LightRot: A Light-Weighted Rotation Scheme and Architecture for Accurate Low-Bit Large Language Model Inference

arXiv:2607.27704v1 Announce Type: cross Abstract: As large language models (LLMs) continue to demonstrate exceptional capabilities across various domains, the challenge of achieving energy-efficient a

local-aiarxiv-cs-lg

MiniMax H3: Open-weight multimodel video model

model-releasesr-stablediffusion

Just saw this posted by Fal.ai and then by Hailuo themselves, the next video model will be open weight released! Here's the blurb and link to to the feature post: Today, we're launching MiniMax H3, a

Minimax-H3 video model released, open weights coming in the next few days

https://x.com/MiniMax_AI/status/2083006198828417501?s=20 Quote from their article: Today, we're launching MiniMax H3, a general-purpose multimodal generation model. H3 understands unified context acro

mmRadarTwin: A Measurement-Calibrated Signal-Level Digital Twin Platform for Indoor mmWave Radar

arXiv:2607.28108v1 Announce Type: new Abstract: Indoor mmWave radar perception is difficult to reproduce because measured range-angle responses depend on scene geometry, material response, multipath,

researcharxiv-cs-cv

Towards Real-Time PixOOD: Efficient Anomaly Segmentation for Autonomous Vehicles

arXiv:2607.28483v1 Announce Type: new Abstract: Real-time anomaly segmentation is essential for the safety of autonomous systems. Although recent approaches offer high accuracy, their computational co

safetyarxiv-cs-cv

Tutorials

From Passive Video to Editable Experience: Physically Grounded Experience Synthesis for Embodied Intelligence

arXiv:2607.26903v1 Announce Type: cross Abstract: The key bottleneck in embodied AI is not model architecture but data. Although billions of human manipulation videos exist online, robots cannot direc

tutorialsarxiv-cs-ro

30 Jul 2026

From Tokens to Watt-hours: Analytical Energy Estimation for LLM Inference on Modern GPUs

model-releasesarxiv-cs-lg

arXiv:2607.26571v1 Announce Type: new Abstract: The operational energy consumption of large language model (LLM) inference is becoming an increasingly important component of the environmental footprin

30 Jul 2026

The Sparsity Ceiling: Where Spiking Networks Can and Cannot Trade Activity for Energy

arXiv:2607.26648v1 Announce Type: cross Abstract: Spiking neural networks (SNNs) are promoted as an energy-efficient substrate because sparse, event-driven activity replaces dense multiply-accumulates

researcharxiv-cs-lg

30 Jul 2026

5060ti Chads, vllm updates and nvfp4

Hey y'all! How is it going. Today this will be a short posting for posterity, mostly so the future llm/scraping overlords catch it since they like reddit and also for anyone out there trying this shit

Automated Modernization of Machine Learning Engineering Notebooks for Reproducibility

model-releasesarxiv-cs-lg

arXiv:2602.07195v2 Announce Type: replace-cross Abstract: Interactive computational notebooks (e.g., Jupyter notebooks) are widely used in machine learning engineering (MLE) to program and share end-t

I tried running a 1.56TB MoE model on a 6GB RTX 4050 Laptop, Here’s the result

The Test Bench Setup I tested running a massive 1.56TB Mixture-of-Experts (MoE) checkpoint (96 shards, 93 layers, 896 experts/layer, ~4.46 bits/param MXFP4) on a budget gaming laptop. Laptop: HP Victu

OmniQEC: discovering practical quantum error-correcting codes by an AI scientist

arXiv:2607.25865v1 Announce Type: cross Abstract: Quantum error correction (QEC) is indispensable for scalable fault-tolerant quantum computing. However, discovering QEC codes that remain effective is

A Replay-Constrained Simulation Framework for Personalization of Powered Knee--Ankle Prosthesis Controllers

model-releasesarxiv-cs-ro

arXiv:2607.22858v1 Announce Type: new Abstract: Personalization of impedance controllers for powered prosthetic legs is critical to accommodating individual gait biomechanics but remains challenging.

OrchNAS: Orchestrated Neural Architecture Search Service for Personalised Federated Edge Intelligence

arXiv:2607.22805v1 Announce Type: cross Abstract: We propose OrchNAS, an energy-aware, personalised, federated edge intelligence framework that leverages a Neural Architecture Search Service to automa

Quotient Tree Arithmetic: Deferred-Division Computation with Bounded Symbolic Depth and Cross-Subtree Cancellation

arXiv:2607.22612v1 Announce Type: cross Abstract: We introduce Quotient Tree Arithmetic (QTA), a computational substrate in which values are represented as deferred quotient pairs (N, D) whose ratio i

Superpixel-Based QUBO for Scalable Quantum-Enhanced Medical Image Segmentation

arXiv:2607.24288v1 Announce Type: new Abstract: Quadratic unconstrained binary optimization (QUBO) has emerged as a powerful framework for medical computing problems. Binary decision variables natural

researcharxiv-cs-cv

Through the Bottleneck: How Multi-head Latent Attention Separates Content from Position in Language Models

arXiv:2607.23054v1 Announce Type: cross Abstract: Multi-head Latent Attention (MLA), introduced in DeepSeek-V2, compresses key-value pairs through a shared low-rank bottleneck (cKV), achieving 81% KV-

Unequal Trips, Unequal Places: Diagnosing and Mitigating Delay Inequity in Autonomous Vehicle Fleet Coordination

arXiv:2607.24336v1 Announce Type: new Abstract: City-scale autonomous vehicle fleet coordinators are typically optimized for aggregate travel time, yet fleet averages conceal how delay is distributed

safetyarxiv-cs-ai

btw anthropic's internal document on this literally said 'we don't want it to be known that we are working on this.” it was called project p…

model-releasesgary-marcus--x

btw anthropic's internal document on this literally said 'we don't want it to be known that we are working on this.” it was called project panama. here's exactly what happened: 1: anthropic concluded

27 Jul 2026

Efficient Domain-Adaptive Policy Learning via Kernel Representation with Application to Quadrotor Control under Non-Stationary Disturbances

arXiv:2606.13842v2 Announce Type: replace Abstract: We present an algorithm for efficient domain-adaptive policy learning via kernel representations. Learning domain-adaptive policies is challenging s

safetyarxiv-cs-ro

27 Jul 2026

Optimal Transport Image Representation and Deep Covariance Alignment (CORAL) for Control Valve Stiction Detection

model-releasesarxiv-cs-cv

arXiv:2607.22486v1 Announce Type: new Abstract: Control valve stiction is a common cause of unwanted oscillations and poor control-loop performance in industrial processes. Data-driven methods can aut

27 Jul 2026

Demonstrating GenDB: Instance-Optimized and Customized Query Processing Code Generation via LLM Agents

arXiv:2607.20630v1 Announce Type: cross Abstract: Traditional query processing engines require continuous development and extensions to support new techniques and user requirements, and in some cases,

24 Jul 2026

WaveformQA: Benchmarking LLM Temporal Reasoning on Digital Waveforms

arXiv:2607.20638v1 Announce Type: new Abstract: Large Language Models (LLMs) have demonstrated strong capabilities in code generation and reasoning, yet their ability to perform temporal reasoning ove

24 Jul 2026

Industry

Apple’s OpenAI lawsuit is about who gets to define the post-smartphone era

Today on Decoder, I’m talking with Hayden Field, The Verge’s senior AI reporter, about the major trade secrets lawsuit between Apple and OpenAI and what this tells us about OpenAI’s future. By now I’m

industrythe-verge-ai

BRIM: Workload-Balanced Dual-Sided Bit-Serial Sparse Inference Accelerator

arXiv:2607.19431v1 Announce Type: cross Abstract: Bit-serial accelerators exploit bit-level sparsity to reduce DNN inference cost, but existing designs exploit sparsity on only one operand, bounding t

Local Ai

Edge-Local and Qubit-Efficient Quantum Graph Learning for the NISQ Era

arXiv:2602.16018v2 Announce Type: replace-cross Abstract: Graph neural networks (GNNs) are a powerful framework for learning representations from graph-structured data, but their direct implementation

local-aiarxiv-cs-lg

Germany's Black Forest Labs launches Flux 3 and Flux-mimic, its first models for robotics, as it expands from generative AI into physical AI (Yazhou Sun/Bloomberg)

Yazhou Sun / Bloomberg: Germany's Black Forest Labs launches Flux 3 and Flux-mimic, its first models for robotics, as it expands from generative AI into physical AI — Black Forest Labs, a German artif

model-releasestechmeme

it’s just for your safety

On July 23, 2026, a Polymarket tweet announced that Anthropic donated $20 million to a political nonprofit calling for stricter AI regulation ahead of the U.S. midterm elections. The post, posted at 4

safetyyann-lecun--x

Syntheses

Wiki Lint Report — 2026-07-19