Search: “hardware”

Leaky Language Models: Stealing Architecture and Inference Optimizations via Per-Token Timing

arXiv:2607.20723v1 Announce Type: cross Abstract: This work presents LeakyLMs, a set of attacks that leak proprietary model, architecture, and deployment information from production language models. L

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

Machine Learning for Charge State Characterization of Isolated Double Quantum Dots

DGX agent

arXiv:2607.20871v1 Announce Type: cross Abstract: Scaling semiconductor quantum dot arrays toward fault-tolerant quantum computing requires efficient tuneup of spin qubits, a process that depends on t

local-aiarxiv-cs-lg

24 Jul 2026

[Paper] Statistically-Lossless Quantization of Large Language Models

model-releasesr-localllama

Model quantization has become essential for efficient large language model deployment, yet existing approaches involve clear trade-offs: methods such as GPTQ and AWQ achieve practical compression but

Profiling Lightweight Large Language Models

arXiv:2607.20806v1 Announce Type: new Abstract: Lightweight large language models (LLMs) are increasingly being deployed locally on personal computers and are expected to play a growing role in resour

Robostral Navigate

arXiv:2607.20785v1 Announce Type: cross Abstract: Deploying navigation systems at scale requires a recipe that minimizes sensor assumptions, generalizes across robot embodiments, and trains efficientl

safetyarxiv-cs-ai

Safe and Scalable Multi-Drone Payload Transport via CBF-based Reinforcement Learning with Zero-Shot Sim-to-Real Transfer

arXiv:2607.20665v1 Announce Type: new Abstract: Multi-drone payload transportation has emerged as a promising research paradigm with potential applications in construction, logistics, and disaster res

Agents

Scalable Low-Cost Laboratory Automation: A Digital Twin-Integrated Robotic Platform for Autonomous Liquid Handling (RAINBOTTM)

arXiv:2607.20662v1 Announce Type: new Abstract: Laboratory automation accelerates discovery, yet its adoption is constrained by the high cost, proprietary design, and limited remote supervisability of

agentsarxiv-cs-ro

Scaling Interpretable Transformers with Parity Bottleneck Layers

arXiv:2607.20652v1 Announce Type: cross Abstract: Language models are thought to exhibit the phenomenon of superposition, representing many more features than dimensions in their residual streams. Spa

Spent two weeks on a kernel that benchmarked 29x faster. End to end it's maybe 6-10%, and it's not even wired in yet.

I've been building a C99 inference engine from scratch (no Python, no BLAS, just gcc and make) that runs BitNet's ternary models on CPU. A few weeks ago I got obsessed with the matmul kernel - wrote a

local-air-localllama

Towards Capability-Aware Traversability Navigation for Unstructured Environments

arXiv:2607.20679v1 Announce Type: new Abstract: Estimating traversability in unstructured environments requires conditioning on robot embodiment, as the same terrain can be traversable for one platfor

researcharxiv-cs-ro

Transformer-Assisted LLM-Based Source Code Summarisation: to Enable More Secure Software Development

arXiv:2607.20933v1 Announce Type: cross Abstract: Neural Source Code Summarisation (NSCS) aims to generate natural language summaries of source code to improve developers' and maintainers' understandi

researcharxiv-cs-cl

Applications

What Matters for Simulation to Online Reinforcement Learning on Real Robots

arXiv:2602.20220v2 Announce Type: replace-cross Abstract: We investigate what specific design choices enable successful online reinforcement learning (RL) on physical robots. Across 100 real-world tra

applicationsarxiv-cs-ai

A Multiclass Quantum Aligned Centroid Kernel

arXiv:2607.19782v1 Announce Type: cross Abstract: Kernel methods are powerful tools in machine learning but commonly used full-Gram kernels face three key limitations: (1) quadratic scaling with train

A Unified Tokenization Framework for Pain Recognition using Heterogeneous 3D Modalities

model-releasesarxiv-cs-cv

arXiv:2607.19716v1 Announce Type: new Abstract: Pain is a complex and pervasive phenomenon affecting a large percentage of the population, and accurate assessment is essential for effective clinical m

BaseRT: Advancing Best-in-Class LLM Inference with Apple M5 Neural Accelerators

arXiv:2607.19438v1 Announce Type: cross Abstract: Apple's M5 generation introduces a redesigned GPU architecture in which every core carries a dedicated Neural Accelerator: on-die matrix units exposed

Clinical Pathways as Safety Specifications for Physical AI in Hospital Wards

arXiv:2607.19827v1 Announce Type: new Abstract: Ensuring safety in Physical AI systems operating in real-world environments is a critical challenge, particularly in hospital wards where vulnerable pat

Deepseek V4 Flash ~105 t/s on two Nvidia 4090d 48G (ada) in vLLM

model-releasesr-localllama

TLDR: I (with the help of AI) re-implemented every Blackwell-only kernel (DeepGEMM, FlashInfer sparse-MLA, block-scaled FP8) in Triton, because they simply don't exist for sm89. The performance is 2-3

Agents

From Non-Rigid to Rigid: Safe Acquisition of Rigid Communication Graphs under Limited Sensing

arXiv:2607.10170v2 Announce Type: replace Abstract: Communication graph rigidity is a fundamental requirement in many multi robot formation control approaches. However, ensuring and maintaining a rigi

agentsarxiv-cs-ro

I run GLM-4.5-Air (110B) on 16Gb ram consumer machine and Qwen3-30B at 20 tok/s

In the past few months I’ve experimenting heavily and tortured my old 2016 Desktop PC to run the biggest Local LLM I can fit. I documented the whole process and research and I’ve published a repositor

local-air-ollama

Identity-Paired Progressive Depth Training: When Trainability Persists Beyond Expressibility

arXiv:2607.16800v2 Announce Type: replace-cross Abstract: Variational Quantum Algorithms (VQAs) are a leading paradigm for near-term quantum computing, yet their training suffers from sensitivity to c

Isaac Sim-to-Real: Reinforcement Learning based Locomotion for Quadrupeds

arXiv:2607.18135v1 Announce Type: cross Abstract: Learning-based approaches to locomotion have risen in popularity in recent years, showing the capability for complex legged locomotion and whole-body

safetyarxiv-cs-lg

Learning Personalized Safety Interventions for Haptic Human-Robot Shared Control

arXiv:2607.19534v1 Announce Type: new Abstract: Haptic feedback provides an implicit channel for communicating safety intentions during human-robot shared control. Existing haptic guidance systems typ

Machine-learned syndrome post-selection for reliable quantum error correction

arXiv:2607.19563v1 Announce Type: cross Abstract: Quantum error correction can be enhanced by post-selecting out runs that are likely to produce a logical failure, but the most accurate measures for t

Memory-Augmented Multimodal Large Language Models for Small Object Understanding in Streaming Aerial Videos

arXiv:2607.19857v1 Announce Type: cross Abstract: Language-guided aerial perception aims to understand user-specified tiny targets in complex unmanned aerial vehicle (UAV) scenes. In real UAV deployme

researcharxiv-cs-ai

Milo, a Fully Autonomous Indoor/Outdoor Robotic Guide Dog

arXiv:2607.19530v1 Announce Type: new Abstract: Many Blind and Low-Vision (BLV) people rely on guide dogs for moment-to-moment navigation, such as staying on path and avoiding obstacles and pedestrian

StrokeSeg2: Stroke Lesion Segmentation in Clinical Research Workflows

model-releasesarxiv-cs-cv

arXiv:2607.19901v1 Announce Type: new Abstract: Deep learning frameworks like nnU-Net achieve state-of-theart brain lesion segmentation performance but remain difficult to deploy in clinical research

The Chronos Vulnerability: A Taxonomy of Temporal Persistence and Memory-Based Deception in Agentic AI

arXiv:2607.19433v1 Announce Type: new Abstract: The transition from stateless generative models in artificial intelligence to stateful, autonomous agents represents an architectural evolution that, wh

The Giant Hippocampus: From Structural Monoculture to a System of Systems

arXiv:2607.19973v1 Announce Type: new Abstract: AI researchers describe state-of-the-art models as one thing repeated at scale: the Transformer, wired identically for text, pixels, or speech. Neurosci

local-aiarxiv-cs-ai

Towards Miniature Humanoid Tele-Loco-Manipulation Using Virtual Reality and Reinforcement Learning

arXiv:2607.20399v1 Announce Type: cross Abstract: Full-sized humanoid robot capabilities have grown exponentially in recent years, aiming towards general-purpose deployment in human environments. A po

Towards Torque-Driven Reinforcement Learning for Quadruped Locomotion

arXiv:2607.18365v1 Announce Type: cross Abstract: Reinforcement learning (RL) for legged robots is advancing locomotion, demonstrating its ability to adapt to new and challenging terrain. Traditionall

safetyarxiv-cs-lg

Trained a 32B FLUX.2 LoRA on a 24GB AMD 7900 XTX, native ROCm on Windows — full guide + patches

model-releasesr-stablediffusion

TL;DR: Everyone says QLoRA past ~13B is dead on a 24GB card. I got the full 32B FLUX.2 dev transformer QLoRA-training resident on the GPU on a 7900 XTX under native ROCm on Windows (no ZLUDA, no CUDA

Accelerating the frontiers of scientific discovery: Google’s $40M commitment to the Genesis Mission

model-releasesgoogle-cloud-ai

Scientists today face challenges of extraordinary scale and complexity. From shaping and simulating the intricate dynamics of fusion plasma, to exploring the vast search space of new materials, to mak

22 Jul 2026

SkewAdam: A tiered optimizer that cuts MoE state memory by 97% (fits a 6.7B MoE on a 40GB GPU) [R]

model-releasesr-machinelearning

Paper:https://arxiv.org/abs/2607.19058 Code (GitHub):https://github.com/nuemaan/skewadam Hi everyone, I just published a preprint on a new optimizer designed to tackle the massive VRAM bottleneck in M

22 Jul 2026

Stuck scaling a Next.js app on M3 Pro (36GB) using local Qwen 3.6 + VS Code Copilot. Should I switch extensions or go paid?

Hey everyone, I’m a Full-Stack Developer with 6+ years of experience. I’m relatively new to AI-assisted development workflows and want to build a production-ready, enterprise-level Next.js web applica

model-releasesr-ollama

22 Jul 2026

My 2hr workshop on Open vs Closed models, reward hacking, benchmaxxing & RL is out! 1. Closed vs open models 2. Throughput maxxing but accur…

My 2hr workshop on Open vs Closed models, reward hacking, benchmaxxing & RL is out! 1. Closed vs open models 2. Throughput maxxing but accuracy minimizing 3. Benchmaxxing & cheating 4. Distillation &

model-releasesswyx--x

21 Jul 2026

Supercharging pgvector: 4x faster HNSW vector search with AlloyDB

model-releasesgoogle-cloud-ai

AlloyDB is a fully managed, PostgreSQL-compatible database service built for your most demanding enterprise workloads. It combines the best of open source PostgreSQL with Google’s advanced technology,

21 Jul 2026

Custom OS installation now available on AWS DeepRacer devices

model-releasesaws-ml-blog

With the stock firmware and software, developers couldn't modify their AWS DeepRacer devices to use the latest operating systems. Now, developers can upgrade or install a custom operating system (OS)

20 Jul 2026

What are the current best local models to run on 48GB VRAM?

I have a 48GB M5 Pro and have far too many development projects going that just don't need the power of Anthropic to churn through so have started looking into running local models and while it certai

local-air-ollama

20 Jul 2026

Cost-Optimal Foundation Model Deployment Portfolio for Transportation Management

arXiv:2607.13239v1 Announce Type: new Abstract: Foundation models, including large language models (LLMs) and vision-language models (VLMs), are increasingly used for transportation management center

safetyarxiv-cs-ai

DarwinLM: Evolutionary Structured Pruning of Large Language Models

arXiv:2502.07780v4 Announce Type: replace Abstract: Large Language Models (LLMs) have achieved significant success across various NLP tasks. However, their massive computational costs limit their wide

EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversal

model-releasesarxiv-cs-cv

arXiv:2607.13472v1 Announce Type: cross Abstract: Deploying humanoid robots in unstructured terrain remains an open problem. While classic reinforcement learning struggles with the sheer complexity of

Inference Economics of Enterprise Coding Agents: A Case Study of Cloud vs. On-Premise LLMs

arXiv:2607.13080v1 Announce Type: cross Abstract: Autonomous coding agents force engineering organizations to choose between API-based frontier models -- strong reasoning at high token cost -- and on-

NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B on 2x3090s

model-releasesr-localllama

I managed to get this model working on 2x 3090s with full 262k ctx and N=4, if anyone is interested to try it, thanks to this quant: https://huggingface.co/danielrmay/NVIDIA-Nemotron-Labs-3-Puzzle-75B

Optimizing Binary and Ternary Neural Network Inference on RRAM Crossbars using CIM-Explorer

arXiv:2505.14303v3 Announce Type: replace-cross Abstract: Using Resistive Random Access Memory (RRAM) crossbars in Computing-in-Memory (CIM) architectures offers a promising solution to overcome the v

Safe Overtaking for Autonomous Racing Using Hierarchical Optimization and Learning-Based Control

model-releasesarxiv-cs-ro

arXiv:2607.13348v1 Announce Type: new Abstract: Autonomous racing overtaking requires balancing competitive performance with safety under nonlinear vehicle dynamics and real-time constraints. Model Pr

Securing LLMs in the Wild: Privacy and Security Challenges at the Edge

arXiv:2607.13088v1 Announce Type: cross Abstract: Large Language Models (LLMs) are rapidly moving from research settings into the wild, deployed on enterprise infrastructure, personal devices, and edg

STITCHER: Constrained Trajectory Planning in Complex Environments with Real-Time Motion Primitive Search

arXiv:2510.14893v4 Announce Type: replace Abstract: Autonomous high-speed navigation through large, complex environments requires real-time generation of agile trajectories that are dynamically feasib

The Cafe in Amsterdam: When the Incumbent Becomes the Oracle

arXiv:2607.13393v1 Announce Type: cross Abstract: A field can reformulate its computations freely exactly where its demand is stated independently of any incumbent implementation, and finds itself una

safetyarxiv-cs-ai