Search: “engineering”

How to estimate tokens/sec for your hardware

We all want more tokens per second but I keep seeing confusion on what to expect for given hardware. For the decoding phase (TG/s) to produce one token all the model weights and KV cache needs to be r

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

I read AI papers for a living, but it has become impossible to track insights. Every week I triage agent papers for our Top AI Papers of the…

DGX agent

I read AI papers for a living, but it has become impossible to track insights. Every week I triage agent papers for our Top AI Papers of the Week digest. A few weeks ago, I tried @viktor_com, an AI em

agentsdair-ai--x

4 Sept 2026

Inferring Affective Consciousness in an Artificial Agent: A Case Study

arXiv:2609.03883v1 Announce Type: new Abstract: Creatures that display 'hedonic place preference behaviour' are thought by many scientists to experience feelings, on the assumption that their attracti

InSituMeasure: Probing Situated Measurement Grounding in Industrial Scenes with Multimodal Large Language Models

arXiv:2609.04014v1 Announce Type: new Abstract: For trained operators, gauge reading requires little specialized knowledge, low cognitive effort, and high repeatability. Yet Multimodal Large Language

safetyarxiv-cs-ai

Instruction Duplication as an Inference-Time Control Primitive

arXiv:2609.04024v1 Announce Type: new Abstract: Procedural instruction following is a basic requirement for controllable language-model systems, especially when generated trajectories are inspected or

LightEMMA: A Longitudinal Evaluation of Vision-Language Models for Autonomous Driving

arXiv:2505.00284v3 Announce Type: replace-cross Abstract: Rapid advances in vision-language models (VLMs) have generated growing interest in their application to autonomous driving. A prevailing assum

Margins, Not Windows: Training-Free Per-Step Lossy Speculative Decoding

model-releasesarxiv-cs-cl

arXiv:2609.02897v1 Announce Type: new Abstract: Speculative decoding accelerates LLM inference by drafting candidate tokens and verifying them in parallel. Tree-attention drafters such as EAGLE-3 are

Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications

arXiv:2508.00669v2 Announce Type: replace-cross Abstract: The proliferation of Large Language Models (LLMs) in medicine has enabled impressive capabilities, yet a critical gap remains in their ability

PoseDreamer: Scalable and Photorealistic Human Data Generation Pipeline with Diffusion Models

arXiv:2603.28763v2 Announce Type: replace Abstract: Acquiring labeled datasets for 3D human mesh estimation is challenging due to depth ambiguities and the inherent difficulty of annotating 3D geometr

safetyarxiv-cs-cv

Proactive Service Agents: A Unified Decision Framework, Methods, and Evaluation

arXiv:2609.03727v1 Announce Type: new Abstract: Large language model agents can plan, invoke tools, and modify external states, yet most systems still take an explicit user instruction as a fixed star

safetyarxiv-cs-ai

RealCADBench: Benchmarking Parametric CAD Modeling from Industrial Design Intents

model-releasesarxiv-cs-cl

arXiv:2609.03773v1 Announce Type: cross Abstract: Parametric computer-aided design (CAD) modeling is difficult to evaluate with a single metric. Existing CAD benchmarks often emphasize synthetic or CA

SimpleDesign: A Joint Model for Protein Sequence and Structure Codesign

arXiv:2609.03377v1 Announce Type: new Abstract: Proteins are fundamental to biological processes, with their function determined by the complex interplay between the amino acid sequence and the three-

researcharxiv-cs-lg

Tree species mapping in Denmark: A comparison of spectral-temporal features with geospatial foundation model embeddings

arXiv:2609.03480v1 Announce Type: cross Abstract: We map tree species across Denmark using National Forest Inventory plots and EO data, while evaluating the potential of foundation models for large-sc

Updated my benchmark with a new vLLM based recipe for Qwen 3.8 Flash Next : now up to 98/100 (instead of 91 previously)

I was using: weights https://huggingface.co/RadixArk/Qwen3.8-Flash-Next-NVFP4 with the optimized SGLANG (patched) from https://old.reddit.com/r/BlackwellPerformance/comments/1w04xb7/qwen38_flashnext_o

VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinement

arXiv:2609.03153v1 Announce Type: new Abstract: Visual fluency in generated video does not imply physical reliability, and a scalar quality score alone is incapable of indicating the obligation a clip

agentsarxiv-cs-cv

Local Ai

You can now run a 90M conversational LLM on the Sony PSP (hardware from 2004). Doesn't get more local than this.

Github link: https://github.com/thatblend/LLMPSP I wanted to see what the PSP can theoretically handle and I got my answer - a 90M model is about the max it can do without atrocious inference speeds.

local-air-localllama

A Survey of Transformer-based Language Models with Focus on Efficiency

arXiv:2406.16893v3 Announce Type: replace-cross Abstract: The emergence of Transformer-based Large Language Models (LLMs) has substantially augmented the capabilities of Natural Language Processing (N

Announcing the Google Gen AI SDK for Kotlin 1.0: Idiomatic multiplatform access to Gemini

model-releasesgoogle-cloud-ai

Integrating modern generative AI capabilities into Kotlin applications shouldn't require juggling raw HTTP clients or bridging disparate Java libraries. Today, we're excited to announce the 1.0 releas

Applications

Architecting Conversational Data Systems for Stateless LLM APIs: The Hydration Proxy Pattern

arXiv:2609.01834v1 Announce Type: new Abstract: As enterprise platforms transition to conversational reasoning interfaces, the stateless nature of LLM APIs creates an architectural gap. While stateles

applicationsarxiv-cs-ai

Banger paper from Google DeepMind and colleagues. (bookmark it) A model reads its entire KV cache on every generated token, even though it e…

Banger paper from Google DeepMind and colleagues. (bookmark it) A model reads its entire KV cache on every generated token, even though it ends up attending to a tiny slice of it. In other words, if y

model-releasesdair-ai--x

FUSE: An Evaluating Framework for Dangerous Capabilities of LLMs

arXiv:2609.02168v1 Announce Type: new Abstract: Fragmented safety evaluation undermines the governance of dangerous AI capabilities. We present a modular framework that evaluates each model through th

GPT‑6 Astra

model-releasessimon-willison

GPT‑6 Astra GPT-6 Astra is 'rolling out today to a limited set of organizations and over the coming days will become available to all ChatGPT Plus, Pro, Business, and Enterprise users, as well as thro

Hidden-Shot: Towards One-Shot Task Generalization for Low-Level Vision Generalist Models

arXiv:2607.01535v2 Announce Type: replace Abstract: Despite the intense engagement surrounding low-level vision generalist models, their effectiveness in zero/few-shot scenarios beyond learned tasks r

researcharxiv-cs-cv

Local Ai

Integrated Laser Scanning and Image-Based Topology Optimization Techniques for Detection and Quantification of Visible and Subsurface Structural Defects

arXiv:2609.01808v1 Announce Type: new Abstract: Reliable characterization of structural defects requires methods capable of resolving both directly observable surface damage and damage that is not vis

local-aiarxiv-cs-cv

Language Models Can Control Their Own Attention

arXiv:2609.02737v1 Announce Type: cross Abstract: Language models spend most of their attention on a small fraction of context, yet they read the entire KV cache to find the few tokens that matter. If

LLM-as-a-Judge Is Not an Oracle: Why Self-Improving Agents Need Deterministic Guardrails

arXiv:2609.02246v1 Announce Type: new Abstract: Self-improving agent pipelines have a problem at their center. An optimizer rewrites prompts to score higher, and the score comes from a judge that is i

safetyarxiv-cs-ai

Meta-ethics and AI: exploring the novel meta-ethical questions in the era of AI

arXiv:2609.01685v1 Announce Type: new Abstract: With the development of artificial intelligence (AI), the landscape of meta-ethics, which has largely centred on human ethics, faces pressures that may

Multi-Agent Retrieval-Augmented Generation for Efficient Cloud Knowledge Base Search in Telecom SNOC Environment

arXiv:2609.01618v1 Announce Type: cross Abstract: Telecom Service and Network Operations Centers (SNOCs) rely on large collections of cloud documents, including Standard Operating Procedures (SOPs), v

agentsarxiv-cs-lg

Omega-N: Interpretable Structural Node Descriptors and Their Applicability Domain

arXiv:2609.01633v1 Announce Type: cross Abstract: A composite structural index summarises a network in one number; for a triangle-based index it is spectrally redundant: Tr(A^3) is the third moment of

safetyarxiv-cs-lg

PaperCompiler: Faithful Paper-to-Code Generation via Repository-Level Specification Compilation

arXiv:2609.02272v1 Announce Type: cross Abstract: Faithfully translating research papers into repository-level implementations remains challenging because papers often describe methods at a high level

Hardware

PitchBook: 95+ investors put money into both Anthropic and OpenAI amid shifting norms; sources: Menlo, Lightspeed, and Iconiq each hold 1%-2% Anthropic stakes (Erin Griffith/New York Times)

Erin Griffith / New York Times: PitchBook: 95+ investors put money into both Anthropic and OpenAI amid shifting norms; sources: Menlo, Lightspeed, and Iconiq each hold 1%-2% Anthropic stakes — As the

hardwaretechmeme

Repodify, a fully local & opensource podcast summarizer, or BYOK if don't have GPU.

Disclaimer: I'm the builder. --- Over the past 2 yrs, I was working on a SaaS ML project & got very interested in ML/DL/AI. As everybody else, there were some normal paths I took to build a solid unde

Applications

RGB-to-IR image translation for infrared vehicle detection in unseen UAV domains

arXiv:2609.02556v1 Announce Type: new Abstract: Synthetic training data is crucial for developing vision AI when real-world data is scarce, as in thermal infrared (IR) aerial vehicle detection. While

applicationsarxiv-cs-cv

SonicCaps: Large-Scale Diverse and Fine-Grained Captioning for Improved Audio-Retrieval

arXiv:2609.02343v1 Announce Type: cross Abstract: Recent advances in audio-language modeling have been driven by large-scale audio captioning datasets. However, existing datasets remain limited by low

researcharxiv-cs-cl

Today we're launching Base Labs, a research lab by Baseten. Our mandate is to make open-source as useful as possible, and our one rule is th…

Today we're launching Base Labs, a research lab by Baseten. Our mandate is to make open-source as useful as possible, and our one rule is that we publish without exception, including what fails. Up un

safetyjeremy-howard--x

Training-free hack to reduce MoE reasoning tokens by 8.5% without losing accuracy but increasing Active parameters per token in MOE (Qwen 35B A4B+)

Hey everyone, Wanted to share a short paper we just published exploring a simple but surprisingly effective optimization for sparse MoE reasoning models. The problem: MoE reasoning models (especially

Autonomous robotic bridging using distributed swarm control without inter-agent communication

arXiv:2609.01394v1 Announce Type: new Abstract: We describe SCARAB--Swarm-Capable Autonomous Robotic Aquatic Bridging. Using distributed swarm control and multi-model sensing of agents and docking tar

agentsarxiv-cs-ro

Banger paper from ByteDance Seed. If you are curious about self-evolving agent harnesses, this one is worth your time. (bookmark it) The pro…

Banger paper from ByteDance Seed. If you are curious about self-evolving agent harnesses, this one is worth your time. (bookmark it) The proposes method, HarnessDev, stops scoring a model on the tasks

agentsdair-ai--x

Claude's new system prompt really doesn't want to reproduce song lyrics

model-releasessimon-willison

Anthropic publish the system prompts for their Claude consumer applications (Claude.ai and the Claude mobile apps - sadly not for Claude Cowork or Claude Code). I love that they do this, and that they

Compositional Machine Design as Program Synthesis with LLMs

arXiv:2510.14980v3 Announce Type: replace Abstract: Large language models (LLMs) have shown strong abilities in writing and revising programs, yet many program-synthesis benchmarks still evaluate prog

Context-Aware Intelligent Vehicles

arXiv:2609.00682v1 Announce Type: new Abstract: Intelligent vehicles increasingly support adaptive applications beyond driving themselves, ranging from context-aware ADAS and automated driving to in-c

safetyarxiv-cs-ro

Control-Data Flow Separation: Stable Prompt Optimization in Multi-Agent LLMs

arXiv:2609.00621v1 Announce Type: new Abstract: Prompt optimization can improve multi-agent LLM systems, but the prompts being optimized often serve two entangled roles: generating task-relevant conte

Don't count out Gemini just yet. Feels like a new era of model releases. Models are so powerful that they now come with cyber variants. Love…

Don't count out Gemini just yet. Feels like a new era of model releases. Models are so powerful that they now come with cyber variants. Love the pricing on Gemini 3.8 Flash. Performance not bad. Gemin

model-releasesdair-ai--x

Exploring Collaboration between a language and a non-language agent

arXiv:2609.00474v1 Announce Type: cross Abstract: LLMs are increasingly deployed as orchestrators that coordinate specialized subagents to solve complex tasks through natural language. However, in man

Geometry-aware Latent Autoregressive Generative Model for PDEs in Complex Domains

arXiv:2609.00297v1 Announce Type: cross Abstract: Solving multiphysics partial differential equations (PDEs) remains a major challenge in scientific computing, especially for highly complex mum-scale

Harness-of-Harness: Multi-Day Autonomous Software Development with Continual Improvement

arXiv:2609.01481v1 Announce Type: new Abstract: This paper studies autonomous software development, in which LLM-based coding agents transform high-level requirements into complete, functional, and us

Hidden relationships in a document-derived property graph: top-k chunk embeddings and inverse-distance weighting over a dynamically evolving ontology

arXiv:2609.00387v1 Announce Type: cross Abstract: Large language models extracting knowledge graphs from text capture only explicitly stated facts, often leaving semantically related entities disconne

researcharxiv-cs-lg

mimeo: Compiling Public Expert Corpora into Agent Skills and Testing What Transfers

arXiv:2609.00453v1 Announce Type: new Abstract: Giving an agent a file about a named expert can supply hard-to-find material, produce a recognizable persona, or change what the agent decides. These ar