Search: “inference”

Beyond Binary Priorities: Multi-Tier SLA Scheduling for Large Language Model Serving

arXiv:2608.16336v1 Announce Type: cross Abstract: Modern LLM serving deployments must simultaneously satisfy heterogeneous service-level objectives (SLOs) across a diverse population of user tiers, ra

applicationsarxiv-cs-lg

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Building cost-effective, high-throughput gen AI workflows in Google Dataflow

DGX agent

Real-time streaming pipelines are the operational backbone of modern enterprises, continuously processing everything from customer support interactions to transaction logs. Traditionally, streaming DA

model-releasesgoogle-cloud-ai

18 Aug 2026

Comprehensive language-image pre-training for 3D medical image understanding

arXiv:2510.15042v3 Announce Type: replace Abstract: In the 3D medical image domain, vision-language pre-training is used to create vision-language encoders (VLEs) that can support radiologists by retr

researcharxiv-cs-cv

CSMoE: An Efficient Remote Sensing Foundation Model with Soft Mixture-of-Experts

arXiv:2509.14104v2 Announce Type: replace Abstract: Self-supervised learning (SSL) through masked autoencoders (MAEs) has recently attracted great attention for remote sensing (RS) foundation model (F

researcharxiv-cs-cv

Industry

DFlash 2 is here! Qwen3.8-27B at 70 tok/s on an M5 Max MacBook Pro. ⚡ Up to 4.6× the speed of autoregressive decoding, with the same output.…

DFlash 2 is here! Qwen3.8-27B at 70 tok/s on an M5 Max MacBook Pro. ⚡ Up to 4.6× the speed of autoregressive decoding, with the same output. This is the next generation of DFlash, seeded at Z Lab and

industryemad-mostaque--x

DYNASHIELD: A Black-Box Moving Target Defense for LLMs via Dynamic Decoding Customization

arXiv:2412.07672v2 Announce Type: replace-cross Abstract: Large language models (LLMs) remain vulnerable to jailbreak attacks in which adversarial prompts induce harmful outputs. Existing defenses oft

safetyarxiv-cs-cl

Faster, Cheaper, More Accurate: Specialised Knowledge Tracing Models Outperform LLMs

arXiv:2603.02830v2 Announce Type: replace-cross Abstract: Predicting future student responses to questions is particularly valuable for educational learning platforms where it enables effective interv

FirstDiff: One-Step Diffusion-Based Anomaly Detection for Multivariate Time Series via Initial Noise Prediction

arXiv:2608.15727v1 Announce Type: cross Abstract: Diffusion models have recently shown strong potential for multivariate time-series anomaly detection by learning the distribution of normal data throu

Foresight-England: Development of a National-Scale Generative AI Model of Electronic Health Records for Medical Event Prediction across the COVID-19 Pandemic

arXiv:2608.16273v1 Announce Type: cross Abstract: Foresight-England (Foresight-E) is the first national-scale generative foundation model of electronic health records (EHRs), developed as a research p

Information-Theoretic Causal Modelling of Semiconductor Process Dynamics

arXiv:2608.14678v1 Announce Type: cross Abstract: With the progress of the semiconductor industry toward increasingly complex compute devices and tighter process tolerances, advanced process control h

Local Ai

Localized TabICLv2: Scaling Tabular In-Context Learning through k-NN

arXiv:2608.16429v1 Announce Type: new Abstract: Foundational models for tabular data have made significant progress in recent years, with TabICLv2 reporting state-of-the-art performance on several tab

local-aiarxiv-cs-lg

MM-BEV: Enhancing Timeliness by Computing Where and When it Matters

arXiv:2608.15437v1 Announce Type: cross Abstract: Multimodal bird's-eye-view (BEV) perception combines LiDAR depth accuracy with dense camera semantics, but its high computational cost and imperfect s

Not All History Helps: Velocity-Aware Selective Memory for Long-Horizon End-to-End Autonomous Driving

model-releasesarxiv-cs-ro

arXiv:2608.15573v1 Announce Type: new Abstract: Reliable long-horizon planning remains a key challenge in end-to-end autonomous driving. By accounting for future motion evolution and potential consequ

Not All Neighbors Matter: Understanding the Impact of Graph Sparsification on GNN Pipelines

arXiv:2603.06952v2 Announce Type: replace Abstract: As graphs scale to billions of nodes and edges, graph Machine Learning workloads are constrained by the cost of multi-hop traversals over exponentia

researcharxiv-cs-lg

OGX: An Open-Source, Vendor-Neutral Generative AI Application Server

arXiv:2608.14580v1 Announce Type: new Abstract: OGX (Open GenAI Stack) is an open-source AI application server and Python library that implements the APIs of major frontier labs (OpenAI, Anthropic, Go

Optimizing Qwen3.6 / Qwen3.8-27B on 16GB VRAM: Complete Benchmark Results and Setup Guide (~30-50tps at 32k to 72k context)

This post was made with AI. I tried to remove as much slop as possible and keep it straight to the point to save your time as I know how annoying AI slop posts can be, but I still wanted to retain all

Local Ai

PACE: Phase-Progress-Aware Credit for Long-Horizon Embodied Manipulation

arXiv:2608.15026v1 Announce Type: new Abstract: Post-training of vision-language-action (VLA) models typically relies on expert demonstrations and policy interaction trajectories. However, in long-hor

local-aiarxiv-cs-ro

PixRestore: Unified Image Restoration via Pixel Diffusion Transformer

model-releasesarxiv-cs-cv

arXiv:2608.16793v1 Announce Type: new Abstract: Unified image restoration (UIR) aims to recover high-quality (HQ) content from low-quality (LQ) images with different degradations using a single model.

Privacy-Preserving Decentralized Federated Learning via Explainable Adaptive Differential Privacy

arXiv:2509.10691v3 Announce Type: replace-cross Abstract: Decentralized federated learning enables collaborative model training without a central server, but shared model updates can still leak sensit

Prototype-Rectified Iterative Self-supervised Manifold Denoising under Severe Acoustic Shift

arXiv:2608.15037v1 Announce Type: cross Abstract: Audio-Text Foundation Models (ATMs) fail catastrophically under severe acoustic noise, yet existing adaptation strategies either rely on gradient-base

safetyarxiv-cs-lg

Qwen 3.8 27b saved me $650+ in API costs this evening

I've been experimenting with Qwen3.8-27B using DeepSeek Harness. It's a monster at long-horizon tasks, and the results were pretty wild. DeepSeek Harness ran on my Windows PC and connected over LAN to

Local Ai

Risk-Adaptive Edge--Cloud Visual Reasoning for Communication-Efficient Autonomous Driving

arXiv:2608.14991v1 Announce Type: new Abstract: Cloud-hosted vision-language models (VLMs) offer greater contextual reasoning capabilities than smaller onboard models, but frequent visual uploads incr

local-aiarxiv-cs-cv

Seeing Before Answering: Training-Free Visual Layer Profiling for Vision-Language Models

arXiv:2608.16263v1 Announce Type: new Abstract: LLaVA-style Vision-Language Models (VLMs) pass visual tokens from a fixed late layer of the vision backbone, typically the penultimate one, to the langu

STAIR: Semantic-Temporal Automaton for Interpretable Reasoning in Temporal Question Answering

arXiv:2608.16224v1 Announce Type: cross Abstract: By leveraging large-scale pretraining, LLMs can interpret diverse temporal expressions and question formulations without task-specific training. Howev

TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models

arXiv:2608.15341v1 Announce Type: new Abstract: Text-to-image diffusion models can be misused to generate harmful content through adversarial or paraphrased prompts that bypass built-in safety mechani

The Unwritten Benchmark: A New Challenge for Multimodal Machine Learning in Abstract Perceptual Reasoning

arXiv:2608.14558v1 Announce Type: new Abstract: Current multimodal models have demonstrated remarkable proficiency in recognizing static visual and auditory content. However, their capacity for abstra

Hardware

TinyDETR-Pose: Towards End-to-End Real-Time Single-Stage 6DoF Object Pose Estimation with Lightweight Transformers

arXiv:2608.15297v1 Announce Type: new Abstract: Real-time 6DoF object pose estimation on resource-constrained hardware remains challenging, as accurate correspondence-based and refinement pipelines ty

hardwarearxiv-cs-cv

A Year in LLM Serving: Workload Evolution, Caching and Load-Balancing

arXiv:2608.13573v1 Announce Type: new Abstract: Large Language Model (LLM) serving has become a critical cloud workload, and realistic traces are essential for motivating and benchmarking serving syst

Hardware

AI cloud operator Groq raises $350M more in funding

Artificial intelligence startup Groq Inc. today announced that it has raised 350 million in additional funding. The Series A round was led by returning backer Disruptive. Grok stated that Nvidia Corp.

hardwaresiliconangle

Content Depth Matters in Short-Video Recommendation: Rethinking the Attention Economy

arXiv:2608.13990v1 Announce Type: new Abstract: Driven by the attention economy, short-video Recommender Systems (RSs) are primarily optimized to maximize user engagement by promoting videos that capt

How Much Do Legal RAG Systems Still Hallucinate?

arXiv:2608.14210v1 Announce Type: cross Abstract: Hallucination is a major challenge for retrieval-augmented generation (RAG) systems in the legal domain, where ungrounded answers can lead to serious

Learning Unsteady Aneurysm Hemodynamics with Physics-Informed DeepONets

arXiv:2608.13629v1 Announce Type: cross Abstract: Clinically actionable, patient-specific hemodynamic assessment, specifically wall shear stress, vortex structure and pressure distributions, is critic

researcharxiv-cs-lg

Model-agnostic Retrieval-Augmented Extended Forecasting for time series

model-releasesarxiv-cs-lg

arXiv:2608.14054v1 Announce Type: new Abstract: Time series forecasting with pretrained foundation models has demonstrated strong zero-shot capabilities. However, achieving optimal performance on time

Multi-Objective Bayesian Optimization for Model Merging

arXiv:2608.14264v1 Announce Type: cross Abstract: Model merging combines trained models directly in weight space, offering a compute-efficient alternative to additional fine-tuning. Selecting merge pa

OCOO-T : A Simple and Scalable Virtual Cell Model for Transcriptional Perturbation Response Prediction

arXiv:2606.12838v2 Announce Type: replace-cross Abstract: Predicting single-cell transcriptional responses to genetic, chemical and cytokine perturbations is a fundamental challenge in computational b

Overcoming Shortcut Learning in Graph Neural Networks through Active Explanation Guidance

arXiv:2608.14121v1 Announce Type: cross Abstract: Graph Neural Networks (GNNs) can solve prediction tasks by unintentionally exploiting shortcuts---that is, edges, nodes, and features that correlate w

Owner3D: Ownership-Guided Style Writing for Training-Free Localized 3D Stylization

model-releasesarxiv-cs-cv

arXiv:2608.14078v1 Announce Type: new Abstract: Localized 3D stylization aims to modify the appearance of a specified object part while preserving the remaining surfaces. In large reconstruction model

Post-training Quantization for Hybrid Iterative Generative Models

arXiv:2608.13932v1 Announce Type: new Abstract: Iterative Generative Models (IGMs) span autoregressive and diffusion paradigms, and hybrid variants that couple them can achieve remarkable image-genera

researcharxiv-cs-lg

Program-space Diffusion for Morphology-to-Transcriptomics Prediction

arXiv:2608.14330v1 Announce Type: new Abstract: Spatial transcriptomics (ST) enables genome-wide gene expression profiling while preserving tissue architecture, but its cost and limited scalability re

Reflex: Enabling Fast and Predictive Vision-Language-Action Models for Reaction-Critical Manipulation

arXiv:2608.14379v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have recently achieved promising performance in robotic manipulation. However, existing benchmarks mainly evaluate

Secret-Stego Dissimilarity as a Design Axis: Invertible Coverless Image Steganography with Diffusion Models

arXiv:2608.13597v1 Announce Type: cross Abstract: Coverless image steganography (CIS) synthesizes a stego image rather than modifying an existing cover image, enabling authorized recipients to reconst

The Linear Geometry of Interpretable Tokens: Jailbreaking Attacks and Defenses for Unlearned Diffusion Models

arXiv:2504.21307v3 Announce Type: replace Abstract: Diffusion models excel at generating high-quality images but can memorize and reproduce harmful concepts when prompted. Although fine-tuning methods

Voxel-based 3D Facies Segmentation from Seismic Data: A Comparative Study

arXiv:2608.14058v1 Announce Type: cross Abstract: Seismic facies segmentation has emerged as a significant challenge in geophysics, requiring robust methods and systems to effectively identify geologi

When Denoising Hurts: Rethinking the Terminal Step of Diffusion Time Series Forecasters -- Extended Version

arXiv:2608.14067v1 Announce Type: new Abstract: Diffusion models offer a natural way to model uncertainty in time series forecasting, yet their iterative sampling process is often treated as a uniform

applicationsarxiv-cs-lg

5090: Windows or Linux for Qwen3.8.27b

I've got a dedicated AI rig sitting here with a RTX 5090 and 96GB RAM and for the past few years have been using Windows 11 and primarily LM Studio, but have also used vLLM, llama.cpp and Ollama. With

16 Aug 2026

Based on an accelerating frontier -> local trajectory, expect a ~30b param 'Mythos at home' by as soon as Jan 2027 (rationalisation below)

Including the rationalisation for the data below - this is a more robust version of an earlier post I did similar to this - explaining below: How I chose the comparisons The basic question I’m trying

16 Aug 2026

Adjustable Text-Guided Backdoor Attacks with Natural-Word Triggers on Multimodal Pretrained Models

arXiv:2604.05809v2 Announce Type: replace-cross Abstract: This paper presents Text-Guided Backdoor (TGB), an adjustable backdoor attack against multimodal pretrained models that uses natural-word trig

applicationsarxiv-cs-lg

14 Aug 2026

Beyond Correctness: Benchmarking and Aligning Response Behaviors in Hybrid-Thinking MLLMs