Search: “inference”

Impact of Multiple Non-Invasive Biosignals on Cardiovascular Biomarker Estimation via Simulation-Based Inference

arXiv:2609.11969v1 Announce Type: cross Abstract: As the population ages, the number of patients with cardiovascular diseases continues to increase, highlighting the need for early detection before pr

14 Sept 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Not All Speech Is Intent: Adaptive Self-Correcting Inference Layer for Post-ASR False Wake-Up

DGX agent

arXiv:2609.12469v1 Announce Type: new Abstract: False wake-up activations remain a persistent challenge in conversational AI. Speech phonetically similar to a device's wake word can produce a syntacti

model-releasesarxiv-cs-cl

14 Sept 2026

One Simple Trick for Improving the Performance of Energy-Limited Local Inference and Training

arXiv:2609.11936v1 Announce Type: cross Abstract: Energy supply and heat dissipation are two of the main challenges with modern GPU deployments. While typically discussed in the context of new datacen

local-aiarxiv-cs-lg

14 Sept 2026

Fast meets open. 🚀 Qwen3.8-27B is now running on @cerebras with rapid inference. Try it now!

Fast meets open. 🚀 Qwen3.8-27B is now running on @cerebras with rapid inference. Try it now! Qwen3.8-27B is now live at Cerebras speed. The dense, open-weight model from @Alibaba_Qwen scores 34 on the

model-releasesqwen--x

12 Sept 2026

Adaptive Diffusion Freezing: Privacy-preserving Diffusion Models Against Membership Inference Attacks

arXiv:2609.10608v1 Announce Type: cross Abstract: Diffusion models have achieved remarkable success in generative tasks across various areas, however their training process raises significant privacy

11 Sept 2026

Generative Marketing Mix Modeling: A Causal Inference Framework Linking GEO and GEM to Business Impact

arXiv:2609.11915v1 Announce Type: cross Abstract: Generative artificial intelligence changes how firms reach customers, but standard marketing data do not record how often users see and notice a firm'

11 Sept 2026

🌐 Supporting open source. Expanding deployment options. We’ll work closely with the open-source community on V4.1-Flash inference support a…

model-releasesdeepseek--x

🌐 Supporting open source. Expanding deployment options. We’ll work closely with the open-source community on V4.1-Flash inference support and explore more deployment options. Planning a large-scale de

10 Sept 2026

A Measurement Study of LLM Inference Trade-offs Across Edge Continuum Hardware

arXiv:2609.08307v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used as backends for intelligent web services, but serving them across the edge continuum requires balan

9 Sept 2026

Toward Sustainable Distributed LLM Inference: A Systems Synthesis and Research Agenda for an Energy-, Carbon-, and Cache-Aware llm-d Control Plane

arXiv:2609.05565v1 Announce Type: cross Abstract: Large language model (LLM) sustainability is increasingly a serving-systems problem, not only a training problem. In production, energy and carbon imp

9 Sept 2026

We have just raised 3B€ to accelerate our R&D. We are scaling up our training and inference compute to build future generations of our model…

model-releasesarthur-mensch--x

We have just raised 3B€ to accelerate our R&D. We are scaling up our training and inference compute to build future generations of our models, and expanding our Science team across all our offices --

8 Sept 2026

TNFlow: Amortized Posterior Inference for Trans-Neptunian Object Surface Composition

arXiv:2609.04305v1 Announce Type: cross Abstract: We present TNFlow, a transformer and normalizing flow architecture for inferring the surface composition of Trans-Neptunian Objects (TNOs) from their

7 Sept 2026

Been posting individual pieces of RunAnywhere for months. Here's the whole thing in one place. RunAnywhere SDKs is a complete inference suit…

model-releasesyohei-nakajima--x

Been posting individual pieces of RunAnywhere for months. Here's the whole thing in one place. RunAnywhere SDKs is a complete inference suite for any dev who wants to run AI on the user's device. ->8

6 Sept 2026

Hardware

Does high / long term inference damages GPUs?

I always heard that cryptocurrency mining can damage a GPU ( it's maybe wrong) so how much long term inference is damaging a GPU? I mean servers are made for 25/7 operation... Gaming GPUs not so sure?

hardwarer-localllama

Privacy Leakage in Federated Learning: Gradient-Based Client Identity Inference and Defenses for Inertial Sensing in Vehicular Edge Networks

arXiv:2609.02971v1 Announce Type: cross Abstract: As vehicular networks move toward 5G/6G edge intelligence, federated learning (FL) is widely promoted as a privacy-preserving way for vehicles and inf

Structured Inference with Large Language Gibbs

arXiv:2606.19264v2 Announce Type: replace-cross Abstract: The knowledge encoded in large language models (LLMs) can serve as a substrate for structured reasoning over variables describing a complex wo

local-aiarxiv-cs-cl

Toward Collective-Centric Evaluation of Preference Inference for Participatory Democracy

model-releasesarxiv-cs-ai

arXiv:2609.02990v1 Announce Type: cross Abstract: To scale up collective decision-making, participatory democracy platforms such as Polis and Remesh enable online deliberation among thousands of parti

Gauge dependence and structured-output corruption in sign-branched repetition penalties: measurements across models, inference stacks, and alternative repetition controls

model-releasesarxiv-cs-cl

arXiv:2607.09791v2 Announce Type: replace-cross Abstract: The multiplicative repetition penalty shipped across the LLM inference ecosystem (HuggingFace, vLLM, llama.cpp, and a dozen further engines) b

3 Sept 2026

Industry

Sources: Crusoe signed a ~$13B, five-year deal with Jane Street to provide GPUs and other infrastructure for AI training and inference via its cloud platform (Bloomberg)

Bloomberg: Sources: Crusoe signed a ~$13B, five-year deal with Jane Street to provide GPUs and other infrastructure for AI training and inference via its cloud platform — Crusoe, a data center upstart

industrytechmeme

3 Sept 2026

GeoGR^2:Zero-Shot Geospatial Inference via Geostatistically-Guided Iterative Refinement with LLMs

arXiv:2508.04080v2 Announce Type: replace Abstract: Standard large language model prompting treats geospatial inference as independent, instance-wise prediction, ignoring the fundamental spatial depen

safetyarxiv-cs-ai

2 Sept 2026

Lily treats Apple silicon as a distinct inference platform and maps Qwen’s operations directly to its compute and memory architecture. Lily …

model-releasesperplexity--x

Lily treats Apple silicon as a distinct inference platform and maps Qwen’s operations directly to its compute and memory architecture. Lily is now available: https://github.com/perplexityai/pplx-garde

2 Sept 2026

Trust Your Guide Only When Certain: Uncertainty-Aware Sparse Alignment at Inference Time

arXiv:2609.00624v1 Announce Type: new Abstract: A prominent paradigm in inference-time alignment employs lightweight supervisors to steer Large Language Models (LLMs). Through empirical analysis, we i

safetyarxiv-cs-cl

2 Sept 2026

Amortizing intractable inference in large language models

arXiv:2310.04363v3 Announce Type: replace-cross Abstract: Autoregressive large language models (LLMs) compress knowledge from their training data through next-token conditional distributions. This lim

safetyarxiv-cs-cl

GFlowNets and variational inference

arXiv:2210.00580v4 Announce Type: replace Abstract: This paper builds bridges between two families of probabilistic algorithms: (hierarchical) variational inference (VI), which is typically used to mo

PhyloGFN: Phylogenetic inference with generative flow networks

arXiv:2310.08774v3 Announce Type: replace-cross Abstract: Phylogenetics is a branch of computational biology that studies the evolutionary relationships among biological entities. Its long history and

SafeMath: Inference-time Safety improves Math Accuracy

arXiv:2603.25201v2 Announce Type: replace Abstract: Recent research points toward LLMs being manipulated through adversarial and seemingly benign inputs, resulting in harmful, biased, or policy-violat

safetyarxiv-cs-cl

When LLM Meets Tree Search: A Systematic View of Inference as Search in Large Language Models

arXiv:2608.30395v1 Announce Type: new Abstract: As pretraining scaling laws approach saturation, Test-Time Scaling (TTS) has emerged as an important direction for improving reasoning by allocating inf

researcharxiv-cs-cl

Accelerating LLM Inference via Vector Index Based Output Embeddings

model-releasesarxiv-cs-cl

arXiv:2608.27460v1 Announce Type: new Abstract: Large output embedding matrices create a significant memory bandwidth bottleneck during autoregressive decoding, especially for compact LLMs with large

31 Aug 2026

Virtual iEEG from Scalp EEG: Charting the Landscape of Source Imaging, Intracranial Inference and Reconstruction

arXiv:2608.26998v1 Announce Type: new Abstract: Intracranial electroencephalography (iEEG) provides temporally precise and spatially specific access to neural activity from focal and deep brain region

researcharxiv-cs-cv

28 Aug 2026

Steering Recurrent Reasoners at Inference Time with Readout Feedback

arXiv:2608.24136v1 Announce Type: new Abstract: Recurrent models, which repeatedly update latent states with shared computation blocks, have emerged as powerful architectures for solving complex reaso

26 Aug 2026

A Cross-Architecture Audit of Direction-Based Inference-Time Defences in Vision-Language Models

arXiv:2607.27910v2 Announce Type: replace Abstract: Inference time defences against vision language model jailbreaks often subtract a calibrated direction from the residual stream at a chosen decoder

safetyarxiv-cs-ai

ADMIL: Attention-Distilled Multiple Instance Learning for Selective Foundation Model Inference in Pathology

arXiv:2608.22066v1 Announce Type: cross Abstract: Attention-based multiple instance learning (ABMIL) using pathology foundation model embeddings is effective for slide-level tasks, but exhaustive infe

researcharxiv-cs-ai

Hardware

Adversarial Entropy Inflation Against Gumbel-Based Inference Verification

arXiv:2608.23375v1 Announce Type: cross Abstract: Gumbel-based inference verification bounds LLM weight exfiltration by only forgiving token choices that plausibly arise from honest GPU nondeterminism

hardwarearxiv-cs-ai

Nvidia unveils the Jetson Orin Nano 2 edge AI computer that it says doubles inference performance, with 78 TOPS of AI compute and an eight-core Arm CPU (Eugene Demaitre/The Robot Report)

Eugene Demaitre / The Robot Report: Nvidia unveils the Jetson Orin Nano 2 edge AI computer that it says doubles inference performance, with 78 TOPS of AI compute and an eight-core Arm CPU — As AI mode

local-aitechmeme

Latent Ordinal Evidence, Misaligned Outputs: Inference-Time Ordinal Lens Alignment for Multimodal LLMs

arXiv:2608.20999v1 Announce Type: new Abstract: Multimodal LLMs apply the language model interface to visual inputs, where ordinal regression tasks such as age estimation, image quality assessment, an

safetyarxiv-cs-cv

24 Aug 2026

GLM-5.2 local inference: ubatch size made a much bigger difference than I expected

model-releasesr-localllama

Has anyone else experimented with ubatch size when running GLM-5.2 locally? I was testing the 226 GiB GLM-5.2-UD-IQ2_XXS GGUF on 3x RTX PRO 6000 Blackwell GPUs and got a pretty interesting result. Wit

22 Aug 2026

Active Inference as Context Acquisition for AI Agents

model-releasesarxiv-cs-ai

arXiv:2608.19202v1 Announce Type: new Abstract: Interactive AI agents must acquire the right context as efficiently as possible. When a user omits a constraint, preference, file, or task variable, an

21 Aug 2026

Does PCIe matter much for inference?

Speaking of -sm tensor. I have 2x5060ti and i get some 40-50tps form 3.8 27B q6. I used HWinfo to see how saturated the PCIes are during inference are and as expected both the PCIe 5x16 slot and PCIe

local-air-localllama

21 Aug 2026

MileGPO: Milestone Inference with Local Evidence for Graph-Based Policy Optimization of Long-Horizon LLM Agents

arXiv:2608.19803v1 Announce Type: cross Abstract: Credit assignment is challenging in long-horizon agentic reinforcement learning, where supervision often comes only from final rewards. Existing metho

local-aiarxiv-cs-ai

21 Aug 2026

Earth Observation Foundation Models for Terrestrial Ecohydrology: From Representation Learning to Process Inference

model-releasesarxiv-cs-cv

arXiv:2608.15282v1 Announce Type: cross Abstract: Earth observation foundation models (EOFMs) are emerging as reusable representation frameworks for data-driven retrieval, prediction and process model

Applications

GUIDER: Evaluating Goal-Free Human Intent Inference for Teleoperated Manipulation on Real-Robot Data

arXiv:2608.15446v1 Announce Type: new Abstract: This paper presents an evaluation of a goal-free probabilistic framework for human intent inference during robotic manipulation. We deploy the Global Us

applicationsarxiv-cs-ro

If alignment issues are becoming big enough that OpenAI is willing to commit 20% of research inference compute to chain-of-thought monitorin…

If alignment issues are becoming big enough that OpenAI is willing to commit 20% of research inference compute to chain-of-thought monitoring, that suggests that alignment issues are becoming a pretty

safetyethan-mollick--x

Industry

OpenAI says new monitoring and security safeguards will add 20% compute overhead to monitored inference workloads; costs will not be passed on to customers (Thomas Claburn/The Register)

Thomas Claburn / The Register: OpenAI says new monitoring and security safeguards will add 20% compute overhead to monitored inference workloads; costs will not be passed on to customers — Expanded mu

industrytechmeme

We just released TensorRT Model Connect in Public Preview. You can take a supported @huggingface model to end-to-end TensorRT inference in j…

model-releasesclem-delangue--x

We just released TensorRT Model Connect in Public Preview. You can take a supported @huggingface model to end-to-end TensorRT inference in just two commands. No intermediate ONNX export, and the resul

The Integer Alibi: Localizing Cross-Kernel Divergence in INT8-Quantized LLM Inference

arXiv:2608.13756v1 Announce Type: new Abstract: Two GPU kernels implementing the same scaled INT8 GEMM interface are usually treated as interchangeable. We test that assumption: holding the checkpoint

17 Aug 2026

Inference-Time Orthogonal Seeding Enables Geometry-Aligned 3D Organ Segmentation for Slice-Propagation Methods

arXiv:2608.12658v1 Announce Type: new Abstract: Dense voxel-level annotation remains a major bottleneck in 3D medical image segmentation. Single-slice propagation methods such as Sli2Vol reduce this b

researcharxiv-cs-cv

Noise as a Probe: Membership Inference Attacks on Diffusion Models Leveraging Initial Noise

arXiv:2601.21628v2 Announce Type: replace-cross Abstract: Diffusion models have achieved remarkable progress in image generation, but their increasing deployment raises serious concerns about privacy

The Illusion of Improvement: Reject Inference Strategies in Credit Scoring

arXiv:2606.18479v2 Announce Type: replace Abstract: Reject inference methods are widely used to mitigate survival bias in credit scoring, yet their effectiveness remains poorly understood. We systemat

Trajectory Prediction via Bayesian Intention Inference under Unknown Goals and Kinematics

model-releasesarxiv-cs-ro

arXiv:2509.24928v2 Announce Type: replace Abstract: This work introduces an adaptive Bayesian algorithm for real-time trajectory prediction via intention inference, where a target's intentions and mot