Search: “inference”

Daedalus-150M: A Convolution-Attention Hybrid Designed for CPU Inference

model-releasesarxiv-cs-ai

arXiv:2608.20210v1 Announce Type: cross Abstract: Small language models are usually built like large ones and then squeezed onto a CPU afterwards. We did the opposite: we fixed the target first, one u

21 Aug 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Pre-Compiled Pipeline Shards for Distributed LLM Inference on Intel AI PC Fleets

DGX agent

arXiv:2608.19147v1 Announce Type: cross Abstract: Modern Intel AI PCs ship capable integrated GPUs and NPUs with 16+ GB of unified memory, and they spend considerable time idle. That is not enough mem

model-releasesarxiv-cs-ai

20 Aug 2026

ProxyGuard: Direct Reliability Inference for Randomized Data Release Mechanisms with Shared Targets

arXiv:2608.18643v1 Announce Type: new Abstract: Researchers often choose a proxy dataset from many releases, transformations, or seeds. Search can make an invalid release appear adequate, while one ad

20 Aug 2026

JUMP: Single-Pass Membership Inference on Fine-Tuned Diffusion Language Models

arXiv:2607.16207v2 Announce Type: replace Abstract: Public open-weight language models are often fine-tuned on private or domain-specific data before deployment, creating a need to audit whether indiv

19 Aug 2026

Contrastive Energy Fields for Inference-Time Procedure Planning in Instructional Videos

arXiv:2608.16457v1 Announce Type: cross Abstract: Procedure planning seeks to estimate a sequence of actions to transition from an observed initial state to a given goal state. Current procedure plann

Hardware

Efficient Block-Layer Parallel Inference for Vision-Language-Action on Hybrid Architectures

arXiv:2608.14586v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models are becoming a promising paradigm for autonomous driving, but their deployment on existing vehicle platforms remai

hardwarearxiv-cs-ai

Hardware

Every Expert Counts: ExactMoE for Memory-Efficient W4A16 Inference

arXiv:2608.15383v1 Announce Type: new Abstract: Sparse mixture-of-experts (MoE) language models reduce arithmetic by activating only a small subset of experts per token, yet deployment still requires

hardwarearxiv-cs-lg

Multi-Modal Generative Fuzzy System: Fuzzy Inference Guided Large Model Interactive Question Answering Framework

arXiv:2608.14584v1 Announce Type: cross Abstract: In Multimodal Question Answering (MQA), models are required to jointly encode and integrate heterogeneous information from multiple modalities, includ

AtomBridge: Agentic VLA Inference Plugin for Long-Horizon Tasks in Scientific Experiments

arXiv:2602.09430v2 Announce Type: replace-cross Abstract: Robotic laboratories play a critical role in autonomous scientific discovery by enabling scalable, continuous experimental execution. Recent v

17 Aug 2026

Automated Inference of Graph Transformation Rules

arXiv:2404.02692v3 Announce Type: replace-cross Abstract: The explosion of data available in life sciences is fueling an increasing demand for expressive models and computational methods. Graph transf

17 Aug 2026

Local Ai

hint^2: Hierarchical World Models for Inference-Time Temporal Logic Guidance

arXiv:2608.13678v1 Announce Type: cross Abstract: A central goal of robot learning is to enable robots to execute rich instructions specified at runtime. Large-scale language-conditioned policies have

local-aiarxiv-cs-lg

17 Aug 2026

Hardware

Balanced Adaptive Prototype Selection for Scalable TabPFN Inference on Large-Scale Tabular Data

arXiv:2608.12989v1 Announce Type: new Abstract: Pretrained tabular foundation models have demonstrated strong predictive capability; however, their application to large-scale datasets remains constrai

hardwarearxiv-cs-lg

14 Aug 2026

Gradual Code-Switching as Inference-Time Cross-Lingual Representational Alignment for LLMs

arXiv:2510.05678v2 Announce Type: replace-cross Abstract: While large language models (LLMs) have achieved notable progress in multilingual settings, their performance remains uneven across languages

14 Aug 2026

Spatially-Grounded Text-to-Video Generation via Inference-Time Gradient-Free Optimization

arXiv:2608.13037v1 Announce Type: new Abstract: Diffusion Transformer Text-to-Video models have achieved remarkable synthesis quality, yet fine-grained spatial controllability remains a significant ch

researcharxiv-cs-cv

14 Aug 2026

APEX: Adaptive Expert Prefetching for Memory-Efficient Edge MoE Inference

arXiv:2608.11688v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) models are attractive for edge deployment because they provide high model capacity while activating only a small subset of pa

13 Aug 2026

ScaleVid: Geometry-Aware Video Object Scaling with Mesh-Free Inference

arXiv:2608.12232v1 Announce Type: new Abstract: Geometry-aware video object scaling aims to anisotropically resize the object along object-centric axes while preserving geometric plausibility, tempora

safetyarxiv-cs-cv

13 Aug 2026

Local Ai

FITTER: Vocabulary-Agnostic Cross-Domain Inference on Temporal Knowledge Graphs

arXiv:2608.10668v1 Announce Type: new Abstract: Temporal knowledge graphs are central to many uses of the Semantic Web, but existing completion methods assume the entities, relation names, and timesta

local-aiarxiv-cs-ai

12 Aug 2026

HIPNO: Symmetry-Aware Physics-Informed Neural Operators for Noninvasive Hemodynamic Inference

arXiv:2608.10011v1 Announce Type: cross Abstract: Continuous hemodynamic monitoring guides treatment decisions in surgery and intensive care. However, gold-standard signals are only measured in severe

12 Aug 2026

DistillCache: KL-Guided Adaptive KV-Cache Eviction for Memory-Efficient LLM Inference

model-releasesarxiv-cs-ai

arXiv:2608.08878v1 Announce Type: cross Abstract: Transformer-based large language models (LLMs) achieve strong performance across many tasks, but their Key-Value (KV) cache grows linearly with sequen

11 Aug 2026

HoloAegis: Frozen Representation, Topological Inference: Minimally Parametric Safety Manifolds for Zero-Shot LLM Guardrails

arXiv:2608.08485v1 Announce Type: new Abstract: Current LLM safety guardrails face a fundamental tension: fine-tuning distorts pre-trained representations while generative judges incur prohibitive inf

11 Aug 2026

VoxZip: Semantic-Anchored Temporal KV Cache Compression for Long-Context Audio Inference

arXiv:2608.08569v1 Announce Type: new Abstract: Recent advancements in Speech Large Language Models have demonstrated remarkable capabilities in understanding complex audio tasks. Despite this progres

11 Aug 2026

Pre-Inference Routing for Cost-Efficient Document Field Extraction

arXiv:2608.06607v1 Announce Type: new Abstract: Most document-extraction systems use a single model for all documents. This is simple but can be costly for easy cases and less effective for difficult

researcharxiv-cs-cl

10 Aug 2026

Distributional Active Inference

arXiv:2601.20985v2 Announce Type: replace Abstract: Optimal control of complex environments with robotic systems faces two complementary and intertwined challenges: efficient organization of sensory s

6 Aug 2026

PSI3D: Plug-and-Play 3D Stochastic Inference with Slice-wise Latent Diffusion Prior

arXiv:2512.18367v2 Announce Type: replace-cross Abstract: Diffusion models are highly expressive image priors for Bayesian inverse problems. However, most diffusion models cannot operate on large-scal

6 Aug 2026

A game theory for foundation models shows new paths to rational cooperation through similarity inference

arXiv:2608.03958v1 Announce Type: new Abstract: As autonomous agents powered by foundation models are increasingly integrated into social and economic systems, understanding the principles governing t

5 Aug 2026

Frozen High-Resolution Inference for Cross-City Object Detection: An AI City Challenge 2026 Study

model-releasesarxiv-cs-cv

arXiv:2608.03136v1 Announce Type: new Abstract: Cross-city object detection requires a detector trained in one city to generalize to an unlabeled target city. In AI City Challenge 2026 Track 6, we ana

5 Aug 2026

LiveMem: Maintaining Memory State Continuity in Long-Running LLM Inference

model-releasesarxiv-cs-cl

arXiv:2608.02515v1 Announce Type: new Abstract: Long-running assistants and agents consume interaction streams that eventually outgrow the context. Existing context retention, summarization, and retri

4 Aug 2026

REFLEX: Rethinking MoE Inference as Refinement-Aware Compute Allocation in Diffusion Language Models

model-releasesarxiv-cs-cl

arXiv:2608.01784v1 Announce Type: cross Abstract: Mixture-of-experts (MoE) models increase parameter capacity by activating only a small subset of experts for each token. This conditional-computation

4 Aug 2026

Towards Autonomous Aircraft Surveillance from Nanosatellites through On-Board Inference and Generative Data Augmentation

arXiv:2607.28470v1 Announce Type: cross Abstract: Airborne surveillance from low Earth orbit is hindered by two interconnected bottlenecks: nanosatellites have a limited downlink budget, yet the conve

agentsarxiv-cs-cv

31 Jul 2026

Steering Instruction Hierarchies at Inference Time

arXiv:2607.26228v1 Announce Type: new Abstract: Instruction hierarchies are a core safety assumption of language model deployment: higher priority inputs, such as system prompts, should override confl

safetyarxiv-cs-cl

30 Jul 2026

BayesContact: Uncertain Pose Estimation via Visuo-Tactile Proposals and Simulation-based Inference

arXiv:2607.16123v2 Announce Type: replace Abstract: Contact-rich manipulation requires pose estimates that are often more accurate than what depth-only sensing provides. Existing methods, relying on v

researcharxiv-cs-ro

29 Jul 2026

Context-Adaptive Inference: A Unified Statistical and Foundation-Model View

model-releasesarxiv-cs-lg

arXiv:2607.23304v1 Announce Type: cross Abstract: Modern predictive systems are expected to adapt their behavior to the specific situation they are facing. A clinical model should not treat every pati

28 Jul 2026

Inverse Bayesian Inference for Extracting Lesion Dynamics from Longitudinal Spectral CT

model-releasesarxiv-cs-cv

arXiv:2607.23078v1 Announce Type: new Abstract: Longitudinal medical imaging captures temporal evolution of lesions, yet extracting the underlying dynamical parameters governing this evolution remains

28 Jul 2026

proxymate: Diagnosis and Adjustment of Proxy Estimates for Reliable Inference

model-releasesarxiv-cs-lg

arXiv:2607.24401v1 Announce Type: cross Abstract: Proxy outcomes (such as short-term behavioral signals, model predictions, or surrogate endpoints) are frequently used in place of primary outcomes tha

28 Jul 2026

CausalForge: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal Inference

arXiv:2607.22511v1 Announce Type: cross Abstract: Automating theoretical research is constrained not only by the generation of candidate results, but also by their reliable evaluation. A common approa

agentsarxiv-cs-lg

27 Jul 2026

The Hard Decision Layer: Evidence for Committed Inference in Transformers

model-releasesarxiv-cs-cl

arXiv:2607.21613v1 Announce Type: cross Abstract: We investigate where and how transformer-based language models commit to predictions in multiple-choice question answering. We identify the _Hard Deci

27 Jul 2026

As agentic AI inference surges, tokenomics becomes the enterprise’s defining budget constraint

The transition from chatbots to autonomous agents is changing the shape of demand itself, and tokenomics — the economics of AI token consumption — is emerging as the defining constraint on enterprise

agentssiliconangle

Environment-Aware Channel Inference via Cross-Modal Flow: From Multimodal Sensing to Wireless Channels

arXiv:2512.04966v2 Announce Type: replace-cross Abstract: Accurate channel state information (CSI) underpins reliable and efficient wireless communication. However, acquiring CSI via pilot estimation

safetyarxiv-cs-lg

MiniCache: Reusable Program Caching with Small Model Interfaces for Efficient LLM Inference

arXiv:2607.20507v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for program-aided reasoning, agentic decision making, and structured task execution, but these applic

agentsarxiv-cs-ai

PlanE: Meta Planning of Data, Tuning, and Inference for Extractive-based LLMs

arXiv:2607.20470v1 Announce Type: new Abstract: Enhancing the task-specific capabilities of Large Language Models (LLMs) primarily requires substantial instruction-tuning datasets. However, the sheer

Autonomous Collaborative Learning Among an Ensemble of Tsetlin Machines with Consensus-Based Inference

arXiv:2607.20124v1 Announce Type: new Abstract: Tsetlin Machine (TM) is a rule-based machine-learning algorithm comprising collectives of two-action Tsetlin Automata (TAs) that cooperatively form conj

agentsarxiv-cs-lg

23 Jul 2026

Adaptive Filtering of the KV Cache: Diagnosing and Correcting Structural-Role Bias in LLM Inference

arXiv:2607.13205v1 Announce Type: cross Abstract: Attention-based KV cache eviction (H2O and its descendants) compresses the memory-constrained state of a long-context model by ranking tokens on accum

16 Jul 2026

TrustVLA: Mechanism-Guided Inference-Time Defense Against Vision-Language-Action Backdoors

arXiv:2607.12571v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models are deployed through pipelines that end users cannot audit, and a poisoned VLA can behave normally on clean observat

safetyarxiv-cs-ro

15 Jul 2026

Industry

Boundless taps idle crypto GPUs to cut AI inference costs

Boundless Network Inc., a distributed computing company that built its graphics processing unit network to generate zero-knowledge proofs for the cryptocurrency industry, is expanding its network towa

industrysiliconangle

14 Jul 2026

Closed-Loop Dynamic Validator Node Scaling in Private Substrate Blockchains Using Takagi-Sugeno Fuzzy Inference

arXiv:2607.07901v1 Announce Type: cross Abstract: Private blockchain networks run with fixed node configurations that cannot adapt to changing workload conditions. Too many nodes serving a light workl

agentsarxiv-cs-ai

10 Jul 2026

Latent Memory Palace: Reasoning for Control as Autoregressive Variational Inference

arXiv:2607.08724v1 Announce Type: new Abstract: Human decision-making is highly flexible -- some actions are taken immediately; others require longer deliberation. Language models have exhibited a sim

safetyarxiv-cs-lg

10 Jul 2026

Constrained Decoding for Diffusion Language Models via Efficient Inference over Finite Automata

arXiv:2607.07026v1 Announce Type: new Abstract: Constrained decoding is essential for serving LLMs, ensuring that generated outputs follow specific structures such as JSON schema-formatted function ca

9 Jul 2026

Fast token generation emerges as the key differentiator as heterogeneous inference takes hold