Search: “deployment”

LLM Inference at the Edge: Mobile, NPU, and GPU Performance Efficiency Trade-offs Under Sustained Load

model-releasesarxiv-cs-lg

arXiv:2603.23640v2 Announce Type: replace-cross Abstract: Deploying large language models on-device for always-on personal agents demands sustained inference from hardware tightly constrained in power

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Hardware

Meeting SLOs, Slashing Hours: Automated Enterprise LLM Optimization with OptiKIT

DGX agent

arXiv:2601.20408v2 Announce Type: replace-cross Abstract: Enterprise LLM deployment faces a critical scalability challenge: organizations must optimize models systematically to scale AI initiatives wi

hardwarearxiv-cs-ai

9 Jun 2026

Local Ai

MemoVAD: Resource-Efficient Video Anomaly Detection via Dynamic Semantic Memory in Edge Computing Scenarios

arXiv:2606.07669v1 Announce Type: cross Abstract: Deploying Video Anomaly Detection (VAD) in real-world surveillance faces a fundamental tension between the demand for high-level semantics to ensure e

local-aiarxiv-cs-ai

One Stone, Three Birds: Self-adaptive Optimal Transport for Multi-VLM Selection, Adaptation, and Ensembling

arXiv:2606.08126v1 Announce Type: new Abstract: Vision-language models (VLMs) enable visual recognition from semantic class descriptions, which makes them attractive when target annotations are scarce

researcharxiv-cs-cv

Payoff scaling shapes cooperation in LLM agents across languages

arXiv:2601.19082v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly deployed as autonomous agents that negotiate, coordinate, and act on behalf of users. Whether they coo

safetyarxiv-cs-ai

Sequential statistical inference for Large Language Models: Representation, validity, and monitoring

arXiv:2606.07624v1 Announce Type: new Abstract: This discussion argues that sequential statistical inference can naturally contribute to LLM trustworthiness. In deployment, LLM systems are queried rep

safetyarxiv-cs-lg

VAIC: Vision-Guided Humanoid Agile Object Interaction Control via Decoupled Commands

arXiv:2606.09286v1 Announce Type: new Abstract: Humanoid robots hold immense potential for real-world assistance, yet agile interaction with objects in unstructured environments demands tightly couple

safetyarxiv-cs-ro

X-Palm: Paired Multispectral-to-Smartphone Dataset for Cross-Domain Palmprint Authentication

arXiv:2606.08437v1 Announce Type: cross Abstract: Palmprint modality offers a privacy-preserving biometric solution, yet its deployment is hindered by the domain gap between controlled enrollment and

applicationsarxiv-cs-cv

EVA: Evolving Semantic Adversaries for Red-Teaming GUI Agents Against Environmental Injection Attacks

arXiv:2505.14289v2 Announce Type: replace Abstract: Graphical User Interface (GUI) agents powered by Multimodal Large Language Models (MLLMs) are increasingly deployed yet vulnerable to Environmental

safetyarxiv-cs-ai

8 Jun 2026

Agents

OpenSkill: Open-World Self-Evolution for LLM Agents

arXiv:2606.06741v1 Announce Type: new Abstract: Self-evolving agents requires adaptation after deployment, but existing approaches assume a usable learning loop, such as curated skills, successful tra

agentsarxiv-cs-ai

8 Jun 2026

Vortex: Efficient and Programmable Sparse Attention Serving for AI Agents

arXiv:2606.06453v1 Announce Type: new Abstract: Sparse attention is becoming increasingly important for serving large language models (LLMs) as generation lengths continue to grow. However, deploying

6 Jun 2026

Real-Time Threat Detection from Surveillance Cameras using Machine Learning

arXiv:2606.05708v1 Announce Type: new Abstract: Ensuring public safety in densely populated urban environments remains a critical challenge, necessitating the deployment of intelligent and automated v

safetyarxiv-cs-cv

Local Ai

Statistical Priors for Implicit Preferences: Decoupling Skill Selection as a Local Harness in Personal Agents

arXiv:2606.05828v1 Announce Type: cross Abstract: As Large Language Model (LLM) capabilities advance, locally deployed personal agents relying on API-based remote models and external skills have emerg

local-aiarxiv-cs-cl

Towards a Data Flywheel for Embodied Intelligence in Logistics

arXiv:2606.05960v1 Announce Type: new Abstract: Embodied intelligence is moving from laboratory demonstrations toward industrial deployment, with the logistics industry serving as a key application sc

safetyarxiv-cs-ro

YouZhi: Towards High-Concurrency Financial LLMs via Adaptive GQA-to-MLA Transition

arXiv:2606.05868v1 Announce Type: new Abstract: Large language models (LLMs) drive significant financial innovations, yet their high-concurrency deployment is severely bottlenecked by KV cache memory

Tutorials

ADAPTOOD: Uncertainty-Aware Fine-Tuning for Out-of-Distribution ECG Time Series Models

arXiv:2606.04164v1 Announce Type: cross Abstract: Data samples used for training often differ from those encountered during fine-tuning and deployment, and while ML models show promise, their performa

tutorialsarxiv-cs-ai

CADET: A Modular Platform for Evaluating Distributed Cooperative Autonomy in Connected Autonomous Vehicles

model-releasesarxiv-cs-lg

arXiv:2606.04072v1 Announce Type: cross Abstract: Deep learning models are increasingly central to autonomous vehicle (AV) pipelines, yet their integration has traditionally followed a monolithic desi

dMX: Differentiable Mixed-Precision Assignment for Low-Precision Floating-Point Formats

arXiv:2606.04115v1 Announce Type: cross Abstract: Quantizing large language models (LLMs) to low-precision floating-point representations is central to efficient deployment, yet applying a single bit-

LiftQuant: Continuous Bit-Width LLM via Dimensional Lifting and Projection

arXiv:2606.04050v1 Announce Type: cross Abstract: Existing quantization methods are fundamentally limited by rigid, integer-based bit-widths (e.g., 2, 3-bit), resulting in a ``deployment gap' where La

Spatial Artifact Coherence Determines Codec Robustness in Patch-Based rPPG

arXiv:2606.04198v1 Announce Type: new Abstract: Remote photoplethysmography (rPPG) achieves low heart-rate error on uncompressed benchmarks yet is deployed over compressed video channels in telehealth

researcharxiv-cs-cv

Industry

This provides some sense of scale

This provides some sense of scale Starlink V3 satellites Bandwidth per Satellite: • V2: 96 Gbps • V3: 1,024 Gbps Bandwidth per Launch: V2: 2,600 Gbps V3: 61,000 Gbps Deployment per Launch: • V2: 27 sa

industryelon-musk--x

Unpredictable Safety: Domain-Dependent Compliance and the Transparency Gap in Open-Weight LLMs

arXiv:2606.04035v1 Announce Type: cross Abstract: We present a systematic study of domain-dependent safety behavior in open-weight LLMs: 7 standardized experiments across 7 ethical domains, testing 5

FlashMLA-ETAP: Efficient Transpose Attention Pipeline for Accelerating MLA Inference on NVIDIA H20 GPUs

arXiv:2506.01969v3 Announce Type: replace-cross Abstract: Efficient inference of Multi-Head Latent Attention (MLA) is challenged by deploying the DeepSeek-R1 671B model on a single Multi-GPU server. T

FlowGuard: Flow Matching for Identity-Independent Detection of Data-Free Model Stealing Attacks on Energy System Intrusion Detection Systems

arXiv:2606.03430v1 Announce Type: cross Abstract: Artificial Intelligence (AI)-based Intrusion Detection Systems (IDS) deployed in energy infrastructure are vulnerable to model theft attacks, which al

researcharxiv-cs-ai

How Quantization Changes Interpretable Features: A Sparse Autoencoder Analysis of Language Models

arXiv:2606.03002v1 Announce Type: cross Abstract: Quantization is a standard path to deploying large language models, and a quantized model is typically judged acceptable when its perplexity or downst

Making Embodied AI Reliable: A Community Agenda from Testing to Formal Verification

arXiv:2606.03593v1 Announce Type: cross Abstract: Embodied AI systems are increasingly deployed in open-world environments, yet ensuring their reliability remains a fundamental challenge. Drawing on d

applicationsarxiv-cs-ro

Industry

Powering the Inference Era: Inside the DigitalOcean Data & Learning Layer

DigitalOcean discusses infrastructure and platform capabilities designed to support the inference phase of machine learning, where trained models are deployed to make predictions on new data at scale.

industrydigitalocean

RRISE: Robust Radius Inference via a Surrogate Estimator

arXiv:2606.02876v1 Announce Type: new Abstract: Randomized smoothing (RS) uses a smoothed classifier to provide architecture-agnostic certificates of ell_2 classification robustness, but its dependenc

The Efficiency vs. Accuracy Trade-off: Optimizing RAG-Enhanced LLM Recommender Systems Using Multi-Head Early Exit

arXiv:2501.02173v2 Announce Type: replace-cross Abstract: The deployment of Large Language Models (LLMs) in recommender systems for predicting Click-Through Rates (CTR) necessitates a delicate balance

Collaborative Few-Step Distillation and Low-Bit Quantization for Wan2.2 Dual-Expert Video Diffusion Models

arXiv:2606.00658v1 Announce Type: cross Abstract: Large video diffusion models achieve strong visual quality but remain expensive to deploy because each sample requires many denoising steps and a larg

CoMIC: Collaborative Memory and Insights Circulation for Long-Horizon LLM Agents in Cloud-Edge Systems

arXiv:2606.00756v1 Announce Type: new Abstract: Deploying lightweight Large Language Model (LLM) agents on edge servers can reduce latency and move agentic services closer to users, but resource-const

Does Compression Preserve Uncertainty? A Unified Benchmark for Quantized and Sparse LLMs via Conformal Prediction

arXiv:2606.01850v1 Announce Type: new Abstract: Model compression techniques such as quantization and pruning are widely used to reduce the deployment cost of large language models (LLMs), with existi

From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier Detection

arXiv:2602.03018v2 Announce Type: replace Abstract: Outlier detection (OD) is widely used in practice; but its effective deployment on new tasks is hindered by lack of labeled outliers, which makes al

Graph Transfer Learning via Shared Latent Geometry: Theory and Applications

arXiv:2606.00716v1 Announce Type: new Abstract: Inference and control in engineered physical systems pay a heavy physics cost at deployment: state estimators, inverse-problem solvers, model-predictive

Incentives, Equilibria, and the Limits of Healthcare AI: A Game-Theoretic Perspective

arXiv:2603.28825v2 Announce Type: replace-cross Abstract: Using a stylised coordination problem drawn from inpatient capacity management, three archetypal forms of AI deployment are described: effort-

applicationsarxiv-cs-ai

RealityTest: How People Probe AI Identity and Whether Models Disclose It

arXiv:2606.00168v1 Announce Type: new Abstract: AI systems are increasingly deployed in conversational settings where users may be uncertain whether they are speaking with a human or an AI. Despite mo

Silent Failures in Federated Personalization of Foundation Models

arXiv:2606.00947v1 Announce Type: cross Abstract: Foundation models are increasingly personalized on decentralized private data through federated learning and are now deployed at scale under growing r

safetyarxiv-cs-ai

Tempora: Characterising the Time-Contingent Utility of Online Test-Time Adaptation

arXiv:2602.06136v2 Announce Type: replace-cross Abstract: Test-time adaptation (TTA) offers a compelling remedy for machine learning (ML) models that degrade under domain shifts, improving generalisat

researcharxiv-cs-cv

Agents

A Unified and Reproducible Experimentation Framework for Speech Understanding

arXiv:2605.30899v1 Announce Type: cross Abstract: Speech foundation models and Speech LLMs have advanced speech understanding, yet deployment-oriented model selection is hindered by non-comparable eva

agentsarxiv-cs-ai

CoFiDA-M: Concept-Aware Feature Modulation for Cross-Domain Adaptation with Image-Only Inference

model-releasesarxiv-cs-cv

arXiv:2605.31591v1 Announce Type: new Abstract: Models for AI-based skin cancer screening suffer a severe performance drop when shifting from expert dermoscopic (source) images to consumer-grade clini

Industry

DigitalOcean Serverless Inference: A Deep Dive

DigitalOcean's serverless inference offering enables developers to deploy and run machine learning models without managing underlying infrastructure, automatically scaling resources based on demand. T

industrydigitalocean

EMBGuard: Constructing Hazard-Aware Guardrails for Safe Planning in Embodied Agents

arXiv:2605.30924v1 Announce Type: new Abstract: MLLM-powered embodied agents deployed in real-world environments encounter physical hazards. However, existing approaches lack explicit mechanisms for i

Tutorials

Jamming-Resilient PRB Reservation for Latency-Critical O-RAN Network Slicing

arXiv:2605.30622v1 Announce Type: cross Abstract: Open radio access network (O-RAN) architectures enable near real-time, software-driven control of network slicing through programmable xApps deployed

tutorialsarxiv-cs-lg

MedFact: Benchmarking the Fact-Checking Capabilities of Large Language Models on Chinese Medical Texts

arXiv:2509.12440v3 Announce Type: replace-cross Abstract: Deploying Large Language Models (LLMs) in medical applications requires fact-checking capabilities to ensure patient safety and regulatory com

NeUQI: Near-Optimal Uniform Quantization Parameter Initialization for Low-Bit LLMs

arXiv:2505.17595v4 Announce Type: replace-cross Abstract: Large language models (LLMs) achieve impressive performance across domains but face significant challenges when deployed on consumer-grade GPU

OrcaRouter: A Production-Oriented LLM Router with Hybrid Offline-Online Learning

arXiv:2605.30736v1 Announce Type: cross Abstract: The rapid development of large language models, each with distinct capabilities and inference costs, raises a practical deployment question: given an

applicationsarxiv-cs-ai

Tutorials

Personalize Your Large Vision-language Models With In-context Prompt Tuning

arXiv:2605.31513v1 Announce Type: new Abstract: Large vision-language models (LVLMs) have demonstrated strong general multimodal capability and are increasingly deployed in downstream systems. This tr

tutorialsarxiv-cs-cv

Agents

SpecDB: LLM-Generated Customized Databases via Feature-Oriented Decomposition

arXiv:2605.31097v1 Announce Type: cross Abstract: Mainstream relational databases ship a uniform feature set across deployments, although individual workloads exercise only a fraction of the available

agentsarxiv-cs-ai