Search: “deployment”

Fast KV Compaction via Attention Matching

arXiv:2602.16284v2 Announce Type: replace Abstract: Scaling language models to long contexts is often bottlenecked by the size of the key-value (KV) cache. In deployed settings, long contexts are typi

researcharxiv-cs-lg

Framing Matters: Addressing Framing Sensitivity in Decision-Making through Behaviorally-Grounded Value Alignment

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2605.28188v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly deployed in high-stakes decision-making settings such as legal reasoning, where consistency under factuall

model-releasesarxiv-cs-cl

28 May 2026

Geometry of Relaxed Fair Regression: A Unified Framework for Aware and Unaware Settings

arXiv:2605.28233v1 Announce Type: cross Abstract: Fairness-accuracy trade-offs are a central concern in the deployment of fairness-aware machine learning methods. When sensitive attributes are unavail

safetyarxiv-cs-lg

Grounded Cache Routing for Retrieval-Augmented Generation: When Is It Safe to Reuse an Answer?

arXiv:2605.27494v1 Announce Type: cross Abstract: Modern retrieval-augmented generation(RAG) deployments increasingly rely on caching to reduce token cost and time-to-first-token(TTFT). Prefix-level K

safetyarxiv-cs-ai

Harness-Bench: Measuring Harness Effects across Models in Realistic Agent Workflows

arXiv:2605.27922v1 Announce Type: new Abstract: LLM agents are increasingly deployed as executable systems that use tools, modify workspaces, and produce concrete artifacts. In such workflows, perform

How enterprise leaders are scaling AI agents across their organization

Enterprise leaders are implementing AI agents across their organizations through strategies that address deployment, governance, and integration challenges. The article from Databricks likely covers b

applicationsdatabricks

Human-like in-group bias in instruction-tuned language model agents

arXiv:2605.28114v1 Announce Type: new Abstract: As autonomous AI agents are deployed in persistent, interacting networks -- coordinating tasks, routing resources, and accumulating reputational histori

safetyarxiv-cs-ai

Industry

IBM expands digital sovereignty push with new cloud compliance and visibility platform

IBM Corp. today introduced a new cloud sovereignty tool aimed at helping enterprises demonstrate compliance, operational control and governance as artificial intelligence deployments expand across hyb

industrysiliconangle

JMedEthicBench: A Multi-Turn Conversational Benchmark for Evaluating Medical Safety in Japanese Large Language Models

arXiv:2601.01627v3 Announce Type: replace-cross Abstract: As Large Language Models (LLMs) are increasingly deployed in healthcare field, it becomes essential to carefully evaluate their medical safety

Agents

Learn from Weaknesses: Automated Domain Specialization for Small Computer-Use Agents

arXiv:2605.28775v1 Announce Type: cross Abstract: Computer-use agents (CUAs) have recently made substantial progress, but deploying a separate large expert for each software domain remains expensive.

agentsarxiv-cs-ai

Models That Know How Evaluations Are Designed Score Safer

arXiv:2605.28591v1 Announce Type: cross Abstract: The validity of AI safety evaluations depends on models behaving consistently across controlled and deployment settings. Prior work has identified tes

Multi-Teacher Knowledge Distillation via Teacher-Informed Mixture Priors

arXiv:2605.27967v1 Announce Type: cross Abstract: Knowledge distillation is a powerful method for model compression, enabling the efficient deployment of complex deep learning models (teachers), inclu

Neural Weight Compression for Language Models

arXiv:2510.11234v3 Announce Type: replace Abstract: Efficient compression of language model weights is increasingly critical as model scale and deployment grow. Yet, most existing methods rely on hand

researcharxiv-cs-lg

Optimal Data Acquisition for Reinforcement Learning: A Large Deviations Perspective

arXiv:2605.28675v1 Announce Type: new Abstract: Data acquisition efficiency is a central challenge in deploying reinforcement learning in business and healthcare operations, where interactions are cos

safetyarxiv-cs-lg

Local Ai

PocketGS: On-Device Training of 3D Gaussian Splatting for High Perceptual Modeling

arXiv:2601.17354v5 Announce Type: replace Abstract: While 3D Gaussian Splatting (3DGS) enables real-time rendering, its training demands workstation-level compute and memory, making mobile deployment

local-aiarxiv-cs-cv

Probing Social Identity Bias in Chinese LLMs with Gendered Pronouns and Social Groups

arXiv:2510.06974v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly deployed in user-facing applications, raising concerns that they may reflect and amplify social biases

safetyarxiv-cs-cl

RAGe: A Retrieval-Augmented Generation Evaluation Framework

arXiv:2605.27445v1 Announce Type: cross Abstract: Deploying Large Language Model (LLM) applications, particularly those relying on Retrieval-Augmented Generation (RAG), remains challenging due to high

Rethinking Visual Neglect: Steering via Context-Preference for MLLM Hallucination Mitigation

arXiv:2605.27993v1 Announce Type: new Abstract: Object hallucination remains a primary obstacle to the reliable deployment of Multimodal Large Language Models (MLLMs). Current inference-time mitigatio

researcharxiv-cs-cl

Local Ai

Reverse Probing: Supervised Token-level Uncertainty Quantification for Large Language Models in Clinical Text

arXiv:2605.28740v1 Announce Type: cross Abstract: As large language models are increasingly deployed for clinical text, ensuring they can reliably signal their own uncertainty becomes critical. Most e

local-aiarxiv-cs-ai

Revisiting Change Detection Methods for their Application to Serac Fall Time-Lapse Monitoring

arXiv:2605.28100v1 Announce Type: cross Abstract: In an era where climate change aggravates environmental uncertainties, the identification and detection of event precursors are becoming crucial to mi

RULER: Representation-Level Verification of Machine Unlearning

arXiv:2605.27569v1 Announce Type: new Abstract: Machine unlearning aims to remove the influence of specific training records from a deployed model without retraining from scratch. Current protocols ve

Safety-Critical Adaptive Impedance Control via Nonsmooth Control Barrier Functions under State and Input Constraints

arXiv:2605.28367v1 Announce Type: new Abstract: Safe physical interaction is critical for deploying robotic manipulators in human-robot interaction and contact-rich tasks, where uncertainty, external

safetyarxiv-cs-ro

Tutorials

SAFEVPR: Patch-Based Conformal Verification for Safe Cross-Condition Sequence Visual Place Recognition

arXiv:2605.28048v1 Announce Type: new Abstract: Sequence-based visual place recognition (VPR) for SLAM and robot relocalization must decide whether the retrieved top-1 candidate is safe to accept. Con

tutorialsarxiv-cs-ro

SAME: Stabilized Mixture-of-Experts for Multimodal Continual Instruction Tuning

arXiv:2602.01990v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) achieve strong performance through instruction tuning, but real-world deployment requires them to con

Tutorials

“The mechanism is always the same in every story I've been covering. The demo works in a controlled environment with clean inputs. The deplo…

“The mechanism is always the same in every story I've been covering. The demo works in a controlled environment with clean inputs. The deployment fails because real kitchens, real intersections, and r

tutorialsgary-marcus--x

We're taking on the hardest problems in the real world 🏗️🚚 🛫⚛️ Today at The AI Now Summit, held at the Louvre, we announced AI solutions …

applicationsmistral-ai--x

We're taking on the hardest problems in the real world 🏗️🚚 🛫⚛️ Today at The AI Now Summit, held at the Louvre, we announced AI solutions for aerospace, automotive, energy, and physics. Deployed in pro

When Helpful Context Leaks: Privacy Risks in Domain-Adapted ASR

arXiv:2605.28211v1 Announce Type: new Abstract: SpeechLLMs are increasingly deployed in professional settings where domain customisation is standard practice: users supply context in prompts with sens

researcharxiv-cs-cl

Local Ai

When NPUs Are Not Always Faster: A Stage-Level Analysis of Mobile LLM Inference

arXiv:2605.27435v1 Announce Type: cross Abstract: Deploying large language models (LLMs) on mobile devices increasingly relies on heterogeneous execution, yet no prior study has systematically charact

local-aiarxiv-cs-ai

You Live More Than Once: Towards Hierarchical Skill Meta-Evolving

arXiv:2605.28390v1 Announce Type: new Abstract: Test-time skill evolving is regarded as a new paradigm for enhancing deployed agentic systems. Existing works mainly focus on hard-coded skill evolving

A Guide to AI Cold Starts on Cloud Run

model-releasesgoogle-cloud-ai

I saw a developer asking on Reddit if there was any “sane way” to manage Cloud Run cold starts for AI across multiple regions. They were experiencing startup latencies of up to 20 seconds, a frustrati

Agents

AI Factories: The New Infrastructure of Intelligence

AI factories are token factories, converting power into intelligence in real time. And as agentic AI scales and autonomous, always-on special agents are deployed in the enterprise, performance per wat

agentsnvidia-blog

Augment Engineering: A Methodology for Multi-Tool AI Orchestration Across Professional Domains

arXiv:2605.26146v1 Announce Type: cross Abstract: Organizations increasingly deploy separate purpose-built AI tools across professional domains, often hiring domain specialists for each, recreating th

Breaking the Epistemic Trap: Active Perception Under Compound Uncertainty

arXiv:2605.26627v1 Announce Type: cross Abstract: Deploying reinforcement learning in safety critical domains, from autonomous vehicles to medical decision support, is constrained by failures arising

safetyarxiv-cs-ro

Dense2MoE: Pushing the Pareto Frontier of On-Device LLMs via Unified Pruning and Upcycling

arXiv:2605.26496v1 Announce Type: cross Abstract: The Mixture of Experts MoE architecture is highly promising for resource constrained on device deployments yet training these models from scratch incu

Detail Consistent Stage-Wise Distillation for Efficient 3D MRI Segmentation

arXiv:2605.26382v1 Announce Type: new Abstract: Deploying high-performing 3D medical image segmenters (e.g., nnU-Net) is often limited by memory footprint and inference latency. Compression is therefo

researcharxiv-cs-cv

Detecting Is Not Resolving: The Monitoring Control Gap in Retrieval Augmented LLMs

arXiv:2605.27157v1 Announce Type: new Abstract: Retrieval-augmented LLMs are deployed for tasks where evidence quality determines action safety, yet evaluation protocols assume that single-turn robust

safetyarxiv-cs-ai

ENPMR-Bench: Benchmarking Proactive Memory Retrieval for Emotional Support Agents

model-releasesarxiv-cs-cl

arXiv:2605.27240v1 Announce Type: new Abstract: Memory-augmented language agents are increasingly deployed in affective applications such as emotional support, where understanding and responding to us

Entropy Sentinel: Continuous LLM Accuracy Monitoring from Decoding Entropy Traces in STEM

model-releasesarxiv-cs-cl

arXiv:2601.09001v4 Announce Type: replace Abstract: Deploying LLMs raises two coupled challenges: (1) monitoring--estimating where a model underperforms as traffic and domains drift--and (2) improveme

Evaluating the Relevance of Uncertainty Estimators for LLM Hallucination

arXiv:2605.27016v1 Announce Type: cross Abstract: Large language models (LLMs) are prone to hallucinations, i.e., statements unsupported by the input or training data, hindering reliable deployment. I

'Give Me BF16 or Give Me Death'? Accuracy-Performance Trade-Offs in LLM Quantization

arXiv:2411.02355v4 Announce Type: replace-cross Abstract: Quantization is a powerful tool for accelerating large language model (LLM) inference, but the accuracy-performance trade-offs across differen

Hubness, Not Anisotropy, Drives Cross-Lingual Retrieval Asymmetry in Multilingual Embedding Models

model-releasesarxiv-cs-cl

arXiv:2605.26575v1 Announce Type: new Abstract: Multilingual embedding models are deployed under the assumption that cross-lingual retrieval is symmetric: if a query in language A retrieves its transl

ICCU: In-Context Continual Unlearning via Pattern-Induced Refusal Rules

arXiv:2605.27138v1 Announce Type: new Abstract: Machine unlearning aims to remove the influence of specific data from trained language models. In real-world deployments, unlearning requests often arri

InfoQuant: Shaping Activation Distributions for Low-Bit LLM Quantization

arXiv:2605.26175v1 Announce Type: cross Abstract: Low-bit activation quantization remains a major bottleneck in efficient large language model (LLM) deployment. The difficulty is not only that activat

It's Not the Capability: Harness Sensitivity Is Non-Monotone Across LLM Agent Tiers

arXiv:2605.26731v1 Announce Type: new Abstract: A prevalent assumption in LLM agent deployment holds that more structured harnesses universally improve reliability, and that higher-capability models n

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors

arXiv:2605.26955v1 Announce Type: cross Abstract: As large language models (LLMs) are increasingly deployed to users around the world, they are integrated into everyday tasks across diverse cultural c

Leveraging Visual Signals for Robust Token-Level Uncertainty in Vision-Language Generation

arXiv:2605.27136v1 Announce Type: new Abstract: Uncertainty quantification (UQ) remains a critical challenge in Large Vision Language Models (LVLMs) for reliable predictions and real-world deployment.

applicationsarxiv-cs-cv

LURE: Live-Usage Replay Evaluations for Reducing Evaluation Awareness

arXiv:2605.26438v1 Announce Type: cross Abstract: Large language models can recognize when they are being evaluated (evaluation awareness) and behave differently because of that, which undermines the

Max-Window Scale Estimation for Near-Lossless HiF8 W8A8 Quantization-Aware Training

arXiv:2605.26189v1 Announce Type: cross Abstract: Quantization-aware training (QAT) with low-bit floating-point formats enables efficient LLM deployment, yet introduces subtle failure modes invisible