Search: “inference”

B9048 is a build/release of llama.cpp, an open-source C/C++ implementation for running large language model inference. The release includes optimizations and improvements to the core llama.cpp softwar

Claude Desktop has a third-party inference feature that lets you replace Anthropic's API with any model provider, including a local AI model running entirely on your machine. This feature can be activ

arXiv:2605.00831v1 Announce Type: cross Abstract: The rise of million-token, agent-based applications has placed unprecedented demands on large language model (LLM) inference services. The long-runnin

arXiv:2603.03756v3 Announce Type: replace-cross Abstract: While large language models (LLMs) show promise in scientific discovery, existing research focuses on inference or feedback-driven training, l

arXiv:2605.02255v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly deployed in interactive and retrieval-augmented settings, raising significant privacy concerns. While at

arXiv:2605.01280v1 Announce Type: cross Abstract: This position paper argues that LLM inference serving has outgrown generic heuristics and now demands mathematical optimization and algorithmic founda

arXiv:2602.22575v2 Announce Type: replace Abstract: Attention scales quadratically with sequence length, fundamentally limiting long-context inference. Existing block-granularity sparsification can re

arXiv:2603.03251v3 Announce Type: replace Abstract: Autoregressive decoding is bottlenecked by its sequential nature. Speculative decoding has become a standard way to accelerate inference by using a

arXiv:2505.08392v3 Announce Type: replace Abstract: Chain-of-Thought (CoT) prompting trades inference speed for reasoning accuracy. Existing compressors force a compromise as static gradient technique

Also Instead of the gold standard, we can imagine an inference standard of exchange, the FLOP. (As opposed to tokens, this accounts for AI ability) With some AI help, I figure 1 buys roughly 10^17 man

arXiv:2605.01226v1 Announce Type: new Abstract: Events in spatiotemporal systems are ubiquitous, yet modeling their complex distributions remains challenging. Existing point process models often rely

B9028 is a release build from the llama.cpp project, which provides LLM inference in C/C++. The llama.cpp project uses sequential build numbers (like b9028) to track intermediate releases of its LLM i

arXiv:2502.06774v4 Announce Type: replace Abstract: Ensuring neural networks adhere to domain-specific constraints is crucial for addressing safety and trustworthiness while also enhancing inference a

arXiv:2510.15545v4 Announce Type: replace Abstract: Accelerating the inference of large language models (LLMs) has been a critical challenge in generative AI. Speculative decoding (SD) substantially i

llama.cpp enables LLM inference in C/C++ , and release b9014 represents a build revision or commit snapshot from the llama.cpp repository on GitHub. This release would include bug fixes, feature impro

B9018 is the latest version of llama.cpp released on May 4, 2026. Llama.cpp is a project for LLM inference in C/C++ , providing efficient large language model execution with broad hardware support inc

b9019 is a release of llama.cpp, a C/C++ implementation for LLM inference. As a release tag from the ggml-org/llama.cpp repository, it represents a specific commit or version of the project that inclu

b9020 is a build release of llama.cpp (a C/C++ implementation of LLM inference) released on May 4, 2026, with precompiled binaries available for multiple platforms including macOS, Android, OpenEuler,

b9025 is a release from llama.cpp, a C/C++ project for LLM inference . The release uses a build numbering system for intermediate versions of the library. As a llama.cpp release, it likely includes up

arXiv:2605.00545v1 Announce Type: new Abstract: Inferring cellular trajectories from destructive snapshots is complicated by the challenges of stochasticity and non-conservative mass dynamics such as

arXiv:2605.00644v1 Announce Type: new Abstract: Energy-based models (EBMs) are a flexible class of deep generative models and are well-suited to capture complex dependencies in multimodal data. Howeve

arXiv:2605.00497v1 Announce Type: cross Abstract: Recent advances in user modeling make it feasible to conduct open-ended inference over a person's everyday computer use. Despite longstanding visions

b9012 is a build version from the llama.cpp GitHub repository, which is an LLM inference implementation in C/C++ . The release likely contains updates, bug fixes, and improvements to the llama.cpp inf

llama.cpp is an LLM inference framework in C/C++ that enables efficient local execution of large language models. Build b9004 is a recent release with optimizations and improvements for supporting var

b9010 is a build release of llama.cpp, an open-source project for LLM inference in C/C++ . As a numbered build tag in the llama.cpp release system, it represents a specific development build containin

llama.cpp is a C/C++ implementation that enables LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware locally and in the cloud. Release b8995 is a build/versio

arXiv:2604.27039v1 Announce Type: new Abstract: Token serves as the fundamental unit of computation in modern autoregressive models, and generation length directly influences both inference cost and r

arXiv:2506.05412v3 Announce Type: replace-cross Abstract: Where someone looks is a nonverbal communication cue that children and adults readily use. How well can Vision-Language Models (VLMs) infer ga

arXiv:2604.25326v2 Announce Type: replace-cross Abstract: Speculative decoding enhances the inference efficiency of large language models (LLMs) by generating drafts using a small draft language model

arXiv:2604.26768v1 Announce Type: new Abstract: Parametric Retrieval-Augmented Generation (PRAG) encodes external documents into lightweight parameter modules that can be retrieved and merged at infer

arXiv:2604.26095v1 Announce Type: new Abstract: {Closed-loop inverse source localization and characterization (ISLC) requires a mobile agent to select measurements that localize sources and infer late

arXiv:2603.05959v3 Announce Type: replace Abstract: Reconstructing 3D geometry from streaming video requires continuous inference under bounded resources. Recent geometric foundation models achieve im

Variational Joint Embedding (VJE) is a framework that synthesizes joint embedding and variational inference to enable self-supervised learning of probabilistic representations in a reconstruction-free

Editor’s note: Want to keep up with the latest from Google Cloud? Check back here for a monthly recap of our latest updates, announcements, resources, events, learning opportunities, and more. We host

arXiv:2604.25427v1 Announce Type: new Abstract: While large-scale video diffusion models have demonstrated impressive capabilities in generating high-resolution and semantically rich content, a signif

b8981 is a release version of llama.cpp, a C/C++ implementation for LLM inference . Build versions in llama.cpp releases typically contain updates to the underlying ggml library, performance optimizat

arXiv:2604.25050v1 Announce Type: new Abstract: Unlike chatbots, physical AI must act while the world keeps evolving. Therefore, the inter-chunk pause of synchronous executors are fatal for dynamic ta

arXiv:2604.24532v1 Announce Type: new Abstract: Many sequential decision-making tasks involve optimizing multiple conflicting objectives, requiring policies that adapt to different user preferences. I

arXiv:2409.01579v2 Announce Type: replace-cross Abstract: Retrieved documents containing noise will hinder RAG from detecting answer clues and make the inference process slow and expensive. Therefore,

b8957 is a release of llama.cpp that includes spec parameter refactoring changes , featuring modifications to parameter handling and model specifications. The llama.cpp project enables LLM inference w

b8958 is a release of llama.cpp, a C/C++ library for LLM inference . The project uses rapid release cycles with frequent version tags tracking incremental updates and improvements to the codebase. Thi

llama.cpp b8967 is an intermediate build release of llama.cpp, a C/C++ implementation for LLM inference with minimal setup and state-of-the-art performance. The project follows a rapid release cycle w

arXiv:2604.24447v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models are promising for generalist robot control, but on-robot deployment is bottlenecked by real-time inference under t

arXiv:2505.13975v4 Announce Type: replace Abstract: While Large Reasoning Models (LRMs) have demonstrated success in complex reasoning tasks through long chain-of-thought (CoT) reasoning, their infere

arXiv:2604.23728v1 Announce Type: cross Abstract: Recent advances in autonomous driving have motivated research on pedestrian intention prediction, which aims to infer future crossing decisions and ac

arXiv:2604.24002v1 Announce Type: cross Abstract: Improving the effectiveness of human-robot interaction requires social robots to accurately infer human goals through robust intention understanding.