Search: “inference”

b9000 is a build release of llama.cpp, a C/C++ implementation for LLM inference . The release follows the project's rapid development cycle where multiple releases can be published in a single day . A

B9002 is a build release of llama.cpp, a C/C++ implementation for LLM inference. The release includes compiled binaries and artifacts for multiple platforms and hardware configurations, as part of the

llama.cpp b8999 is a build release from the llama.cpp project, which provides LLM inference in C/C++ . This build represents an intermediate development version in the project's rapid release cycle. T

arXiv:2409.16808v1 Announce Type: cross Abstract: Modern applications, such as autonomous vehicles, require deploying deep learning algorithms on resource-constrained edge devices for real-time image

arXiv:2604.26959v1 Announce Type: cross Abstract: Integrating large language models (LLMs) into patient-facing healthcare systems offers significant potential to improve access to medical information.

arXiv:2604.27251v1 Announce Type: cross Abstract: Large Language Models (LLMs) are known to acquire reasoning capabilities through shared inference patterns in pre-training data, which are further eli

arXiv:2604.02715v2 Announce Type: replace Abstract: Mixture-of-Experts (MoE) models have become a dominant paradigm for scaling large language models, but their rapidly growing parameter sizes introdu

I have been testing DeepSeek-V4-Pro with the Pi coding agent. I am mindblown by how well it works out of the box. A few notes: I spent a few hours building an LLM wiki with an agent powered entirely b

arXiv:2412.05135v2 Announce Type: replace-cross Abstract: We propose a novel method for measuring the discrepancy between a set of samples and a desired posterior distribution for Bayesian inference.

b8983 is a release of llama.cpp, a C/C++ implementation for LLM inference. The release represents a specific build/commit version in the active development of the llama.cpp project, which supports run

Release b8987 of llama.cpp updates cpp-httplib to version 0.43.2 . This is a minor maintenance release from the llama.cpp project, which provides C/C++ inference for large language models. The release

llama.cpp b8990 is a release version of a C/C++ LLM inference tool from the ggml-org project. The release likely contains bug fixes, performance improvements, or new features for local language model

llama.cpp is a C/C++ implementation for LLM inference , and b8991 is a specific release version from the project's ongoing development cycle. The search results indicate that the project doesn't follo

b8992 is a build release from the llama.cpp project, which publishes multiple releases in a single day . llama.cpp enables LLM inference with minimal setup and state-of-the-art performance on a wide r

arXiv:2512.08982v2 Announce Type: replace-cross Abstract: Retinex-based low-light image enhancement benefits from separating reflectance and illumination, yet recent generative approaches often rely o

arXiv:2604.26378v1 Announce Type: new Abstract: Post-training quantization (PTQ) has become an important technique for reducing the inference cost of Large Language Models (LLMs). While recent mixed-p

arXiv:2604.26881v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) models offer high capacity with efficient inference cost by activating a small subset of expert models per input. However, de

arXiv:2603.19199v2 Announce Type: replace-cross Abstract: Real-time execution is crucial for deploying Vision-Language-Action (VLA) models in the physical world. Existing asynchronous inference method

Featherless.ai Inc., a serverless inference platform startup that hosts open-source artificial intelligence models, today revealed it has raised 20 million in new funding to expand its global infrastr

arXiv:2604.26070v1 Announce Type: new Abstract: Causal inference in continuous-time sequential decision problems is challenged by hidden confounders. We show that, in latent state-space models with ti

arXiv:2604.26039v1 Announce Type: cross Abstract: The optimal kernel configuration for Mixture-of-Experts (MoE) inference depends on both batch size and the expert routing distribution, yet production

arXiv:2604.25975v1 Announce Type: cross Abstract: Key-value (KV) caching is essential for large language model inference, yet its memory overhead poses a critical bottleneck for long-context generatio

arXiv:2512.18583v2 Announce Type: replace Abstract: Adversarial Imitation Learning (AIL) is a dominant framework in imitation learning that infers rewards from expert demonstrations to guide policy op

arXiv:2604.26355v1 Announce Type: new Abstract: Reasoning in Large Language Models incurs significant inference-time compute, yet the token-level information structure of reasoning traces remains unde

arXiv:2604.25925v1 Announce Type: new Abstract: Autoregressive language models suffer from high inference latency due to their sequential decoding nature. Speculative decoding (SD) mitigates this by e

arXiv:2604.26422v1 Announce Type: cross Abstract: Accurate end-to-end tail-latency forecasting is critical for proactive SLO management in microservice systems. However, modeling long-range dependency

arXiv:2505.13963v3 Announce Type: replace Abstract: Quantization methods are widely used to accelerate inference and streamline the deployment of large language models (LLMs). Although quantization's

Today we’re releasing Qwen-Scope 🔭, an open suite of sparse autoencoders for the Qwen model family. It turns SAE features into practical tools： 🎯 Inference — Steer model outputs by directly manipulati

arXiv:2511.22972v3 Announce Type: replace Abstract: Large language models (LLMs) achieve strong performance across diverse tasks but suffer from high inference latency due to their autoregressive gene

arXiv:2603.07080v3 Announce Type: replace-cross Abstract: Vision-and-Language Navigation (VLN) increasingly relies on large vision-language models, but their inference cost conflicts with real-time de

arXiv:2604.26934v1 Announce Type: new Abstract: Vision-language models (VLMs) have shown strong performance on static visual understanding, yet they still struggle with dynamic spatial reasoning that

b8969 is a release build of llama.cpp (commit bdc9c74), published on April 29, 2026. Llama.cpp is a C/C++ implementation designed to enable LLM inference with minimal setup and state-of-the-art perfor

b8970 is a release of llama.cpp, a C/C++ project for large language model inference. The naming convention using a build hash (b8970) is typical of llama.cpp's continuous release pattern rather than t

b8971 is a build release of llama.cpp, an open-source C/C++ project for LLM inference . As a numbered build identifier from the llama.cpp repository, this release likely contains bug fixes, performanc

b8972 is a release of llama.cpp, a C/C++ implementation for LLM inference . The release identifier follows llama.cpp's development versioning scheme with frequent builds published to the GitHub releas

b8973 is a release of llama.cpp that added SVE tuned code for the gemm_q8_0_4x8_q8_0() kernel and changed arrays to static const in repack.cpp . The llama.cpp project enables LLM inference with minima

b8978 is a release of llama.cpp, a project designed to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware. The llama.cpp project uses sequential build

arXiv:2604.25774v1 Announce Type: new Abstract: Accurate nutrient estimation from unstructured recipe text is an important yet challenging problem in dietary monitoring, due to ambiguous ingredient te

arXiv:2602.01433v2 Announce Type: replace Abstract: Multivariate time series in domains such as finance, climate science, and healthcare often exhibit long-term trends, seasonal patterns, and short-te

arXiv:2604.25300v1 Announce Type: new Abstract: Deploying tiny object perception on edge platforms is challenging because practical systems must satisfy both strict compute budgets and end-to-end late

arXiv:2604.25533v1 Announce Type: new Abstract: Worldwide image geo-localization aims to infer the geographic location of an image captured anywhere on Earth, spanning street, city, regional, national

arXiv:2604.24972v1 Announce Type: new Abstract: Clinical abnormality grounding for rare diseases is often hindered by data scarcity, making supervised fine-tuning impractical and single-pass inference

IMO DeepSeek v4 demonstrated utter confidence and competence by not benchmaxxing, not focusing on some BS final run cost, not even spending inference-optimal compute. just showed up, demonstrated SOTA

arXiv:2604.24827v1 Announce Type: new Abstract: Closed-source frontier labs do not disclose parameter counts, and the standard alternative -- inference economics -- carries 2imes+ uncertainty from har

arXiv:2604.24809v1 Announce Type: new Abstract: We present Nautile-370M, a 371-million-parameter small language model designed for efficient reasoning under strict parameter and inference budgets. Nau

arXiv:2604.25859v1 Announce Type: new Abstract: World action models jointly predict future video and action during training, raising an open question about what role the future-prediction branch actua