Search: “inference”

Build **b8779** is an incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), an open-source C/C++ framework for running large language model inference locally and in the cloud. Lik

llama.cpp build b8781 is the latest release of the open-source C/C++ LLM inference framework, published on April 13, 2026. Its primary change introduces a dedicated DeepSeek v3.2 chat parser along wit

arXiv:2509.14875v2 Announce Type: replace-cross Abstract: Characterizing the geometry of an object orbiting around a star from its transit light curve is a powerful tool to uncover various complex phe

arXiv:2604.09089v1 Announce Type: cross Abstract: Large Language Models (LLMs) for code generation can replicate insecure patterns from their training data. To mitigate this, a common strategy for sec

arXiv:2604.09450v1 Announce Type: cross Abstract: Chest X-ray report generation (CXR-RG) has the potential to substantially alleviate radiologists' workload. However, conventional autoregressive visio

arXiv:2604.09127v1 Announce Type: new Abstract: Lightweight face recognition is increasingly important for deployment on edge and mobile devices, where strict constraints on latency, memory, and energ

arXiv:2601.18150v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) for large language models (LLMs) is increasingly bottlenecked by rollout (generation), where long output sequence

arXiv:2604.08581v1 Announce Type: new Abstract: This paper presents a fully autonomous Tiny Machine Learning (TinyML) Z-Score-based anomaly detection system deployed on a low-power microcontroller for

arXiv:2604.08894v1 Announce Type: cross Abstract: Spiking Neural Networks (SNNs) offer superior energy efficiency over Artificial Neural Networks (ANNs). However, they encounter significant deficienci

This Reddit post on r/MachineLearning presents a community-contributed dictionary of contemporary Large Language Model (LLM) terminology, covering terms related to training, fine-tuning, inference, al

This r/StableDiffusion post discusses community experimentation with custom sigma schedules for the LTX-2.3 Distilled video generation model — a fast-inference checkpoint that completes video generati

arXiv:2604.09124v1 Announce Type: cross Abstract: Deploying DNNs on System-on-Chips (SoC) with multiple heterogeneous acceleration engines is challenging, and the majority of deployment frameworks can

Users in the r/ollama community reported that Ollama reduced the usage limits on their Pro subscription tier for cloud-hosted inference. Ollama Cloud is available through subscription tiers including

Wall Street Journal: Ornn Compute Price Index: renting one Nvidia Blackwell GPU for an hour now costs 4.08, up 48% from 2.75 two months ago, driven by agentic AI demand — AI companies are rationing of

arXiv:2604.09499v1 Announce Type: new Abstract: Autonomous racing without prebuilt maps is a grand challenge for embedded robotics that requires kinodynamic planning from instantaneous sensor data at

TurboOCR is a high-performance OCR project that combines PaddleOCR with NVIDIA TensorRT, implemented in C++ and CUDA, achieving throughput of 270–1,200 images per second using FP16 half-precision infe

arXiv:2604.09041v1 Announce Type: cross Abstract: AI-based weather forecasting now rivals traditional physics-based ensembles, but state-of-the-art (SOTA) models rely on specialized architectures and

A Reddit post on r/StableDiffusion showcasing image generations using a combination of Z-Image Turbo — a distilled 6B parameter efficient image generation model with sub-second inference latency — pai

Build b8766 is a numbered incremental release of llama.cpp, the open-source C/C++ framework for running large language model inference locally. Like other builds in its rapid release cycle, it likely

Build **b8769** is an incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ library for running large language model inference locally. Like all llama.cpp bu

**b8770** is a sequentially numbered automated build release of [llama.cpp](https://github.com/ggml-org/llama.cpp), an open-source C/C++ framework for running large language model (LLM) inference loca

MiniMax M2.7 is an enhancement of the MiniMax M2.5 model, built as a 230B-parameter Mixture-of-Experts (MoE) model with 10B active parameters per token and a 200K context length, designed for agentic

MiniMax-M1 is a large-scale open-weight reasoning model developed by MiniMax, featuring a hybrid Mixture-of-Experts (MoE) architecture with 456 billion total parameters (activating 45.9 billion per to

llama.cpp build **b8751** is a tagged release of the [ggml-org/llama.cpp](https://github.com/ggml-org/llama.cpp) project, a C/C++ library enabling high-performance LLM inference with minimal setup ...

llama.cpp release **b8752** is a tagged build of the [ggml-org/llama.cpp](https://github.com/ggml-org/llama.cpp) project — a C/C++ framework for efficient LLM inference on a wide range of hardware....

llama.cpp release **b8754** is a tagged build of the open-source C/C++ LLM inference library maintained under the `ggml-org` GitHub organization. The release includes pre-built binaries for a wide ...

llama.cpp release **b8755** is a tagged build of the [ggml-org/llama.cpp](https://github.com/ggml-org/llama.cpp) project — a C/C++ library for local LLM inference. This build is one of the project'...

**b8757** is a versioned build release of [llama.cpp](https://github.com/ggml-org/llama.cpp), an open-source C/C++ framework for running large language model (LLM) inference locally on consumer hardwa

Build **b8759** is an incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ library for local LLM inference using GGUF-format models. Like other builds in th

llama.cpp release **b8760** is a build of the open-source C/C++ LLM inference framework, with its primary change being a tensor parallelism (TP) fix for Qwen 3 regarding next data split (PR #21732). P

Build b8761 is an incremental release of **llama.cpp**, an open-source C/C++ framework for running large language model (LLM) inference locally with minimal dependencies. Like neighboring builds in th

llama.cpp build b8763 is a release of the open-source C/C++ LLM inference library, published on April 11, 2025, with the primary change being a CUDA optimization to skip compilation of superfluous fla

A developer shared an open-source Android keyboard on r/ollama that integrates local AI capabilities by connecting to self-hosted inference servers such as Ollama, LM Studio, or any OpenAI-compatible

Nous Research partnered with Xiaomi to integrate Xiaomi's MiMo V2 Pro inference model into its Hermes Agent framework, making it accessible via the Nous Portal for a two-week free trial period. The...

arXiv:2511.11159v2 Announce Type: replace Abstract: Many tasks in machine learning can be described as or reduced to learning a probability distribution given a finite set of samples. A common approac

arXiv:2508.07112v4 Announce Type: replace-cross Abstract: Lifting-based 3D human pose estimation infers 3D joints from 2D keypoints but generalizes poorly because (x,y) coordinates alone are an ill-

llama.cpp release **b8740** (commit `e34f042`) is a build of the open-source C/C++ LLM inference engine focused on the change 'CUDA: fuse muls' (PR #21665), which optimizes CUDA performance by fusi...

llama.cpp **b8741** is an incremental build release of the open-source [llama.cpp](https://github.com/ggml-org/llama.cpp) project, which provides LLM inference in C/C++. It is one of many frequentl...

llama.cpp release **b8742** (commit `7b69125`) is a incremental build of the C/C++ LLM inference engine focused on a Vulkan backend enhancement: it adds Q1_0 quantization type support to `ggml-vulk...

llama.cpp release **b8744**, published on April 10, 2026, is a build of the ggml-org/llama.cpp C/C++ LLM inference engine. Its primary change enables the reasoning budget sampler for Gemma 4 by add...

llama.cpp release **b8747** is the latest build of the C/C++ LLM inference engine, published on April 10, 2026 (commit `fb38d6f`). Its primary change is a bug fix in the `common` layer that resolve...

Ollama Cloud offers Free, Pro ($20/month), and Max ($100/month) subscription tiers for cloud-hosted inference, but token generation speed depends on model size, architecture, and hardware optimiza...

arXiv:2604.08369v1 Announce Type: cross Abstract: Inference-time compute scaling has emerged as a powerful technique for improving the reliability of large language model (LLM) agents, but existing me

arXiv:2604.03540v2 Announce Type: replace Abstract: Although multi-step generative policies achieve strong performance in robotic manipulation by modeling multimodal action distributions, they require

arXiv:2604.06596v1 Announce Type: cross Abstract: Semi-supervised learning aims to infer class labels using only a small fraction of labeled data. In graph-based semi-supervised learning, this is typi

arXiv:2604.07003v1 Announce Type: new Abstract: Large language models (LLMs) has been widely used for automated negotiation, but their high computational cost and privacy risks limit deployment in pri