b11280
SYCL: reduce tensor allreduce sync with pinned host buffers (#29604) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51446793 macOS/iOS: macOS Apple Silicon
Knowledge catalogue
SYCL: reduce tensor allreduce sync with pinned host buffers (#29604) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51446793 macOS/iOS: macOS Apple Silicon
musa : define CUDA_ARCH for device passes (#29508) The MUSA vendor header never defined CUDA_ARCH, so every architecture test in the shared ggml-cuda sources evaluated to 0. Kernel bodies gated on the
openvino: serve GET_ROWS on a weight view from the base Constant (#28381) openvino: serve GET_ROWS on a weight view from the base Constant Resolve view_src when collecting weight Constants so a view o
cpu: accept BF16 in src1 of mul_mat (#28937) cpu: accept BF16 in src1 of mul_mat ggml_conv_1d_dw builds its im2col in F32 when the kernel is BF16, then calls ggml_mul_mat(im2col, kernel), which puts F
ggml : add BF16 unary, GLU, binary and scale ops (CPU, CUDA) (#29675) ggml : add BF16 unary, GLU, binary and scale ops (CPU, CUDA) ggml-cpu : use per-op _bf16 functions for BF16 unary and GLU ops Assi
llama: llama_prefetch_rows (#29599) llama: llama_prefetch_rows llama: support row prefetch on Windows Apply the Windows port contributed by @praneshgo unchanged. Source: #29599 (comment) avoid exposin
ci : fix Models Backend Check by shortening the hrm_text fixture (#29744) The fixture recycles its two blocks over 8 cache slots, so the fp16 error builds up past the 1e-4 NMSE bound on the Vulkan T4
jinja : support coerced array attributes (#29574) support coerced array attributes add tests Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51590476 macOS/
mimo : support dflash (convert + feature extraction) (#29650) convert : update to support dflash cont : fix Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co Co-authored-by: Sigbjørn S
cli: exit on stdin EOF and drop the console wide Ctrl+C broadcast (#29722) cli: exit on stdin EOF and drop the console wide Ctrl+C broadcast On Windows the simple input reader sends CTRL_C_EVENT to ev
ggml/gguf : fix integer overflow (#29384) ggml: fix integer overflow guard for zero-element tensors ggml: validate number of elements in tensor to prevent integer overflow ggml: fix error print Websit
glm5-next: give dead indexer slots unique scatter rows (#29745) The sparse indexer mask is built with a set_rows scatter. Padded pools, absent sequences and missing tail cells all pointed to the same
batch: migrate the rest of examples to llama_batch_ext (#29601) migrate the rest test-thread-safety rm common_batch_staged Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cp
llama: properly handle KV on training (#28520) llama: properly handle KV on training improve Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51644581 macOS/
test-llama-archs : toggle causal_attn to catch graph shape changes (#29724) After the device decode, flip causal_attn off, decode n_ubatch/2 then n_ubatch tokens. Both have the same node count, so a s
'AREX-2 is a 27B-parameter long-horizon agent model from the Beijing Academy of Artificial Intelligence (BAAI). It learns to improve a solution over multiple test-time rounds: propose, measure, reflec
arXiv:2609.37016v1 Announce Type: new Abstract: Structured images, such as diagrams, charts, and flowcharts, are inherently symbolic and can be compactly represented in an editable format, yet in prac
arXiv:2609.37468v1 Announce Type: cross Abstract: Agentic retrieval-augmented generation (RAG) interleaves reasoning with repeated retrieval, giving the retriever influence over both the evidence an a
arXiv:2609.37367v1 Announce Type: cross Abstract: Decentralized large language model (LLM) fine-tuning lets organizations collaboratively train a shared LLM on data they cannot pool, without a central
arXiv:2609.36738v1 Announce Type: cross Abstract: Optimizer momentum is usually stored as a parameter-sized moving average of past gradients, which makes history costly and fixes each past signal in t
arXiv:2406.00083v3 Announce Type: replace-cross Abstract: Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by retrieving relevant information from external knowledge bases to
arXiv:2609.36913v1 Announce Type: cross Abstract: Transcribing domain-specific entities and rare proper nouns remains a major challenge in automatic speech recognition (ASR). In this paper, we propose
arXiv:2609.35877v1 Announce Type: cross Abstract: Many DNA foundation models are pretrained by masking parts of a sequence and asking the model to reconstruct them. Standard masked pretraining exposes
arXiv:2609.36222v1 Announce Type: new Abstract: Large language models are increasingly expensive to serve. In large-scale serving systems, autoregressive decoding is often bottlenecked by transferring
arXiv:2601.04094v4 Announce Type: cross Abstract: Effective regulation of AI is a defining policy challenge, driven by their integration into all aspects of society. To remain responsive to their rapi
arXiv:2609.37316v1 Announce Type: new Abstract: Agile flight tasks such as drone racing and pursuit-evasion require strong acceleration and precise turns, but the available thrust changes as the batte
arXiv:2609.37084v1 Announce Type: new Abstract: The ability to navigate toward sound sources extends a robot's reach beyond its visual field, enabling response to auditory events in unknown environmen
arXiv:2609.37041v1 Announce Type: cross Abstract: Self-Distillation Fine-Tuning (SDFT) enables a language model to act as its own teacher: by conditioning on a demonstration, the model produces an imp
arXiv:2609.37400v1 Announce Type: new Abstract: Generating realistic 3D dance from music is a challenging task that requires accurate synchronization with musical rhythms while capturing the spatial c
arXiv:2609.37887v1 Announce Type: new Abstract: Activation and key-value cache precision change what a quantized language model computes without altering its stored weights. Direct weight-code bounds,
arXiv:2609.37836v1 Announce Type: new Abstract: Neural networks trained toward the same final objective can reach similar predictive performance while retaining internal representations shaped by earl
arXiv:2609.36920v1 Announce Type: new Abstract: Comprehensive evaluations of automatic speech recognition (ASR) for Iberian languages remain limited, and low-resource languages, biases, and efficiency
arXiv:2609.37555v1 Announce Type: new Abstract: Drug discovery is a costly and high-risk process, where toxicity-related failures remain a major cause of attrition in both preclinical and clinical sta
arXiv:2609.36492v1 Announce Type: cross Abstract: We benchmarked vision-language models (VLMs) on the decisions annotators take when inspecting electron microscopy images in connectomics: synapse dete
Building a local voice chat pipeline: Struggling with fast, natural PT-BR conversation models I'm currently trying to build a local AI voice chat system that can use tools via an LLM. I'm testing tw
Our agent workflow is currently executing a group of 10 vllm api calls within a asyncio.gather we made them share the same prompt until the end where the queries/instruction prompts differ. These call
arXiv:2609.36609v1 Announce Type: cross Abstract: Electroencephalography (EEG) analysis requires careful choices in preprocessing, statistical modeling, and machine learning because EEG signals are hi
arXiv:2609.36097v1 Announce Type: cross Abstract: Using predictive models to explain cognition requires more than accurate behavioral predictions. Input ablations offer an appealing route: remove info
arXiv:2609.36359v1 Announce Type: new Abstract: Graph-based approximate nearest neighbor search (ANNS) is widely used for large-scale semantic search. Its indices are constructed primarily based on ge
arXiv:2609.37644v1 Announce Type: new Abstract: Latent world models often struggle with long-horizon planning despite accurate short-term predictions. Recursive rollouts accumulate errors, while dista
arXiv:2609.37263v1 Announce Type: new Abstract: While Large Vision-Language Models (LVLMs) achieve remarkable success, hallucinations remain a significant barrier to their reliable deployment. Recent
arXiv:2609.36628v1 Announce Type: new Abstract: Vision-Language Models (VLMs) can generate rich video captions, yet often misidentify which person performs an action or which limb is involved, particu
arXiv:2609.37066v1 Announce Type: cross Abstract: Post-training is central to mathematical reasoning in modern large language models (LLMs), but endpoint pass@1 alone underidentifies what has changed.
arXiv:2609.36771v1 Announce Type: cross Abstract: Root cause analysis (RCA) is a critical problem in many real-world scenarios. RCA enables the identification of faulty or failing mechanisms in a syst
arXiv:2609.35863v1 Announce Type: cross Abstract: Modern bioacoustic foundation models like Perch and BirdNET can identify species with high discriminative accuracy, yet their confidence scores are of
arXiv:2609.37905v1 Announce Type: cross Abstract: Click-Through Rate prediction, a core task in recommendation and advertising systems, relies on modeling interactions among sparse categorical feature
arXiv:2609.35856v1 Announce Type: cross Abstract: This research describes the adaptation of Large Language Models (LLMs) for economic monitoring in the public sector to automatically determine whether
arXiv:2609.36598v1 Announce Type: new Abstract: A video can exhibit convincing motion and photorealism yet fail immediately when visual text collapses. Unlike generic scene content, visual text is unf
arXiv:2609.38019v1 Announce Type: new Abstract: We present RGOR (Reference-Grounded Oral Refinement), an audio-driven lip-sync framework that renders the mouth of the specific person being dubbed rath
arXiv:2609.37027v1 Announce Type: new Abstract: Low-Rank Adaptation (LoRA) is a widely used approach to parameter-efficient fine-tuning (PEFT), yet a performance gap can remain relative to full fine-t
arXiv:2602.11678v2 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs) have shown remarkable progress in visual understanding, yet they suffer from a critical limitation: structu
arXiv:2609.37377v1 Announce Type: new Abstract: On-policy distillation (OPD) trains students using teacher feedback on their own sampled responses, yet how prompt choice shapes transfer across teacher
arXiv:2609.36957v1 Announce Type: new Abstract: Direct visual readability and task-information recoverability are different quantities. Failure to decode a target from a fixed observation need not eli
arXiv:2609.35841v1 Announce Type: cross Abstract: Mutation testing evaluates test-suite adequacy by injecting synthetic faults into program code. However, traditional rule-based tools often generate l
arXiv:2609.37218v1 Announce Type: cross Abstract: Semantic watermarking improves robustness against watermark removal attacks by embedding detectable signals into sentence-level representations. Howev
arXiv:2510.22752v2 Announce Type: replace-cross Abstract: In-context learning is governed by both temporal and semantic relationships, shaping how Large Language Models (LLMs) retrieve contextual info
arXiv:2609.36888v1 Announce Type: new Abstract: Mixed human-LLM documents require locating authorship transitions from detector scores whose reliability varies across text units. Existing weighted mea
arXiv:2609.35875v1 Announce Type: new Abstract: Multi-agent debate (MAD) reportedly improves reasoning and factuality over single-model inference, but prior work treats agents as symmetric peers, leav
arXiv:2609.35831v1 Announce Type: new Abstract: Modern large language models now support context windows of more than one million tokens, which has raised the question of whether retrieval-augmented g
arXiv:2609.38155v1 Announce Type: cross Abstract: Answering questions about long videos often requires connecting events involving the same objects across hours or days. Chronological descriptions and