Search: “local-ai”

The raw reasoning stream can be accessed through the message.thinking field in the API response or the thinking endpoint field, which contains the reasoning trace separately from the final answer. Use

v0.30.0-rc25 is a pre-release version of Ollama that changes the architecture to directly support llama.cpp instead of building on top of GGML, and allows for compatibility with GGUF file format. MLX

arXiv:2605.23717v1 Announce Type: new Abstract: Autonomous landing of Unmanned Aerial Vehicles on maritime vessels is challenging due to the coupled motion of the vehicle and landing platform in open-

arXiv:2601.21198v2 Announce Type: replace-cross Abstract: While Mixture-of-Experts (MoE) architectures substantially bolster the expressive power of large-language models, their prohibitive memory foo

300,000 AI builders filled their hardware profile on @huggingface and we're sharing the results: http://hf.co/hardware. Excited to see how it evolves in the coming months especially with the explosion

llama.cpp is an open-source C/C++ project for LLM inference , and build b9301 is a specific release version in the project's development history. This build number represents an incremental developmen

Release b9305 was published on May 24, 2026 , featuring CMake UI build fixes and improvements for multiple platforms including macOS Apple Silicon and Linux architectures . The release provides prebui

ComfyUI_SamplingUtils with Klein_9B enables rapid image style changes within ComfyUI workflows, supporting text-to-image generation and reference-based editing for quick style transformation and conte

A discussion about difficulties getting Ollama to fully utilize dual NVIDIA RTX 3090 GPUs when running various language models including 8B and 70B parameter models. Users report that despite Ollama r

LongCat-Video-Avatar 1.5 is an upgraded open-source framework that prioritizes extreme empirical optimization and production-readiness for audio-driven human video generation. The v1.5 release replace

Clem Delangue reports consuming approximately 17 million tokens daily when running local language models, indicating substantial usage of on-device AI inference. He expresses satisfaction with the uti

A Reddit discussion from the StableDiffusion community about challenges with managing cloud GPU services like RunPod and Vast, with someone proposing to build a unified 'Stability Matrix' tool to simp

v0.30.0-rc24 is a pre-release version that changes Ollama's architecture to directly support llama.cpp instead of building on top of GGML, enabling compatibility with the GGUF file format. MLX is used

arXiv:2411.01332v5 Announce Type: replace Abstract: Despite significant advancements in XAI, scholars note a persistent lack of solid conceptual foundations and integration with broader scientific dis

AsymFLUX.2-klein-9B is a pixel-space text-to-image model finetuned from FLUX.2-klein-base-9B using the AsymFlow method. The model is noted for producing sharp textures with strong adherence and compos

b9294 is a llama.cpp release that includes improvements to OpenCL kernels for AMD Adreno GPUs, specifically generalizing MoE (Mixture of Experts) kernel implementations. The release provides pre-built

b9296 is a build release of llama.cpp , the C/C++ implementation for efficient large language model inference. As an intermediate build in the llama.cpp release cycle, it likely includes recent bug fi

The search results show information about llama.cpp releases but don't contain specific details about build b9297. Based on the context and numbering (b9297 is a recent build after b9294), b9297 is li

arXiv:2510.10129v2 Announce Type: replace Abstract: Retrieval-Augmented Generation (RAG) systems suffer from severe time-to-first-token (TTFT) bottlenecks due to long input sequences. Existing KV cach

arXiv:2605.22221v1 Announce Type: new Abstract: Backtracking search underlies classical constraint solvers, planners, and theorem provers. Recent transformer-based reasoning systems explore search tre

arXiv:2605.22703v1 Announce Type: new Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a central paradigm for scaling LLM reasoning, yet its optimization often suffers fr

arXiv:2605.22379v1 Announce Type: cross Abstract: With the advancement of science and technology, the importance of emotion research has become increasingly evident. Electroencephalography (EEG)-based

This post showcases a dark fantasy art series created using a heavy ink style, likely featuring gritty, detailed artwork with gothic or fantasy themes. The creator shared the work on r/StableDiffusion

arXiv:2605.22266v1 Announce Type: new Abstract: Federated learning enables collaborative training across distributed clients with heterogeneous data, but such heterogeneity often leads to unstable upd

arXiv:2605.22531v1 Announce Type: new Abstract: There is a gap between the theoretical foundations of disentanglement and the practice of modern representation learning. Existing theoretical framework

arXiv:2605.22506v1 Announce Type: cross Abstract: Federated learning faces increasing threats from model poisoning attacks, which harms its application to improve privacy. Existing defense methods typ

arXiv:2605.22537v1 Announce Type: new Abstract: Reinforcement learning methods such as GRPO have seen great popularity in LLM post-training. In GRPO, models produce completions to a set of prompts, wh

ForgeFlash is a minimalist frontend interface designed for Stable Diffusion WebUI Forge that emphasizes simplified workflows inspired by Fooocus while maintaining direct access to essential advanced c

This post describes a custom Stable Diffusion graphical interface optimized for older graphics cards, specifically the GTX 1060, incorporating features like zero-copy ADetailer (a detail enhancement t

This post describes a project where a developer created a searchable database of 49,000 sample images featuring Anima AI characters and artists. The tool appears to be designed to help users find and

arXiv:2605.22410v1 Announce Type: new Abstract: Spectral clustering largely depends on the affinity graph, yet constructing a graph that preserves reliable local connectivity while adapting to heterog

Ollama can be installed on Mac by downloading the application and placing it in the Applications folder, after which you use Terminal to run commands that download and launch models . The best model c

arXiv:2605.21851v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards has become the standard recipe for improving LLM reasoning, but the dominant algorithm GRPO assigns a sin

arXiv:2507.20268v3 Announce Type: replace Abstract: Wireless indoor localization using predictive models with received signal strength information (RSSI) requires proper calibration for reliable posit

arXiv:2605.22814v1 Announce Type: new Abstract: Exploration is a prerequisite for learning useful behaviors in sparse-reward, long-horizon tasks, particularly within 3D environments. Curiosity-driven

arXiv:2605.22488v1 Announce Type: new Abstract: Structured prompts require integrating components according to task-relevant relations. How a network implements this integration is often hard to judge

A realistic fighter vs a fully anime-styled character, generated with Seedance 2.0 using detailed prompting and reference images. This workflow combines Seedance with an LLM-powered prompting setup de

Ollama has added MLX support for Qwen3.5 and Gemma 4 , with both MLX and NVFP4 quantization variants available for these models. There have been issues with broken Qwen3.6 NVFP4 generation on Ollama ,

arXiv:2605.22631v1 Announce Type: new Abstract: Accurately reconstructing full-body poses from sparse head and hand trajectories is a foundational challenge for immersive AR/VR telepresence. Current m

arXiv:2605.21932v1 Announce Type: new Abstract: Multi-Robot Task Allocation (MRTA) is a central challenge in decentralized multi-agent systems, where teams of robots must cooperatively assign and exec

llama.cpp build b9276 introduces support for hybrid DNA tokenization with new pre-type dispatching and tokenizer implementations, alongside fixes for VRAM leaks in Multi-Token Prediction (MTP) models

Release b9283 of llama.cpp includes updates to the BPE tokenizer with new pre-type dispatch and Carbon-3B DNA tokenizer support, along with refactoring of tokenizer helpers to follow project conventio

B9286 introduces support for HybridDNATokenizer as its own vocabulary type (LLAMA_VOCAB_TYPE_HYBRIDDNA), enabling proper tokenization of DNA sequences by routing raw text through a DNA-aware splitter

Release b9292 of llama.cpp fixes a memory leak in the server context where speculative decoder, draft context, and draft model were not properly freed during destroy(), causing VRAM leaks on sleep/res

arXiv:2605.22373v1 Announce Type: cross Abstract: Safety classifiers are essential safeguards within generative AI systems, filtering harmful content or identifying at-risk users when interacting with

arXiv:2605.21712v1 Announce Type: new Abstract: Transportation safety analysis requires integrating crash records, roadway attributes, and geospatial data through GIS-based workflows, but access remai