local ai

arXiv:2606.02995v1 Announce Type: cross Abstract: Large language models remain vulnerable to jailbreak backdoor attacks, where adversaries poison safety alignment data to embed hidden triggers that by

PrivateGPT is back! In 2023, it became the first offline RAG implementation and a breakout open source project. Then we went quiet in 2024. Today, PrivateGPT 1.0 is here: a full application API layer

This post documents running the Qwen3.6-35B-A3B language model on dual GTX 1080 Ti GPUs using Ollama, achieving approximately 20 tokens per second. The author highlights three critical configuration r

arXiv:2502.02748v4 Announce Type: replace Abstract: Predicting properties of crystals from their structures is a fundamental yet challenging task in materials science. Unlike molecules, crystal struct

arXiv:2606.03080v1 Announce Type: cross Abstract: Causal language models factorize sequence probabilities using only preceding context, leaving future information unexploited during training despite i

arXiv:2411.15851v2 Announce Type: replace Abstract: While vision-language models like CLIP have shown remarkable success in open-vocabulary tasks, their application is currently confined to image-leve

arXiv:2606.03736v1 Announce Type: cross Abstract: Resource-constrained pricing controllers can make fixed-price inference impossible: the controller's resource state may remove the target price neighb

arXiv:2606.03406v1 Announce Type: new Abstract: Reliable correspondence estimation is a fundamental problem in image processing, underpinning applications such as Structure from Motion, visual localiz

arXiv:2606.02909v1 Announce Type: cross Abstract: Gradient observations can substantially improve Gaussian process (GP) surrogates, particularly in high-dimensional settings where function evaluations

arXiv:2606.03940v1 Announce Type: cross Abstract: In robotics systems, vast amounts of visual data are easily captured at high resolution using low-cost, low-power hardware. Yet, limited bandwidth and

arXiv:2606.02638v1 Announce Type: cross Abstract: Recent advances in neural song generation have enabled high-quality synthesis from lyrics and global textual prompts. However, most systems fail to mo

arXiv:2603.18599v2 Announce Type: replace Abstract: Speculative Jacobi Decoding (SJD) offers a draft-model-free approach to accelerate autoregressive text-to-image synthesis. However, the high-entropy

Computex 2024 is expected to feature significant announcements around local AI deployment, with major industry players including NVIDIA and Microsoft actively promoting and discussing on-device AI wor

arXiv:2606.03332v1 Announce Type: new Abstract: Probabilistic models are typically trained using task-agnostic objectives like log-loss, which can lead to significant errors in downstream estimation.

arXiv:2606.02956v1 Announce Type: new Abstract: Existing autonomous driving datasets have enabled major progress, but fall short in sensor fidelity, map completeness, or geographic diversity. We prese

This post documents a creative project combining multiple AI image and video generation tools—SDXL, DMD-2, SEEDVR2, and LTX-2.3—with video editing software Shotcut to create a multi-day production. Th

arXiv:2606.02894v1 Announce Type: new Abstract: Small edge devices such as IoT surveillance nodes and search-and-rescue (SAR) platforms are increasingly expected to run computer vision locally. On ult

arXiv:2606.02862v1 Announce Type: new Abstract: The rise of Large Language Models (LLMs) has enabled agentic AI capable of complex reasoning and tool use; however, deploying such autonomy in pervasive

TripoSplat is an open-source tool developed by TripoAI that converts single 2D images into 3D Gaussian representations with variable density and high quality. The method enables efficient 3D reconstru

Ollama v0.30.2 is a patch release from the 0.30 series, which features improved compatibility and performance using llama.cpp, augmented MLX engine support on Apple Silicon, and broader model support

Ollama v0.30.3 adds support for the Gemma 4-12B model . This is a minor patch release that builds on the v0.30 series, which provides improved compatibility and performance improvements. The release w

Ollama v0.30.4 is a patch release within the v0.30 series, which offers improved compatibility and performance using llama.cpp, augments the MLX engine on Apple Silicon with wider hardware support, an

arXiv:2606.03871v1 Announce Type: cross Abstract: Visual instruction tuning effectively adapts a pre-trained Large Language Model (LLM) to process image information alongside text. Yet, it remains unc

arXiv:2603.13384v2 Announce Type: replace-cross Abstract: Software vulnerabilities often depend on cross-file data flow, build options, framework conventions, and runtime guards, so isolated function

arXiv:2606.03220v1 Announce Type: cross Abstract: Existing benchmarks for MLLM-generated web artifacts assess interaction through local evidence and miss the requirement-induced states and transitions

This Reddit discussion from r/ollama explores user experiences with uncensored Ollama language models, featuring anecdotal accounts of unusual or extreme use cases and recommendations for popular unce

arXiv:2606.03238v1 Announce Type: cross Abstract: Reinforcement learning from human feedback (RLHF) makes large-scale post-training possible by replacing an underspecified human objective with learned

You can use Hermes Desktop with Ollama using local or cloud models. Get started 👇👇👇 The next evolution of Hermes Agent is here! Introducing Hermes Desktop: everything you love about Hermes, now native

arXiv:2507.19702v1 Announce Type: cross Abstract: Identifying influential nodes in complex networks is a critical task with a wide range of applications across different domains. However, existing app

arXiv:2606.00016v1 Announce Type: cross Abstract: Detecting AI-generated text is becoming increasingly challenging as modern language models approach human-level fluency and can evade detectors that r

arXiv:2606.02551v1 Announce Type: cross Abstract: Affordance understanding bridges visual perception and physical action, serving as an explainable interface for robot manipulation in open and unstruc

arXiv:2606.00092v1 Announce Type: cross Abstract: Weakly-supervised classification of whole-slide images with attention-based multiple instance learning (ABMIL) on top of foundation features now reach

arXiv:2606.00386v1 Announce Type: new Abstract: Accurately modeling soft boundaries, e.g., hair and defocus blur, is a fundamental challenge in stereo conversion due to the ambiguous blending of foreg

arXiv:2606.01635v1 Announce Type: cross Abstract: Token selection is pivotal for effective LLM post-training. However, existing methods mostly rely on local heuristics and rarely formulate token selec

arXiv:2602.16224v2 Announce Type: replace Abstract: Time series data are prone to noise in various domains, and training samples may contain low-predictability patterns that deviate from the normal da

arXiv:2606.00483v1 Announce Type: cross Abstract: Genotype-based cis-expression prediction depends on accurately modeling local regulatory architecture. We present block-sparse Bayesian sparse linear

arXiv:2606.02256v1 Announce Type: new Abstract: Our work presents a method for ECG segmentation and arrhythmia detection using Tiny Machine Learning (TinyML) models for real-time, on-device inference

arXiv:2606.00393v1 Announce Type: cross Abstract: Geometric distortion in prostate diffusion-weighted imaging (DWI) can impair lesion localization and reduce the reliability of MRI-based clinical asse

B9466 is a build release in the llama.cpp project that includes fixes and improvements to speculative decoding functionality, specifically addressing n_outputs_max issues and extracting helper functio

The search results show recent llama.cpp releases but do not contain specific information about release b9467. Based on the context of llama.cpp releases and the GitHub repository structure, b9467 is

B9468 is an intermediate build release of llama.cpp, the open-source C/C++ library that enables large language model inference on consumer hardware. This release continues the project's rapid developm

b9469 is an intermediate build release of llama.cpp, a C/C++ implementation that enables large language model inference on consumer hardware with minimal dependencies. Build releases like b9469 repres

The search results don't contain specific information about release b9470. Based on available context, b9470 is a build release from llama.cpp, a C/C++ implementation that enables LLM inference with m

B9471 is a build release of llama.cpp, an open-source C/C++ implementation for LLM inference that enables running large language models on consumer hardware with optimized performance. This intermedia

B9473 is a release of llama.cpp, a C/C++ framework for large language model inference . The release represents a specific build commit from the ggml-org/llama.cpp repository. This entry likely documen

B9474 is a release version of llama.cpp, a tool for LLM inference in C/C++ . The release likely contains bug fixes, feature updates, and performance improvements to the llama.cpp project, which enable