Search: “inference”

Has anyone actually gotten a reliable local AI system running?

This r/ollama Reddit thread addresses a common question among the local AI community about whether reliable, self-hosted AI systems are genuinely achievable. Community members in this space typically

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

I fed The Godfather into a structured knowledge graph, here's what the MCP tools surface

DGX agent

A Reddit post from the r/ollama community demonstrating a practical experiment in which a user ingested the narrative content of *The Godfather* into a structured knowledge graph and then queried it u

agentsr-ollama

12 Apr 2026

LTX2.3 - LTX-2.3-22b-IC-LoRA-Outpaint

local-air-stablediffusion

LTX-2.3-22b-IC-LoRA-Outpaint is an Outpaint IC-LoRA trained on top of LTX-2.3-22b, designed to extend the canvas of an input video by generating new content in regions marked as pure black. It can out

This one gives a lot of perspective over the fact that memory isn't just a plugin anymore. My take is, each approach has it's tradeoffs but …

This one gives a lot of perspective over the fact that memory isn't just a plugin anymore. My take is, each approach has it's tradeoffs but for me the mental model is, if the memory is more than or 80

agentsharrison-chase--x

Watch Me Chat With Ollama Kimi AI Agents Inside The Grid on CopeAi.net — This Is What Real AI-Powered agents on Ethereum Actually Look Like

This Reddit post from r/ollama showcases a demonstration of running Kimi AI agents — powered locally via Ollama — within a platform called CopeAi.net, which appears to integrate AI agents with the Eth

b8753

**llama.cpp release b8753** is a specific tagged build of the [llama.cpp](https://github.com/ggml-org/llama.cpp) project by ggml-org, an open-source C/C++ framework for running large language model...

b8756

The search results did not return the specific changelog details for build b8756. Based on what is available and the general context of llama.cpp's rolling release model, here is a factual summary ...

Tools

Closing thoughts on ai engineer conf: - weather so great - did not like the venue one bit - can’t say any talks really stood out for me - bu…

Closing thoughts on ai engineer conf: - weather so great - did not like the venue one bit - can’t say any talks really stood out for me - but had very interesting hallway conversations. Especially wit

toolsswyx--x

Had a great time at @aiDotEngineer in London the last days! Thanks to @swyx and the team for the great organisation and last minute opportun…

A attendee shared positive feedback about the AI Engineer conference held in London, expressing gratitude to Swyx and the organizing team for their efforts. The post highlights the quality of the even

agentsswyx--x

Is 'live AI video generation' a meaningful technical category or just a marketing term? [R]

researchr-machinelearning

The specific Reddit thread could not be retrieved directly, but based on its title, source, and the broader context of r/MachineLearning discussions, here is a fitting knowledge base summary: This r/M

llm-server v2 ai-tuning it self now best performance for llama.cpp/ik_llama.cpp (big steps form v1) auto flag optimization

**llm-server v2** is a community-developed local LLM server tool that introduces AI-driven self-tuning capabilities, automatically identifying and applying optimal performance flags for **llama.cpp**

model-releasesr-ollama

My 2026 Ollama Setup Guide: What Actually Works Best for Daily Use on Consumer Hardware

This r/ollama community post is a practitioner's guide sharing personal, real-world experience running Ollama on everyday consumer hardware in 2026, covering which models, quantization settings, and c

A Comprehensive Survey of Agents for Computer Use: Foundations, Challenges, and Future Directions

arXiv:2501.16150v3 Announce Type: replace Abstract: Agents for computer use (ACUs) are an emerging class of systems capable of executing complex tasks on digital devices -- such as desktops, mobile ph

agentsarxiv-cs-ai

A Graph-Enhanced Defense Framework for Explainable Fake News Detection with LLM

arXiv:2604.06666v1 Announce Type: cross Abstract: Explainable fake news detection aims to assess the veracity of news claims while providing human-friendly explanations. Existing methods incorporating

researcharxiv-cs-ai

A-MBER: Affective Memory Benchmark for Emotion Recognition

arXiv:2604.07017v1 Announce Type: new Abstract: AI assistants that interact with users over time need to interpret the user's current emotional state in order to respond appropriately and personally.

A Parameter-Efficient Transfer Learning Approach through Multitask Prompt Distillation and Decomposition for Clinical NLP

arXiv:2604.06650v1 Announce Type: cross Abstract: Existing prompt-based fine-tuning methods typically learn task-specific prompts independently, imposing significant computing and storage overhead at

ABMAMBA: Multimodal Large Language Model with Aligned Hierarchical Bidirectional Scan for Efficient Video Captioning

arXiv:2604.08050v1 Announce Type: new Abstract: In this study, we focus on video captioning by fully open multimodal large language models (MLLMs). The comprehension of visual sequences is challenging

researcharxiv-cs-cv

Act Wisely: Cultivating Meta-Cognitive Tool Use in Agentic Multimodal Models

arXiv:2604.08545v1 Announce Type: new Abstract: The advent of agentic multimodal models has empowered systems to actively interact with external environments. However, current agents suffer from a pro

agentsarxiv-cs-cv

ActiveGlasses: Learning Manipulation with Active Vision from Ego-centric Human Demonstration

arXiv:2604.08534v1 Announce Type: new Abstract: Large-scale real-world robot data collection is a prerequisite for bringing robots into everyday deployment. However, existing pipelines often rely on s

safetyarxiv-cs-ro

AdaSpark: Adaptive Sparsity for Efficient Long-Video Understanding

arXiv:2604.08077v1 Announce Type: new Abstract: Processing long-form videos with Video Large Language Models (Video-LLMs) is computationally prohibitive. Current efficiency methods often compromise fi

researcharxiv-cs-cv

Ads in AI Chatbots? An Analysis of How Large Language Models Navigate Conflicts of Interest

model-releasesarxiv-cs-cl

arXiv:2604.08525v1 Announce Type: cross Abstract: Today's large language models (LLMs) are trained to align with user preferences through methods such as reinforcement learning. Yet models are beginni

Adversarial Evasion Attacks on Computer Vision using SHAP Values

arXiv:2601.10587v2 Announce Type: replace Abstract: The paper introduces a white-box attack on computer vision models using SHAP values. It demonstrates how adversarial evasion attacks can compromise

researcharxiv-cs-cv

AgentCity: Constitutional Governance for Autonomous Agent Economies via Separation of Power

arXiv:2604.07007v1 Announce Type: cross Abstract: Autonomous AI agents are beginning to operate across organizational boundaries on the open internet -- discovering, transacting with, and delegating t

safetyarxiv-cs-ai

AI-Driven Research for Databases

arXiv:2604.06566v1 Announce Type: cross Abstract: As the complexity of modern workloads and hardware increasingly outpaces human research and engineering capacity, existing methods for database perfor

safetyarxiv-cs-ai

Tools

And that’s a wrap. What an amazing few days spent with the AI builders of Europe. Thanks to @swyx for bringing us all together. The journey …

The specific tweet (status ID 2042723714970620125) is from the future relative to available data and could not be directly fetched or verified. Based on the contextual clues in the tweet title and ...

toolsswyx--x

Industry

Apple's head of cloud says Open Source models will address 90% of the use case

I was unable to retrieve the specific Reddit thread or locate reliable sourced details about Apple's head of cloud making a statement that open source models will address 90% of use cases. The sear...

industryr-chatgpt

Asymptotic-Preserving Neural Networks for Viscoelastic Parameter Identification in Multiscale Blood Flow Modeling

model-releasesarxiv-cs-lg

arXiv:2604.06287v1 Announce Type: new Abstract: Mathematical models and numerical simulations offer a non-invasive way to explore cardiovascular phenomena, providing access to quantities that cannot b

b8748

The search results do not contain the specific changelog details for llama.cpp release **b8748**. The closest available data is for build b8747 (the latest at time of search), and no per-build note...

b8749

The search results do not contain specific changelog details for the exact `b8749` tag. Based on the available information about the llama.cpp project and its release cadence, here is a factual sum...

Bad news on Happy Horse from twitter

local-air-stablediffusion

HappyHorse-1.0 is a pseudonymous AI video generation model that appeared on April 7, 2026, topping the Artificial Analysis Video Arena leaderboard in both text-to-video and image-to-video (no audio...

Benchmarking LLM Tool-Use in the Wild

arXiv:2604.06185v1 Announce Type: cross Abstract: Fulfilling user needs through Large Language Model multi-turn, multi-step tool-use is rarely a straightforward process. Real user interactions are inh

Beyond Facts: Benchmarking Distributional Reading Comprehension in Large Language Models

arXiv:2604.06201v1 Announce Type: cross Abstract: While most reading comprehension benchmarks for LLMs focus on factual information that can be answered by localizing specific textual evidence, many r

BTC-LLM: Efficient Sub-1-Bit LLM Quantization via Learnable Transformation and Binary Codebook

model-releasesarxiv-cs-cv

arXiv:2506.12040v2 Announce Type: replace-cross Abstract: Binary quantization represents the most extreme form of compression, reducing weights to +/-1 for maximal memory and computational efficiency.

Busemann energy-based attention for emotion analysis in Poincare discs

arXiv:2604.06752v1 Announce Type: new Abstract: We present EmBolic - a novel fully hyperbolic deep learning architecture for fine-grained emotion analysis from textual messages. The underlying idea is

researcharxiv-cs-lg

CADENCE: Context-Adaptive Depth Estimation for Navigation and Computational Efficiency

arXiv:2604.07286v1 Announce Type: cross Abstract: Autonomous vehicles deployed in remote environments typically rely on embedded processors, compact batteries, and lightweight sensors. These hardware

CAMO: A Class-Aware Minority-Optimized Ensemble for Robust Language Model Evaluation on Imbalanced Data

model-releasesarxiv-cs-cl

arXiv:2604.07583v1 Announce Type: new Abstract: Real-world categorization is severely hampered by class imbalance because traditional ensembles favor majority classes, which lowers minority performanc

Cannot search pdf document using WebUI and Ollama

Users in the Ollama/Open WebUI community commonly report being unable to query PDF documents via the Open WebUI interface when using a locally hosted Ollama backend, with the model failing to recog...

CASE: Cadence-Aware Set Encoding for Large-Scale Next Basket Repurchase Recommendation

model-releasesarxiv-cs-lg

arXiv:2604.06718v2 Announce Type: cross Abstract: Repurchase behavior is a primary signal in large-scale retail recommendation, particularly in categories with frequent replenishment: many items in a

Applications

ChemVLR: Prioritizing Reasoning in Perception for Chemical Vision-Language Understanding

arXiv:2604.06685v1 Announce Type: cross Abstract: While Vision-Language Models (VLMs) have demonstrated significant potential in chemical visual understanding, current models are predominantly optimiz

applicationsarxiv-cs-ai

CHiQPM: Calibrated Hierarchical Interpretable Image Classification

arXiv:2511.20779v2 Announce Type: replace Abstract: Globally interpretable models are a promising approach for trustworthy AI in safety-critical domains. Alongside global explanations, detailed local

local-aiarxiv-cs-lg

Chunks as Arms: Multi-Armed Bandit-Guided Sampling for Long-Context LLM Preference Optimization

model-releasesarxiv-cs-cl

arXiv:2508.13993v2 Announce Type: replace Abstract: Long-context modeling is critical for a wide range of real-world tasks, including long-context question answering, summarization, and complex reason

Tutorials

Conditional flow matching for physics-constrained inverse problems with finite training data

arXiv:2603.14135v3 Announce Type: replace-cross Abstract: This study presents a conditional flow matching framework for solving physics-constrained Bayesian inverse problems. In this setting, samples

tutorialsarxiv-cs-lg

Continual Visual Anomaly Detection on the Edge: Benchmark and Efficient Solutions

arXiv:2604.06435v1 Announce Type: cross Abstract: Visual Anomaly Detection (VAD) is a critical task for many applications including industrial inspection and healthcare. While VAD has been extensively

Cool mlx-vlm segmentation demo by @Prince_Canuma at @aiDotEngineer You can do so much with it

Prince Canuma (GitHub: Blaizzy) demonstrated image segmentation capabilities using mlx-vlm at the AI Engineer event, showcasing the library's versatility beyond standard vision-language tasks. mlx-...

local-aiswyx--x

CSA-Graphs: A Privacy-Preserving Structural Dataset for Child Sexual Abuse Research

arXiv:2604.07132v1 Announce Type: cross Abstract: Child Sexual Abuse Imagery (CSAI) classification is an important yet challenging problem for computer vision research due to the strict legal and ethi

safetyarxiv-cs-ai

[D] 60% MatMul Performance Bug in cuBLAS on RTX 5090 [D]

researchr-machinelearning

A bug was identified in NVIDIA's cuBLAS library where `cublasSgemmStridedBatched` dispatches the same suboptimal `cutlass_80_simt_sgemm_128x32_8x5` kernel for every batched FP32 workload from 256×...

[D] Large scale OCR [D]

researchr-machinelearning

The specific Reddit thread (r/MachineLearning post ID 1shg2ob) was not returned in the search results, and I was unable to directly fetch the URL's content. I cannot accurately summarize a page I h...

DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generation

arXiv:2511.19365v2 Announce Type: replace-cross Abstract: Pixel diffusion aims to generate images directly in pixel space in an end-to-end fashion. This approach avoids the limitations of VAE in the t

researcharxiv-cs-ai