Knowledge catalogue
arXiv:2601.06973v2 Announce Type: replace Abstract: As LLMs move from text completion toward autonomous agents, they remain constrained by the standard chat interface, which lacks private working memo
Since I spent the time to figure it out and it is not like it will make me any money ever. I think I'd share with you all what I managed to cobble together. First and foremost here the relevant bits a
I wanted to share my successful setup for running a Qwen 3.8 27B model with a massive context window on a consumer 16GB GPU (RTX 4070 Ti SUPER). The goal was to fit everything into VRAM without sacrif
Row-Bot v4.9.0 is available. - Meet Buddy: a native, always-on-top desktop overlay for Windows and macOS. - Drag Buddy from the sidebar and place it over any app. - Chat, track progress, read replies,
I was bored and handwrote a tiny 100-line bash script to let an agent search for and read articles from an offline wikipedia archive during a regular chat. It's not particularly useful, but it's defin
Hi, since ollama provide multiple cloud models i was wondering is there an app that could be used for chat like claude already has but you can switch models? Or if that is complicated to build at leas
Technology leaders are under mounting pressure to modernize infrastructure, control multi-cloud operational spend, and build data foundations for generative AI. However, the discovery required for tha
Grok Bot is hands down one of the best products I have ever used. Maybe the best ever. I have had it less than a week. I am not a developer. I talk to one chat and it already knows my business better
I kept running into the same wall. Every agentic coding plugin ships an autocomplete, and almost all of them lock it down — no model choice, or a subscription, or both. I don't want a chat panel, I do
Written by: Gabby Roncone, Wesley Shields Overview Google Threat Intelligence Group (GTIG) is tracking three distinct suspected Russian cyber espionage threat clusters abusing legitimate authenticatio
Edit: Title says 134 tps, it's actually 138 -- keep in mind my 3090 is power limited to 250w. Three days ago I released a hyper-optimized Qwen3.8-27B inference engine for an RTX 3090 (82 tps single re
I'm currently testing out Qwen3.8-27B using Unsloth's UD-Q4_K_XL running a freshly rebuilt llama.cpp. I have a 22GB RTX 2080TI on which I'm able to fit 100k context with q8_0 quantization, and using M
I released LLM 0.32 this morning, the most significant new version of LLM since the initial launch of the project. The new version includes support for visible reasoning traces, server-side provider t
DigitalOcean launched Kimi K3 on day 0. It’s already one of the most popular models on the platform and across the market: second most likes on Hugging Face, sixth most traffic on OpenCode. Getting a
Microsoft is working on an AI 'super app' that combines Copilot's chat, coding, and agentic capabilities. During an earnings call on Wednesday, Microsoft CEO Satya Nadella said the app will span 'both
Most graph-based LLM interfaces use a canvas as a visual layer over what is still a linear chat. I wanted the graph itself to determine what Ollama receives. ThoughtDAG has one rule: wires are the con
this was such a fun talk with Cat and Simon, hope you get to check it out if you missed it 🆕This Year In Claude https://www.youtube.com/watch?v=uU5Gv2h8-9g @simonw chats with @_catwu and @trq212 about
We just shipped a full revamp of the RunAnywhere apps. iOS and Android, live now. One assistant, fully on-device, works offline: - new UI, opens straight into chat - device-aware model recommendations
Elon Musk just gave a massive update on Community Notes Users who interact with a misleading post that is later corrected by Community Notes will now receive the correction directly through X Chat Thi
Ollama Talk is an Android app that connects to an Ollama server, enabling conversations with AI models like Llama and Mistral . The app features an intuitive chat interface with real-time conversation
A vulnerability in DeepSeek's website exposed a significant amount of data, including user chats. A publicly accessible ClickHouse database belonging to DeepSeek allowed full control over database ope
Welcome to the first Cloud CISO Perspectives for May 2026. Today, Vinod D’Souza, director, Office of the CISO, shares highlights from his RSA Conference fireside chat with Anthony Belfiore, chief stra
New course: Build agents that respond to users with not only plaintext, but custom UIs like charts, forms, and whiteboards, generated on demand and displayed right in the chat. This short course is bu
arXiv:2605.01104v1 Announce Type: cross Abstract: Understanding how developers interact with AI coding assistants requires more than chat logs or git histories in isolation; it requires reconstructing
At Google Cloud Next ‘26, we announced that more than 50 Google-managed Model Context Protocol (MCP) servers are generally available or in preview, with more on the way. Why it matters: To move beyond
everyones gonna be here! I’ll be in San Francisco from May 9-16 for @LangChain Interrupt 🦜 If you’re around, DM me, I’d love to chat about applied AI, agents, and running agentic systems in production
Jagmeet Singh / TechCrunch: WhatsApp partners with PayU to roll out prepaid mobile recharges in India; it remains a marginal payments player in India despite launching payments in 2020 — WhatsApp is a
arXiv:2604.14682v1 Announce Type: cross Abstract: Speculative decoding accelerates large language model (LLM) inference. It uses a small draft model to propose a tree of future tokens. A larger target
Vercel Flags has reached general availability, enabling developers to implement feature flags and manage application behavior without requiring new deployments. This capability allows teams to control
arXiv:2604.10288v1 Announce Type: new Abstract: This essay identifies a failure mode of AI chat systems that we term attribution laundering: the model performs substantive cognitive work and then rhet
llama.cpp build b8781 is the latest release of the open-source C/C++ LLM inference framework, published on April 13, 2026. Its primary change introduces a dedicated DeepSeek v3.2 chat parser along wit
arXiv:2604.08782v1 Announce Type: new Abstract: Large language models (LLMs) suffer significant performance degradation when user instructions and context are distributed over multiple conversational
On software engineering: → 56.22% SWE-Pro, matching GPT-5.3-Codex → 55.6% VIBE-Pro — full-stack project delivery → SWE Multilingual: 76.5 For agentic work: → Multi-agent collaboration built into the m
Vercel's open-source Knowledge Agent Template enables developers to build AI knowledge agents using a filesystem and bash tools (grep, find, cat) instead of the traditional vector database, embeddi...
Strong release! GLM-5.1 is a DeepSeek-V3.2-like architecture (including MLA and DeepSeek Sparse Attention) but with more layers. And the benchmarks look better throughout! Looks like THE flagship open
A lot of you are asking about the :cloud tag. Here's the deal: GLM-5.1 is a 744B parameter beast. To hit that 54.9 benchmark score without turning my M4 Mac Mini into a space heater, I run the cloud e
Z.AI's GLM-5.1, a next-generation flagship model for agentic engineering released in April 2026, is now available across all Kilo Code surfaces — including the VS Code extension, Cloud Agents, and ...
GLM-5.1 is now available through OpenCode Go, a low-cost subscription service ($5 first month, then $10/month) that provides access to open-source coding models with a zero data retention policy, m...
User Kevin Kern reported successfully integrating OpenCode into Taugentic (an AI-powered browser/agent environment), enabling use of GLM-5.1 via Z.ai's GLM Coding Plan. GLM-5.1 is Z.ai's next-gener...
To run GLM-5.1 locally (744B params, 40B active MoE), full precision needs ~1.65TB disk + enterprise hardware like 8x H200/B200 GPUs. Minimum practical setup: Unsloth 2-bit GGUF quant (~220-236GB). Fi
ui : Discover & Download Models from HF Hub (#29584) common : resolve - download tags and list cached sidecars A Q4_0-mtp style tag now resolves the sidecar file when no model file matches it, so a so
I understand this kind of product may not be exactly right for this subreddit, but I still think it deserves some attention, as it's an LLM frontend for local engines in the first place, and can be us
In the video, user Joseph instructs Delta (an AI model) to switch its provider configuration to @ollama, a custom OpenAI-compatible service. The entire setup occurs automatically within the chat threa
Tool: Tree Appreciator Another game experiment with Claude. This one used the default Claude iPhone app (chat mode, not Claude Code mode) where I prompted Claude Opus 5.5 Max with: Build a three js ga
If an agent saves an engineer 2 hours to implement a feature but collectively costs the team 3 hours in alignment and review, the ROI is negative. Isolated chats are suboptimal in team environments be
llama.cpp now has a Windows app 🦙 Llama Windows makes it easy to run models locally, with optimizations for NVIDIA RTX Spark. 📥 Browse and download models from Hugging Face 💬 Chat with local models ri
Trying to read on what the real tested downsides have been but information seems to go both ways, some proclaim no loss, others pretty huge ones. I had some weird looping issue in their chat, and some
Learn how to deploy decision models with llama.cpp on Amazon SageMaker AI. This technical how-to serves OpenAI-compatible chat completions with the AWS Deep Learning Container for llama.cpp, then exte
Quick context: LocalLightChat (LLC) is a chat frontend for local LLMs. Download it, run it, that's it. No installation (unless you want to), no dependencies, and it runs on pretty much anything, inclu
I stumbled across this as I was currently having glm5.3 flash run only around 10tok/s basically unusable. With Maya i am running 30 tok/s now. GLM5.3 feels even with this low quant like a much more en
chat : refactor API (#30210) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/54392536 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, Kle
arXiv:2610.11351v1 Announce Type: new Abstract: Large language models (LLMs) increasingly act as agents with little human oversight, so potential mistakes they make can go unnoticed. Users then depend
arXiv:2603.07980v2 Announce Type: replace-cross Abstract: As language models (LMs) evolve from chat assistants to long-horizon agents capable of multi-step reasoning and tool use, existing benchmarks
GPT‑6 with Intelligent UI rolls out globally to Plus, Pro, Business, and Enterprise users today and will expand to Free and Go users starting tomorrow. GPT‑6 in ChatGPT is powered by GPT‑6 Sol for Plu
Thursday, October 8 — 15:00–19:00 UTC Access is free and the API is OpenAI-compatible. During those 4 hours, everyone will be asked to use it actively at the same time—coding, chatting, agents, long c
Disclosure first: I work at Vstorm and I build AgenticOS, an open-source (Apache-2.0), self-hosted platform for building AI agents in a browser. This post was drafted with an LLM's help and edited by
model : add K2 Horizon dense and MoVA support (#29535) model: K2 Horizon gguf conversion code model: loading hparams and tensors in k2-horizon.cpp model: K2 Horizon compute graph model: K2 Horizon com
The secondary button gets its own look back and the chat add button its own light surface. Pressable elements get a pointer cursor again, the font rendering smooths on the app shell, the root layout r
Octop is an open-source, self-hosted AI assistant. Through its multi-agent architecture, it builds an intelligent environment that is both independent and collaborative for teams, families, and indivi
arXiv:2610.04433v1 Announce Type: cross Abstract: A coding agent is a language model wrapped in a harness: the system prompt, the tool set, and the context management that turn a chat model into somet