Search: “local-ai”

Is there a good rule-of-thumb to calculate how many full 5-hour windows add up to one week's allowed usage under the $20/Pro plan? ie: you fill up six 5-hour windows, and that equals 100% usage for a

Gemax 1.9.15 — What’s new LAN server — share Gemax on your local network; open the real IP from another PC or phone Mobile-friendly UI — responsive layout for phone browsers on the same Wi‑Fi Workspac

I can't seem to find a good answer to this, my Hermes agent has access to Firecrawl and some other web scrapers for content extraction, but anyone know of a way to let a local LLM drive a 'real' web b

I have a Intel Arc A580 GPU that has 8gb VRAM, but I'm not sure that I am running ollama's local ai on it. Also, any suggestions on a good model to use for general purpose AI? submitted by /u/Illustri

Liquid AI currently possesses among the fastest LLM architectures around, and some of the best SLMs (in terms of utility IMO) around, so I'm very excited to see what a potential 100B LFM (3?) model wo

This is a genuine community of real generally respectful adult human beings. Despite the enthusiasm all of you have for local AI, you can recognize that there are times when local LLMs are flawed, and

Speaking of -sm tensor. I have 2x5060ti and i get some 40-50tps form 3.8 27B q6. I used HWinfo to see how saturated the PCIes are during inference are and as expected both the PCIe 5x16 slot and PCIe

QwQ was genuine next-gen performance usable on local hardware, but the massive required context (it's reasoning style was akin to 'if I say every possible word, I'll notice the right one!') kinda made

AQuA's preprint uses 'recursive self-improvement' for a bounded research loop. It does not say the research-agent LM rewrites its own weights. The paper separates three objects: The language model dri

I'm introducing Aurora-80K, a small language model with exactly 80 thousand parameters. It uses a factorized 4,096-token vocabulary despite having only 80K parameters. The benchmarks: Wikitext-2 BPB:

Using Open-Webui I can connect to Ollama Cloud using ollama.com and the api key. It lists the models, it works. but i want to connect open-webui to the loacl ollama installation (windows) because all

Tested on: X570DD_M570DD / GTX 1050 mobile / Arch Linux x86_64 / NVIDIA 580.178.04 driver / CUDA V12.9.86 What happened: As everyone knows, NVIDIA dropped the Pascal line in the 590.xxx.xx+ and CUDA 1

hey so im currently working to integrate a locally ran llm to control home assistant (through tool calling, no direct connection) so i can use a voice input without needing very specific commands. Its

I build LoRA Dataset Studio — free, open source, self-hosted, no account and no telemetry. It is not a competitor to ai-toolkit: it orchestrates it. ai-toolkit is the trainer; this is everything befor

Hey guys! Supra2-Medium is finally out! It's a 25M parameters qwen3 architecture model trained entirely from scratch (on our new rig: RTX 5060 Ti 16GB + the new RTX 5060 8GB!). Here's how it competes

Off a single prompt, given my credentials and the name of my university, qwen3.8-27b was able to successfully pull my class schedule from the kinda shitty and convoluted web of university websites. It

I chose to do this thing, not because it was hard, but because it was silly. Posts kept discussing how 3.8 and 3.6 were functionally the same, but based on training (3.8 does have seven new tokens!)..

This is gonna seem crazy off-topic, but I saw Spider-Man the other day and couldn’t help but notice how well executed E.V. is as an agentic system. compared to Jarvis, it felt much more grounded and c

https://preview.redd.it/xel6i6kujjkh1.png?width=2396&format=png&auto=webp&s=b78cd87da266324364e6b8cb8457a7f0e029d163 https://preview.redd.it/ofy8ttyxjjkh1.png?width=2396&format=png&auto=webp&s=3e64405

None has undergone post-training, giving researchers flexible starting points for continued pre-training, fine-tuning, and further research. Two key highlights: - They use WSM to replace LR decay with

Trying to make an account so I can start using Odyssey and to download some stuff through PowerShell. It requires a sign-in, but I can't make an account on the site because i need a U.S number and I d

Hi everyone, I built an open-source Windows desktop utility called **Polish** that lets you highlight text or SQL in ANY app (Slack, Teams, Outlook, DBeaver, SQL Developer, browser) and rephrase or fi

Hey everyone! We’re releasing new Qwen3.8-27B GGUFs with 10% higher accuracy for the same size. This uses a new version of Dynamic v3.0 Unsloth Dynamic V3 outperforms others by >10% on Div-300, KLD &

SCoPE: Sightline-Coordinate Positional Encoding for Video Diffusion Transformers SCoPE adds camera sightlines as positional coordinates to a pretrained video diffusion transformer. Given a first frame

Any LLM will hallucinate the world knowledge, even a 3T model. Use a 4B with a kiwix skill and local Wikipedia, 50gb and no more hallucinated world knowledge. Ask your coding agent to build your own,

I was checking out benchmarks of this model and apparantly better than Qwen3.5 9b reasoning across the bench on artificial analysis. I have used the 9b model for variety of stuff and it has been amazi

I have a lot of content in my personal Obsidian vault and would feel much more comfortable using LLMs with an offline model. I've experimented with Ollama and various small 3b/8b local models (given c

The AI wants to run a higher risk action. Nyx AI stops it here. Nyx AI deliberately invokes a native Windows confirmation before certain higher risk actions can continue. The model cannot approve this

Hi everyone, I use AI agents to code and manage my personal files heavily. However, I am worried that the agents may accidentally delete some important files on my machine, outside of the defined scop

I’m trying to compare Ollama Pro with OpenCode Go, specifically in terms of how much real-world usage each plan provides. Ollama Pro costs 20/month, while OpenCode Go costs approximately 10/month. Bas

We introduce Mobius-v0, an architecture that comprises a globally shared Memory (FFN) that stores knowledge vectors and multiple Reasoners (Self-Attn) that iteratively achieve compositional reasoning.

Overview EVIE-Preview-4.5B is a state-of-the-art multilingual Visual Document Retrieval (VDR) model built upon Qwen3.5-4B. It employs ColBERT-style late interaction with native 128-dimensional multi-v

I've pulled two models, `gemma4:latest` and `qwen3.5:latest`, and tried to use them in Android Studio and Itellij. I've followed the docs for both IDEs and they show in their chat features. My problem

Ollama sucks in terms of modaltiy options , model variety and is better in terms of usage limits . Is there any other alternative that could provide the same usage limits with better modality options

Hi, After a long night of optimizations, I believe I have made the fastest inference engine for Qwen3.6-28B on a 3090. Quick metrics: - 250w power capped - Up to 195k context (ships with 150k for safe

one of my llm hobbies is re-creating graphics demos i used to write in BASIC in the late 1980s. i slopped together an agentic harness and a basic-to-js transpiler in a web page i've been playing with

Muse Glimmer Cookbook Clone it, run it on the GPU you already own, and ship a working agent — one that plans, calls tools, and self-corrects — in a single sitting, fully offline. Muse Glimmer is an op

Been working on this for the last few months. I've been working on PyTorch for the past few years and I always felt, many a times my work went into dump, because of some mistakes I made in the code. t

Over & over I see people post slop and excusing it as 'english is not my native language'. As if, if we could understand their language we'd see they wrote it all by hand Fine then, new rule: > if you

I'm currently building a very budget-oriented AI / homelab PC using used parts. I've been saving up (I'm a student), and I'm working on a setup costing around 330€ total. The specs are: Xeon E-2124: N

Ollama makes it easy to run a model locally, but the hard part for me starts after the model responds: what keeps an agent from having unclear tool permissions, unbounded loops, silent partial failure

It'll use whatever model you have installed on ollama. Pro+/Cloud accounts are supported and you can ensemble multiple models and compound their results into one response or individually. Looking for

I want to build a PC/sever that can host me a ollama or alternative server, with good enough performance that it can be used for .net application development, specially with WinForms amd Blazor server

Hi, I just started with Ollama and local LLMs. Looking for a GPU I found the Mi50 could be a sweet spot to start, because it costs half of the Mi100. But as for the software support the Mi50 got dropp

I'm working on a local perplexity/AI search comprised of a custom harness and a further trained model. LFM 2.6 is almost to spec with no additional training, it is very good. submitted by /u/thebadsli

Good day to all. I'm fairly new running local models and would like to pick your brains on an issue I'm running into. I'll first tell you the issue, then give you my set up. I run into issues where th