Search: “reasoning”

It has only been two days since I move 100% from Qwen3.5-27B F16 to ThinkingCap-Qwen3.6-27B F16. Where I was getting tps in 30-40 range (depending on the size of the context), I am definitely getting

It doesn't solve any problems. Just a few paragraphs above, he says he fears that authoritarian states (he names China, and possibly others) can use their models to do evil stuff. And surely enough, m

I'm considering the 20 Pro plan, but the limits seem to change over time and are hard to compare with direct API pricing. For anyone using Pro currently, roughly how much coding agent usage do you get

Someone in the comments of my 27B post-train bakeoff asked for the 35B version, so I ran it. Same setup as last time: fresh Coder workspaces on my k8s cluster, each driving my own agent (Hermes) headl

Hey r/LocalLLaMA, I’m a retired engineer with a background in distributed computing, currently running a 1-person startup. Like many people here, I’d love to experiment with 2T+ MoE models locally. Th

I finished the speed leg of my spec-decode benchmarking for Qwen3.6-27B, main algorithms across quants. Overall: the heavier the quant, the more spec-decode buys you (10 of 10 speculative configs rank

Running local models means every token counts — an 8K or 16K window fills up fast when you're stuffing graph context into prompts for RAG. I benchmarked 10 graph serialization formats (JSON, GraphML,

Instead of 2T+ models, continuing to release highly capable small to medium size LLMs would really help to keep this community vibrant. Hardly anyone can even dream of running the recent 1.5-2T+ beast

I am writing a fairly complex C++ windows MFC application. I have a few 3090s and can run F16 Qwen3.6-27B with 256K context and MTP. The quality of code is exceptional with this quant vs its lower qua

Last week someone here said ThinkingCap and Fable Fusion 'really do beat the OG' for agentic work, so I ran it: 6 self-grading tasks, 5 reps, 3 models, 90 isolated runs. Tooling, since that's half the

I ran DeepSeek V4 Flash through Claude Code, OpenCode and Pi on my own benchmark, and the quality came out basically the same across all three while the time and tokens spent was wildly different. Cla

Qwen3.6-27B: SFT vs continued pre-training vs RL? I’m interested in adapting Qwen3.6-27B, but I’m increasingly unsure whether conventional SFT/LoRA is the best route if the goal is to add a capability

Cuda and Vulkan Benchmark: TensorSharp vs. llama.cpp I would like to share my latest open source local Unsloth (GGUF) LLM inference engine and applications. It supports many models from Unsloth, like

RTX 4070, 32gb system ram, Linux. NVIDIA-SMI 610.43.03, KMD Version: 610.43.03, CUDA UMD Version: 13.3 Systemd service modifications: [Service] Environment='OLLAMA_HOST=0.0.0.0:11434' Environment='OLL

https://reddit.com/link/1v5rvuq/video/bgmwc754i9fh1/player My goal was to create a benchmark to measure the spatial awareness and memory of models. Eventually, I came up with the simple idea of a maze

In a previous post (https://www.reddit.com/r/LocalLLaMA/comments/1utefpr/running_qwen3_30b_a3b_at_50_toks_on_rtx_5060_ti/) there seemed to be great demand for bringing in Qwen3.5 35B. Some Gated Delta

https://github.com/shootthesound/Fizgig Intelligent trainer - Per-image loss tracking with self-adapting training runs — every image gets its own verdict (easy / suspect / stuck / exhausted) and its o

I maintain Tagvico, an open-source companion for Paperless-ngx. I added Ollama because document text is exactly the kind of data many people do not want to send to a hosted model. The surprising failu

mii-llm, an open source AI lab, released Zagreus-0.4B-por, a compact bilingual Portuguese–English language model pretrained entirely from scratch. The model has approximately 400 million parameters an

Hey all, I’ve been working on this in my spare time and finally feel ready to share it outside my own circles. Arbiter is a single binary for running agents locally. I originally built it because I wa

If you're running Laguna S 2.1 on llama.cpp and hitting thinking loops because it won't close its </think> tags, you might want to look at your quant before you spend too much time tweaking settings.

Full-parameter post-training of trillion-parameter-scale MoE models introduces substantial system-level challenges for large-scale distributed training, including severe memory pressure, non-overlappe

Today the Department of Energy (DOE) and Arcee AI announced the development of Genesis-Science-1 (GS1), an open model for scientific research. This is a joint effort to bring advanced AI into scientif

Fara1.5-27B is a multimodal computer use agent (CUA) for web browsers, from Microsoft Research AI Frontiers. It observes the browser through screenshots and acts on the user's behalf by emitting struc

Let me try to explain this clearly, simply, and neatly. Originally, I just wanted to build a small WebUI adapter with an admin panel, but things escalated over the last few months. At first, I faced t

Hi everyone, I'm working on extracting the hierarchical structure of long PDF documents (legal/regulatory text, lots of numbered sections) and would like to gather some feedback on my approach before

I managed to get this model working on 2x 3090s with full 262k ctx and N=4, if anyone is interested to try it, thanks to this quant: https://huggingface.co/danielrmay/NVIDIA-Nemotron-Labs-3-Puzzle-75B

https://youtu.be/oxpGq5FITgA?si=nkHWLReGCDYe7QfL I got Hermes running in the native Debian Terminal in Graphene OS and its really slick. Voice dictation works amazingly. Im using a remote Hermes gatew

The full quote: I realize that some people really dislike AI, but this is an area where I'm willing to absolutely put my foot down as the top-level maintainer. Linux is not one of those anti-AI projec

Two DGX Spark and a Connect-X7 cable give you about 250GB of usable memory for 7000 8000 USD. This allows using some interesting models at 4-bit. For what seemed like an eternity, the only serious mod

dam bois we eating good this week ngl, The velocity of the open_weight ecosystem right now is hitting a point where proprietary, closed-source APIs are losing their leverage on compute intelligence. W

A user announced a major update to their Ollama coding assistant featuring Cline, an autonomous coding agent that operates within IDEs and can create, edit files, execute commands, and interact with t

MiniMax M3 launched on June 1, 2026 as the first open-weights model to combine frontier coding, a 1-million-token context window, and native multimodality. The model achieves top-tier performance on c

A user reports difficulty creating an image of a bald green man using ChatGPT's image generation capabilities, likely related to limitations in the DALL-E model's ability to render certain character a

CANTANTE addresses the challenge of optimizing LLM-based multi-agent systems where system-level performance scores are available but individual agent parameters cannot be directly optimized. The frame

A developer created a visualization tool that displays GPT-2's internal concept activations in real-time during text generation, representing the model's 'thinking' process as a 3D graph that updates

A Reddit discussion from r/ChatGPT in which a user expresses their continued preference for ChatGPT while also using Claude, likely exploring whether other users share similar sentiments about ChatGPT

ChatGPT Images 2.0 generates highly realistic images that are difficult to distinguish from authentic photographs, raising concerns about misinformation and deepfakes. The new model features improved

OpenAI introduced ChatGPT Images 2.0, an updated model that can better handle complex visual tasks. It is able to follow detailed instructions, placing and relating objects accurately, preserving fine

Whistant is an on-phone AI buddy that helps users get things done directly from their iPhone without requiring a Mac. It breaks requests into step-by-step subtasks and executes them on the device, inc

Claude Opus 4.7 'thinks more' at higher effort levels, particularly on later turns in agentic settings. Anthropic introduced a new 'xhigh' (extra high) effort level between high and max to give users

A guide on disabling thinking mode in Ollama models using the CLI by running models with the `--think=false` flag or using `/set nothink` followed by a prompt. The post likely discusses how to configu

Yes, Ollama models can be used with the Codex app on Windows. Ollama supports all major operating systems, including Windows , and open models can be used with OpenAI's Codex CLI through Ollama — Code

Qwen 3.6 Plus Preview is Alibaba's next-generation large language model released on March 30-31, 2026 , and the first open-weight variant was released following the February Qwen 3.5 series, prioritiz

This r/ChatGPT thread addresses the well-documented tendency of ChatGPT to be sycophantic — by default, ChatGPT is trained to be polite, non-confrontational, and agreeable — and contrasts it with Clau

Qwen3 is a series of large language models spanning both dense and Mixture-of-Experts (MoE) architectures, with parameter scales ranging from 0.6B to 235B, and a key innovation being the integration o