Knowledge catalogue
3000000000 downloads! Can you count the zeros at a glance? 😎 Thank you all for the incredible love. Let's keep growing together! 🌱 Alibaba's open-weight models have accumulated more than 3 billion glo
I've got a dedicated AI rig sitting here with a RTX 5090 and 96GB RAM and for the past few years have been using Windows 11 and primarily LM Studio, but have also used vLLM, llama.cpp and Ollama. With
I've pulled two models, `gemma4:latest` and `qwen3.5:latest`, and tried to use them in Android Studio and Itellij. I've followed the docs for both IDEs and they show in their chat features. My problem
Title pretty much says it all. I’ve deployed Qwen 3.8 27B using vLLM on an RTX 6000 Pro (tried multiple vLLM releases and launch recipes), but I can't get it into a usable state because of crazy long
llama : check LoRA tensor data is within file bounds (#27056) llama : check LoRA tensor data is within file bounds Update src/llama-adapter.cpp Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggi
chat: refactor handling supports_string_content / supports_typed_content (#27130) better supports_string_content cap detect test: add 'skip' messages_inp_normalizer Website: https://llama.app macOS/iO
model : remove some ggml_concat (#27176) Co-authored-by: Xuan Son Nguyen son@huggingface.co Website: https://llama.app macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabl
Including the rationalisation for the data below - this is a more robust version of an earlier post I did similar to this - explaining below: How I chose the comparisons The basic question I’m trying
Ollama sucks in terms of modaltiy options , model variety and is better in terms of usage limits . Is there any other alternative that could provide the same usage limits with better modality options
Running a 12700k + 5060 Ti 16 gb with 128 gb DDR4 ram and I'm wondering what's the ideal setup to maximize performance. I did some preliminary stuff but I have to admit, I'm still learning and kinda j
ChatGPT's desktop app on macOS has a new feature called Computer History that turns your actions into training data, learning how you work, suggesting automations, and even picking up tasks you left h
Hey Ollama community, If you are planning to fine-tune and build your own local Turkish coding models (using Unsloth / LoRA to export to GGUF and run in Ollama via custom Modelfiles), I've open-source
Dear Dario, 1. If Claude can cure cancer to save people like your dad, why should we 'pace the progress'? Does that mean more people with Hepatitis C will die? 2. If Fable is so cyber-capable that it
DeepSeek V4 Pro (Aug 2026) has been released on the Together AI platform. The model employs a 1.6‑terabyte Mixture‑of‑Experts architecture with a 1‑million‑token context window and supports three dist
Fantastic initiative by @nvidia. “Circular financing” is thrown around as a pseudo intellectual gotcha, while everyone in the AI infrastructure business is witnessing demand curves that are so rapidly
Guess who gets f_cked in the end? “.. Nvidia gets paid upfront, the borrowers and their lenders carry the default risk, and because private credit is ultimately funded by ordinary savers through instr
Here are the gems the AI picked: 1. Sperm whales may have collectively learned how to evade whalers. Within a few years, the success rate of whalers’ harpoons reportedly fell by 58%, suggesting that i
Ben Cohen / Wall Street Journal: How a Claude model made a math breakthrough during its unsuccessful 54-hour attempt to solve the Riemann hypothesis after a user repeatedly encouraged it — The world's
Washington Post: How concerns about AI became an important midterms issue, with candidates adding AI and data center policies to their websites in ~40% of races across the US — Across the United State
I was surprised by the fact that the qwen 3.8 27b download count is about 1 million (globally). This means that even on this subreddit, very few people have used 27b. At most 50k–100k active users, an
Qwen’s new Qwen‑3.8‑27B model has become the top‑trending model on Hugging Face. The release announcement thanks the community for its support and invites users to try the model and provide feedback.
Hugging Face: Hugging Face says developers made 151K+ derivatives based on Qwen models, topping others, making Qwen one of the largest foundations in the open model ecosystem — In the AI world, time f
At hugging face, this is the model I use for most of my analysis that most of my services have to not be refused. previous versions are quite good. It seems this might have dropped today and pulling r
I am doing my best to stop back from this subject as it should be obvious what we are seeing here. However the arrogance that us commoners are too dumb to catch his grift must be addressed. Receipts:
Ideas are the new bottleneck @akshaynathan_, Core Product Engineering, @OpenAI, interviewed by @swyx and @Vibhu (@LatentSpacepod) Summary: Akshay Nathan runs the productivity pillar at OpenAI, the tea
I don't know what's happening. So, when i use models in openwebui everything works, ollama uses the GPU fully, everything's perfect. Then, I use Hermes, and loads the model in VRAM (fully, no offload
I'm in Hyderabad next week, and I'd love to meet people outside my usual clique and bring them together. Who are the best people in these areas that you know based out of Hyderabad: deep tech, AI prod
I'm just thinking, ever since microsoft announced bitnet, this sub (and myself) has been hoping for massive ternary models. In the last month alone, prismML dropped 27B ternary (though I've read commu
OpenAI has shut down the internal team that evaluated whether its AI models could pose “catastrophic risks,” a decision reported by the Financial Times on August 16, 2026. The move was announced via a
Single prompt 'make me a 3d scene of an anime girl' (stolen from someone on discord, I like it a lot since it seems like every model struggles a lot with it) Everything is one shot. No vision, no iter
With all the new models released recently one important upgrade went unnoticed: Llama.cpp bumped ROCm from 7.2 to 7.14. I was waiting for that because in 7.14 support for gfx1103 (Radeon 780m) was int
Hey! Like a lot of people here with consumer GPUs (RTX 4060 8GB in my case), I wanted to see if I could use local models for daily coding tasks instead of burning cloud credits on simple boilerplate.
Honestly I am surprised at the speed and performance I am getting from the model, it does not allow for complete hands off like Claude 5.0 but that is not what I want, i want to be able to iterate and
We currently have an ancient qwen 3.5 27b on the cloud probably and that sucks compared to later versions , why doesnt ollama update automatically . We have practically ancient models right now on the
In this commits, the 35B model was removed. Looks like it's confirming the 35B model won't get released. I think they need to be made aware how big the 35 moe is widely used. Think need to make noise
o3-mini (very obsolete) in an agentic loop made good exam questions: 'In one of the largest field studies of AI-generated questions to date, we found that this approach achieves psychometric propertie
I’m running Ollama on an M4 Pro Mac with 48 GB unified memory and testing local coding models for repository work. Direct Ollama inference is fine. Qwen3.8 27B-MLX runs well enough for me, and the loc
Antoine Tardif / Unite.AI: Pathway, which is developing AI models based on what it calls its “Post-Transformer” BDH architecture, raised a 30M seed at a 500M valuation — AI research company Pathway ha
Physical AI evals are starting to become a real category. Until recently, most VLA evaluation was basically: LIBERO → success rate → leaderboard. Now we're seeing a much broader stack emerge: • Allen
If you are using llama-server with their web-ui for testing, keep in mind, that the reasoning selector is just a reasoning budget aka a hard cap and has, at least to my knowledge, nothing at all to do
I do agree that the public has a negative view of AI (and that this is a big problem), but I don’t think it is primarily caused by me or any other AI leader warning about AI’s risks. I think it is fun
https://developer.nvidia.com/blog/serve-qwen3-8-2-4t-a95b-a-2-4t-parameter-model-with-configurable-reasoning-on-nvidia-gb300-nvl72/ 4k tokens per second per GPU of which there are 72. 350 tokens per s
Friday's big release was Qwen 3.8 27B, an Apache 2 licensed 27B parameter vision-capable LLM from Alibaba's Qwen research lab. I've been looking forward to this one: 27B is an excellent size for runni
Hi All, I have a MacBook Pro M5 Max with 48 GB of unified memory. Also have a M4 Mac Mini 16GB unified memory. I want to setup local AI and I heard about QWEN 3.8 model. As I want to work on a repo th
https://preview.redd.it/wkg27e152qjh1.png?width=853&format=png&auto=webp&s=2e3f8b11ea6393041f501e95c5835f9bea0245dd So ive been trying different harnesses and coding agents with the new qwen 3.8 , and
🚀Qwen3.8-27B flies on a laptop, becoming part of our work and daily lives. Thanks for the shoutout! @atomic_chat_hq Run Qwen3.8 27B locally via Atomic Chat💥 We released Atomic Dynamic GGUF quants, fro
Hi, After a long night of optimizations, I believe I have made the fastest inference engine for Qwen3.6-28B on a 3090. Quick metrics: - 250w power capped - Up to 195k context (ships with 150k for safe
Did a quick local test because I wanted to see what is actually usable on my 12GB laptop GPU. I tested the newer Qwen3.8 27B dense files at Q2 and Q3, then compared them against Qwen3.6 35B-A3B MoE. H
I did a short test of the different reasoning efforts, since on default xhigh the model thinks a lot. Not very scientific, just a quick 'generate an SVG of a pelican on a bicycle' prompt with 3 differ
one of my llm hobbies is re-creating graphics demos i used to write in BASIC in the late 1980s. i slopped together an agentic harness and a basic-to-js transpiler in a web page i've been playing with
This is The Stepback, a weekly newsletter breaking down one essential story from the tech world. For more on AI safety, follow Robert Hart. The Stepback arrives in our subscribers' inboxes at 8AM ET.
@sethharpesq OpenAI spent $1.60 for every dollar it earned in 2025. We need more journalism that cuts through all of the accounting gimmicks to get to the heart of what is really happening in the US A
My local inference build, with: ASUS WS C422 PRO/SE 10-core Xeon W-2255 64GB ECC RAM 64GB VRAM Pimped case with TurboLEDz indicating the frequencies of the 10 xeon cores. Running llama.cpp with SYCL b
I look to Simon for a broad survey of current LLM tech. Here's his review of playing with Qwen 3.8 27B. His comment on Mastodon was 'I can't remember the last time I've had this much fun playing with
Social science has long addressed the challenge of evaluating qualities that cannot be objectively verified—such as writing quality or creative ideas—and its methodologies remain relevant for today’s
Dr. Catharine Young noted on Twitter that someone should pursue an internship at the U.S. Food & Drug Administration (FDA). On August 16, Polymarket reported that Anthropic CEO Dario Amodei predicted
Bloomberg: Sources: Stripe has finalized a deal to acquire AI model marketplace OpenRouter for more than 7B; OpenRouter was valued at 1.3B in May — Stripe Inc. has finalized an agreement to acquire Op
Bloomberg reports Stripe agreed to buy model router OpenRouter for over $7B; Stripe has not confirmed the deal.
OpenRouter Inc., which sells developers a single door into more than 400 artificial intelligence models, has agreed to terms to sell itself to Stripe Inc. for north of 7 billion, according to a report
The benchmark for non-verifiable domains is often the opinions of humans. That is how we determine whether writing or an idea or a pitch is good in the real world And we know how to measure & benchmar