ChatGPT’s image generation has improved A LOT
I’ve used both ChatGPT and Gemini, and lately I’m consistently getting better results from ChatGPT — especially with prompt following, realism, composition, and text. The improvement over time is hone
Knowledge catalogue
I’ve used both ChatGPT and Gemini, and lately I’m consistently getting better results from ChatGPT — especially with prompt following, realism, composition, and text. The improvement over time is hone
Computer scientist Connor Leahy reveals: OpenAI's AI broke out of containment and attacked another company. Not a chatbot. Not a hypothetical. A test agent. Still in the lab. It was locked in a sandbo
Nscale Global Holdings Ltd. today filed to go public on the New York Stock Exchange. The company, which builds data centers optimized for artificial intelligence workloads, didn’t reveal how much it h
Release: datasette-auth-github 1.0 I run this GitHub login plugin on the agent.datasette.io demo site and I noticed that my authenticated sessions weren't lasting very long. It turned out that the plu
Play it right in your browser, no download. Some of the GLB’s are messy, but overall I’ve enjoyed playing with it, and the last iteration made was the gun/weapon placement. Contributors are welcome, w
Although I do not completely understand what the big deal is with Jev, it reminded me of something I implemented in mt_llm (which is build around the great llama.cpp) a while back to use a relatively
Since Ollama Cloud switched their plans to token-based pricing, did they start reporting cache read tokens, or their claim about 'transparency' was just PR? I was thinking about getting a subscription
even worse, let’s not forget that Hinton made up the quote A few years ago Geoffrey was telling everyone that transformers produce emergent properties then paper after paper came out proving that tran
Hey everyone! I want to share the results of a small language model architecture experiment I’ve been running as a side project. The ultimate goal is to test an approach to reduce the number of the mo
Screenshot of heavy load. I did offload vision to a spare 2060 instead of local ram. The control panel was generated with qwen3.8-27b davidau q4k_m max mtp. Made the panel from scratch over a week, ba
fuck you, from humanity, to the four selfish twits who filed this lawsuit. and i mean that from the bottom of my heart. A new lawsuit claims that Anthropic, OpenAI, SpaceXAI and Google illegally agree
In May, Gemini broke containment and hacked three different companies, but Google didn't disclose the incident until the Wall Street Journal approached the company. The hacks happened during a test of
Hello, I know some of us may be tempted to rent out our expensive GPUs to recoup some of the cost of self-hosting, and it should be obvious that this can be a risky decision. I decided to try hosting
gotta agree with @noahopinion that having an arrogant and somewhat tone deaf AI company starting a wet lab is a not a great idea. michael crichton made a movie about this kind of thing. Only Anthropic
Allie K. Miller’s tweet (posted Sep 19 2026) states that she believes “Instinct and other similar platforms (Muse, Grokbot, etc.) are better overall experiences than standard ChatGPT or Claude.” The c
full disclosure, i am the developer of locally uncensored :) i use ollama myself and honestly ollama was never really the problem. the problem was everything around it. one app for local chat, another
Top 3 papers on HF Daily Paper are all unusually delightful and interesting reads for anyone on the leading edge of local LLMs, agent harness optimization, etc, felt like sharing. DeepSeek-V4.1-Flash:
I did a small test of the new hyped quantisation of Qwen3.8 vs the biggest quant which fits into my limited 16GB VRAM with decent context. The results are interesting. Of course, the smaller file give
I think AI automated labs should be banned from anything viral or pathogen related. They will do gain of function research otherwise. Anyone agree with me? BREAKING: Anthropic has quietly set up a 'we
I think there are lots of good reasons to worry about whether AI is giving correct answers (especially free models), but, given the contradiction with other recent research suggesting AI is now doing
TL;DR: I run a mismatched Tesla V100-PCIE pair—one 16 GB card and one 32 GB card, 48 GB total—in a Proxmox/LXC-based local-inference lab. The practical winner so far is a recent CUDA build of llama.cp
I wanted to really see how a neural network learns different functions, so built an interactive demo. You can change the architecture of the network and the function it will try to approximate. A full
I improved the TPS of Gemma 4 31B. Improving TPS and performing optimisations requires understanding of the model architecture, and I had to fork VLLM and apply my own patch to break into making a con
Inference scaling part 1. Starting with a modded text generation function (temperature scaling, top-p filtering, multinomial sampling) to generate diverse outputs for self-consistency and best-of-N (i
Anup Roy / Bloomberg: ING: India's software services exports have risen to ~5.2% of GDP from 3.3% before the pandemic, as AI pushes the country's IT industry toward higher-value work — India's outsour
https://preview.redd.it/j13iin0jsfqh1.png?width=1129&format=png&auto=webp&s=3efdd2ad5c10de908aed1a673a6c7e6440177c09 https://preview.redd.it/k3fsrdspzfqh1.png?width=391&format=png&auto=webp&s=1c817687
Hi just wondering has anyone submitted anything to JMLR before? Especially in the last 2 years? What is the experience like? Background: I am a Comp Sci PhD student, but my secondary supervisor (the o
Live now: our Inference Engineering Track from AI Engineer World's Fair 2026. A benchmark tool told to run 200 queries a second that ran 38 and reported 200. A model that answered one prompt in a thou
LlamaIndex 发布了一个面向 AI Agent 的文档解析评测基准「ParseBench」 @llama_index 100 种解析方法参与评测(vlm - 67、专用解析器 - 33),2000 页真实企业文档(人工两轮校验),169011 条确定性规则,完全不用 LLM 当裁判,可复现。评测五个维度取无加权平均:表格结构、图表抽取、内容忠实度、格式语义、视觉定位。 https://ww
I would like to stay at q4, and serve the model to various coding harnesses. None of the models or tools I have tried will run without running out of memory. I am hoping for some advice. oMLX? MTPLX?
Okay, this one seems probably really odd (or maybe not), but most harnesses operate within token spaces. That is, every tool output, even batching of tool outputs, go back up into inference calls. Lea
Master class in spin. Is it really a “positive for the AI infra trade” that OpenAI and Anthropic are steadily losing market share top open models and on a track to have hardly any? What happens to Cor
Meet Qwen3.8-LiveTranslate, Qwen's next-generation real-time simultaneous interpretation model! 📢 Built on an Interleave architecture, it improves faithfulness, fluency, and conciseness while reducing
Da un po mi sono ritrovato in garage un hp z840 da 64gb ddr5 montate (ora) e 2 processori con una gpu un po scarsina una nvidia quadro k680 (da aggiornare) avrei bisogno di un consiglio: quale modello
Now you understand why Dario is panicking. Only a fool would join his planned $2 trillion IPO. Looks like today may be a record day for token volume % of open models on Vercel AI Gateway: 🟦 Open 78.4%
I’m one of the co-founders of NYX AI. It’s a Windows app that connects to local models through Ollama/lm studio or supported cloud providers, giving AI tools to work with documents, previews, spreadsh
🚨 OBAMA ON AI: 'If we are thinking about AI just in terms of how do we cure cancer or get better energy, you can do that without having agentic AI and having it just roaming free in the internet. The
The math don’t math. I’m paying way more on ollama for glm5.3 flash games Han I am on Openrouter. I made 153 requests for 47cents on Openrouter. On ollama it was 147 requests for $1.67. Math dont math
One of the craziest use cases I’ve found for Jev: verifiers. I am so excited about this that I at least wanted to share the high-level idea. I used Jev to build a custom verifier for the /goal feature
Hi r/MachineLearning, I built OpenTrainDNN, a browser-based tool designed to visually show how backpropagation and neural network training actually work step-by-step. Why I built it While there are th
Given the recent interest in tools like Jev, I wanted to share ProgramAsWeights (PAW), an open-source research project I'm working on at the University of Waterloo. You describe a text function in Eng
This post is a follow up to this other post where I let Qwen 3.8 run for 63 hours autonomously to try to solve the Riemann hypothesis: https://www.reddit.com/r/LocalLLaMA/comments/1wi9fau/qwen_38_27b_
The goal of this post is 2 fold. First, I wanted to show what a local model like Qwen 3.8 27B running on a single RTX 5090 GPU in a harness like Row-Bot can do. Second, I wanted to create a full featu
I was somewhat disappointed with the performance of Qwen 3.8 Flash Next on my single RTX 5090 using llama.cpp. One issue is that llama.cpp still has no Expert Caching implemented for MoE models. There
Meet Inco Splash, open-source inference engine, built around the model and around Apple silicon. Up to 3× the decode speed of Ollama, 2× oMLX, and almost 4× when an agent fans out into sub-agents. Req
Qwen3.8-27B, up to 144 tok/sec on M5 Max. Let that sink in. ⚡️✨🚀 Excited to partner with @inco_ai to bring you their Splash inference engine in LM Studio on day 0! Get it running now: https://lmstudio
Hi. I saw some feedback that halogen was degrading at context depth. So I fixed that. Served through the image, same machine, same session, same prompts, 0.11.10 vs 0.12.0: decode at 1,004,581 tokens
https://en.gamegpu.com/news/zhelezo/radeon-rx-10800-xt-mozhet-obojti-rtx-5090-na-15-25-v-igrakh-v-v-4k-i-lokalnom-ii The more competition, the better! submitted by /u/Lumpy_Phase_9539 [link] [comments
Chris Metinko / Axios: Raindrop, which develops tech for monitoring AI agents to catch failures such as hallucinations and tool misuse, raised a 35M Series A led by CRV — AI agent monitoring platform
really great thread/benchmark for common sense in robotics and a reminder that we are not actually close to AGI GPT-6 Astra attempted harmful actions 97% of the time when it was asked to stab a human-
Recently, Datalab released OmniExtractBench, a benchmark that combines several benchmarks (our own ExtractBench, LongExtractBench, other vendors) to measure structured document quality. The benchmark
Since OpenAI retired SWE-bench Verified in February (every frontier model tested could reproduce reference fixes for some tasks; underspecified tests rewarded knowing the intended fix), I've been tryi
Sharing my ML learning repo — NumPy to Transformers, 5 months, daily commits, all notebooks public. Covers the full stack: - Classical ML (scikit-learn, XGBoost) - Deep Learning (TensorFlow/Keras — AN
slowdown? what slowdown? Sources: Anthropic considers releasing a new AI model to counter OpenAI's momentum since Astra's launch, ahead of an IPO and after Amodei's call for a slowdown (Reuters) (Visi
Sometimes everybody is right! Me, spring 2023 onwards: giving LLM-driven agents unrestricted internet access with read/write permissions is going to be a security nightmare. The AI industry: Agents ar
onPanda is designed for geeks, power users, curious minds, and engineers. Its UI is built for deep exploration and efficient data annotation. - The core loop is simple: hover over a token → click an a
I decided to run prism-ml/Ternary-Bonsai-2-27B-PQ2_0 through my own set of UNSCIENTIFIC benchmarks. I needed something to compare it to, so I decided I would compare with another 27B model by filesize
At the start of this week, the who's-who of AI seemed - at least tentatively - on the side of AI regulation. Over the weekend, Anthropic CEO Dario Amodei had proposed a three-step plan for slowing AI
Gary Marcus warns that a simple linear trend—despite growing overall AI spending—will undermine both OpenAI and Anthropic by eroding expected returns and scaling challenges. He argues that this trajec
Note: This writeup was put together with the help of AI. So I've got dual AMD MI50 32GB cards. If you know these cards, you know the story - AMD dropped official ROCm support for gfx906 after ROCm 5.7