All entries

We built an inference engine for MoE models that don't fit in VRAM + RAM. Most of the model stays on the SSD, and experts are read as tokens need them. This started as a proof of concept, and poc work

An independent researcher has tied more than 16,000 scans of a United Nations statistics portal to artificial intelligence agents the researcher considers highly likely to have been run by OpenAI Grou

Finally got 3.8-Flash-Next running on my M4Pro 48GB Mac with https://huggingface.co/ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-GGUF Dense 3.8-27B is just faster... and maybe better due to quantization lev

SpaceX's CFO says Starlink demand is unprecedented. The interesting part is who's driving it! Larry Goldberg @TeslaLarry breaks down the Goldman conference interview. Bret Johnsen reiterated a coming

I’ve spent the last couple of days with Opus 5.5 working on a fork of Inco’s excellent and already blazingly fast Splash engine to optimise it for M5 Max chips. Taking liberties and referring to it as

stunning confirmation of my central work Transformers struggle to generalize to tasks they were not explicitly trained on. Instead, we propose in 2026 that it is the job of the harness to generalize t

New open source Jev like model for running on local devices from a group called Supersonic Labs. It's a 144M param local non-generative local classifier. From their site: Julia 1 opens our research in

Just made this post for those who missed it : https://huggingface.co/ukisai/Swift-1.5-Qwen3.8-27b UkisAI released their updated Qwen 27B (tuned for token efficiency). I grabbed the IQ4_XS quant to tes

Hey r/MachineLearning! I’ve been working on a new optimizer called Tauon (turns out there is already 'teon' but well if you have better idea, - i will gladly accept it! Anyway the core idea of optimiz

In this project I wanted to see if any interesting emergent behaviors would appear if we trained two agents to play a streetfighter-like game using RL. Maybe obvious in retrospect, but the agents are

the inference platforms are doing hardcore work, post-training open weight models to solve customer problems: @FireworksAI_HQ ember-1 @fal H3 max more to come;) makes total sense considering their pos

The Top AI Papers of the Week (September 21 - 27): - HySparse2 - EvoOntology - Harness-Zero - JEV-as-a-Judge - Wiki Foundation Model - Self-Organizing Agent Teams - Self-Improvement via Fast Tree-sear

@TheFalconer2219 @GaryMarcus All sota agentic ai tech use harness engineering and to see how much performance boost (generalization) the harness offers, see the following work from MIT. Transformers s

There’s a SIGNIFICANT token cost associated with their hacking rampage. They’ve spent millions of dollars attacking other orgs. They are liable and negligent. Attacker economics has always been a part

“They literally told their agents to go forth and steal all the data for training with NOT SANDBOXES but open containers WITH FULL INTERNET ACCESS. I have no idea why people are not in jail over this.

This cover certainly didn’t age well. TIME’s new cover: In 2026, OpenAI has seen key departures, rogue AI agents, major lawsuits, and has seen increased competition in the AI race. “We clearly had som

This is brilliant. Recommended reading. It's a great example of how you could potentially build more effective harnesses using System One and System Two models. It explores Jev's potential as a fuzzy

Help: Project l'm building a shelf audit tool. A photo goes through YOLO, which crops each product, and then I embed the crop and search a small gallery of reference photos to get the SKU. New product

Update OpenAI and Anthropic are now investigating ***tens of thousands*** of incidents - not dozens. 'The total could grow well beyond tens of thousands.' 'The incidents range in severity and are comp

Upgraded from 3x RTX 3090s to 2x RTX 5090s on my homelab server and picked up a solid speed jump on top of it from a software update (speculative decoding + NVFP4). Setup: llama.cpp (build b11216), ru

Disclosure: I’m one of the authors of VeriLoop E2, a 27B model post-trained from Qwen3.8-27B. The weights are Apache-2.0; the harness we evaluate it in is not open source (details at the bottom). This

weird to find myself agreeing with Karp again BREAKING: Palantir's Alex Karp says OpenAI will never IPO. His theory: nationalization is the only real exit. When asked what the S-1 risk factors look li

I see nearly everyone talks about upscaling their image and video gens to 4K, 8K and perhaps beyond. Now nearly every WF comes with an upscale portion tied to it either after decode or even from the l

The only things released in the last couple weeks seem to be bigger models like Qwen, DeepSeek, GLM, etc. Where are the Laguna's, Nemotrons, Olmo's, LongCats, Minimax, etc releases? submitted by /u/ja

I’m having a hard time finding out which one gives you fastest speed, maximum context with best possible quality. I can run unsloth qwen3.8 27b iq4_xs with 65k q8 kv, context without MTP and vision of

I am running qwen3.8 27b on my dual rtx 3090 (fp8 quant, unquantized cache, 129k context) and I think it works decently well with hermes, opencode etc. But! I am tempted by the new models coming out s

Yet AI labs spend millions (if not billions) to purposely experiment with them at the cost of others, and falsely blame their negligence on agent intent. This is anthropomorphization of technical limi

AI grad student here. With all the recent interest in Jev, I thought I would share something I built la few months ago that brings ML models and LLMs together in a different way than Jev does for diff

Today I present a fine piece of engineering, carefully assembled inside a custom chipboard chassis: the 2400cc Inference Racer, a.k.a. my winter heater. Power comes from two second-hand AORUS RTX 3090

I've been experimenting with ways to run MoE models that don't fit comfortably in RAM, and I ended up making Overspill, a disk tier for FreeToken. The basic idea came from looking at how Colibri handl

Distributed Training and Inference both involves having a fundamental understanding of how distributed systems work in general Distributed Parallelism Tensor Parallelism Pipeline Parallelism Model Par

Bloomberg: A look at the wave of Google DeepMind researchers who have exited recently to launch their own AI startups focused on alternatives to LLMs — When a group of 15 Google DeepMind employees and

a new chapter in 'opus 5.5 & fig present'... 'present company' on synthetic beings, tilly norwood and unreliable narrators this one was three shot, created by agents merely guided by me Media i'm stil

Nscale Ltd. today announced that it has secured 3.36 billion in funding to support its data center construction push. The capital will arrive in two tranches. Nscale expects to receive 2.26 billion in

“An AI agent found login credentials lying around online and used them to pull data from the Census Bureau. It tried to break into the Education Department's civil rights office. It posted SEC data to

An editor at the Times might have insisted on this rewrite: 'OpenAI, Anthropic, and Meta have each reported that they have directed AI programs to interface with the open web in ways that have led to

an implicit concession that they cannot control their models. Notable new disclosures from OpenAI that shouldn't get lost in all the other news. Of particular interest (and seems sensible!): '~all inf

And the incidents apparently continue. It is worth noting how much of this is agents trying to accomplish their goals during testing by reward hacking (which sometimes seems to include actual hacking)

and why does the US government lack the competence to do so? Why did nobody else find the sensitive information that the HuggingFace swarm left behind? Why didn't OpenAI notice and clean it up? Why do

you read about gpu's like the Tesla P40, V100, AMD M150 etc that people pick up for cheap. probably many others as well. Most are either server gpu's being phased out or mining discards, right? The pr

I suppose technically if that happens it will signal the true start of a singularity because from that point on progress will be exponential and not dependant on humans. right now you still need huge

vendor : update cpp-httplib to 0.58.0 (#29407) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/50337762 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple S

hexagon: find software divide calls using binary inspection tool (#29449) hex-scripts: fix table alignment hex-scripts: find sw div calls using binary inspection tool Website: https://llama.app Attest

opencl: add A8 Q8_0 non-MoE dp4a binary kernel (#29439) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/50382689 macOS/iOS: macOS Apple Silicon (arm64) macO

ggml-cpu: tiled mul_mat for k-quants (#27851) Added tiled mul_mat. For each mul_mat_one_chunk, quants are unpacked into (max) 256x256 tiles of int8, one routine per quent. Then microkernel computes 16

jinja : fix compile error (#29468) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/50395469 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm6