Hardware
Exciting to work with @googledevs . Dflash is one of the most powerful technique developed here at UCSD by @zhijianliu_ and @jianchen1799 an…
Exciting to work with @googledevs . Dflash is one of the most powerful technique developed here at UCSD by @zhijianliu_ and @jianchen1799 and glad that our students and collaborators help port them in
Exciting to work with @googledevs . Dflash is one of the most powerful technique developed here at UCSD by @zhijianliu_ and @jianchen1799 and glad that our students and collaborators help port them into Google's TPU systems!!! Breaking LLM inference’s autoregressive bottleneck 🛠️ We've teamed up with @haozhangml, @YimingBob, and @aaronzhfeng, among others from UCSD to achieve a massive 3.13X speedup for LLM inference on Google Cloud TPUs using Diffusion-Style Speculative Decoding (DFlash). Read the bl…
Source: Jeremy Howard (X) | 2026-05-06