Lophius: A workbench for language model research, from the creator of Heretic

Hi folks, I hate slop as much as you do, so instead of starting with "The Problem", I'll just cut to the chase: I just published Lophius, which is the culmination of more than two years of fighting with Jupyter and Transformers. It's a hybrid code/GUI research system that runs inside a notebook. It can eliminate mountains of boilerplate and save you many hours of time. Lophius can be found at https://lophius.org (code at https://github.com/p-e-w/lophius). Lophius handles pretty much all common research tasks: Model inspection, architecture analysis, configuration manipulation, tokenizer inspection, prompt management, inference, logits, entropy, attention scores, hidden states, and chat. In many cases, it can be used without any configuration. It intelligently manages GPU memory during inference, and can lazy-load output signals that you might want to look at later. Lophius has very high quality documentation and a complete tutorial. If you ever wanted to try your hand at transformer research, this might just be what you were waiting for! In the future, Heretic might start using Lophius as a backend, but that's a story for another day. Cheers :) submitted by /u/-p-e-w- [link] [comments]

Related

• Understand Kimi K3 from first principles: a recommended order for anyone trying to understand this beast
• i just spent weeks rewriting my webUI from scratch, getting rid of all AI slop within the codebase and switching it over to a proper lightweight framework (alpine.js). i am now comfortable suggesting it as an alternative to openwebUI, librechat and the like! it is made for local models
• Spent two weeks on a kernel that benchmarked 29x faster. End to end it's maybe 6-10%, and it's not even wired in yet.

Source: r/LocalLLaMA | 2026-08-09