Good morning, everyone! TLDR: full base weights for healed 18b merge are LIVE! I am so blessed and excited by all of the support for my fran…

Good morning, everyone! TLDR: full base weights for healed 18b merge are LIVE! I am so blessed and excited by all of the support for my frankenmerge of Jackrongs models. Positive and negative feedback have been excellent! This community is so incredibly patient and intelligent. You guys all rock! Big thing is some people are having trouble when using Q4 K or V cache compression, so try to keep it toward Q8, fp16 if you have the space. I haven't tried turboquant from @no_stp_on_snek yet, but I would think it would be far superior to basic Q4 kv if you're trying to get more context on tight VRAM! Also, make sure you get the "healed" version of the model weights from my repo. Lots of people were downloading and sharing the unhealed version from Jackrongs repo yesterday and having issues; however, Jackrong was able to reclone the healed repo last night as well, so either repo will work now! Also, I have uploaded the full base weights to a new repo so all of you quantization scholars can do your worst! I'm having some slow upload speed issues still today, so I figured you guys could get mlx and tq going in the meantime with the base weights below. I can't thank you all enough for all of the support, it's been very motivating and incredibly enjoyable to discuss with all of you! Follow me for more insane experiments, follow my friend Jackrong on Hugging Face for more incredible fintunes! Will be posting his stuff here as well while he waits on getting a phone that can get his X account back! Happy Sunday! https://huggingface.co/KyleHessling1/Qwopus-GLM-18B-Healed

Source: Clem Delangue (X) | 2026-04-19

Related