Model Releases
Are there any model architecture innovations/breakthroughs that we're looking forward to in the next wave of open model drops?
Basically the title. Training models take time and if a model was already in the process of pre-training/RL then it can't be re-cooked with any new architectural improvement that has been discovered i
Basically the title. Training models take time and if a model was already in the process of pre-training/RL then it can't be re-cooked with any new architectural improvement that has been discovered in that timeframe. So, has there been any new innovation which couldn't be incorporated into GLM 5.3, Qwen 3.8, DS V4.1 and such models but we're looking forward to in the next generation? I live under a rock so I'm not aware much of what sort of breakthroughs happen in the industry, but I did hear that the Deepseek V4.1 architecture was really good but couldn't bring out its full potential because it was undertrained. submitted by /u/accelerate_to_asi [link] [comments]
Related
- llama.cpp ngram on RAM/SSD?
- Are models with N-Gram tables going to completely change the AI race?
- nvidias nemotron omni only loads its text half on a mac, so i wrote the vision and audio towers in mlx
Source: r/LocalLLaMA | 2026-09-17