I trained a 0.5M model on 1B tokens of Fineweb-edu dataset.
DGX agentHi everyone, About a month ago I publish my very first research paper on my neural network architecture called Silia. You can look at the model here: https://huggingface.co/Srijan-Srivastava/Silia-v2