I developed my own quantized LLM from scratch, trained on 30B tokens, deploys in 60 MB
DGX agentReposting here after sharing this on [r/MachineLearning](r/MachineLearning) a few days ago, where it got a much better response than I expected (300+ upvotes, great questions, zero roasting) GitHub is