Model Releases
Built GPT-2, Llama 3, and DeepSeek from scratch in PyTorch - open source code + book [p]
A Reddit post on r/MachineLearning sharing an open-source project and accompanying book by Sebastian Raschka that walks through implementing GPT-2, Llama 3, and DeepSeek from scratch using PyTorch, wi
A Reddit post on r/MachineLearning sharing an open-source project and accompanying book by Sebastian Raschka that walks through implementing GPT-2, Llama 3, and DeepSeek from scratch using PyTorch, with no reliance on external LLM libraries. The associated GitHub repository (rasbt/LLMs-from-scratch) contains code for developing, pretraining, and finetuning a GPT-like LLM, and serves as the official code companion to the book Build a Large Language Model (From Scratch), which teaches how LLMs work from the inside out by coding them step by step. The method mirrors the approach used in creating large-scale foundational models such as those behind ChatGPT, making it a practical educational resource for understanding modern LLM architectures.
Related
- Open-source AI is now matching GPT-4 — and you can run it privately for free
- [[project-i-built-an-ai-agent-that-runs-entirely-on-cpu-with-a|[Project] I built an AI Agent that runs entirely on CPU with a 1.5B parameter model — here's what I learned]]
- PIKA: Expert-Level Synthetic Datasets for Post-Training Alignment from Scratch
Source: r/MachineLearning | 2026-04-15