Hardware
Looking for feedback on my GPU-accelerated Snake AI project [P]
I've been building an AI that learns to play the classic Snake game through reinforcement learning. The goal is to reach high scores while keeping training time as low as possible. The current version
I've been building an AI that learns to play the classic Snake game through reinforcement learning. The goal is to reach high scores while keeping training time as low as possible. The current version averages 86 points (87 is the maximum) after less than 10 hours of training on a single free Google Colab T4 GPU. To keep training fast, it runs 4,096 Snake games directly on the GPU, combines GPU-native environment simulation with PPO + GAE, and uses a spatially-preserving CoordConv architecture that maintains the full game grid throughout training. I'm sure there's still room to improve. If you've worked on reinforcement learning or efficient training systems, what would you try next? Better exploration, reward design, network architecture, or something else? Repository: (https://github.com/siddhartha399/PPO-CoordConv-Snake) I'd really appreciate any feedback or criticism. submitted by /u/Due_Highlight_9341 [link] [comments]
Related
- Fast experiment on T4 GPU. Self play training on Dark Hex (Colab notebook) [P]
- Profiling PyTorch training without accidentally stalling the GPU [D]
- CA-AC-MPC: CUDA-Accelerated Actor-Critic Model Predictive Control
- Rewriting model inference with CUDA kernels: the bottleneck was not just GEMM [P]
Source: r/MachineLearning | 2026-07-21