I scaled a pure Spiking Neural Network (SNN) to 1.088B parameters from scratch. Ran out of budget, but here is what I found [R]
DGX agentA researcher on r/MachineLearning documented an independent attempt to scale a pure Spiking Neural Network (SNN) to 1.088 billion parameters, built from scratch, exploring whether SNNs can achieve per