Growing neural cellular automata in PyTorch

In this video, I implement the Growing Neural Cellular Automata article. It is a biologically inspired deep learning pipeline that generates update rules that are applied to a grid of pixels. It uses heavily the convolution operation together with multiple other techniques - alive masking and stochastic update. Implementation from the video: Original article: Youtube tutorial by the author: Existing PyTorch implementation: 00:00 Intro resources 01:10 Motivation and setup: Game of life 04:12 Learning rules using convolutions 06:04 Article: proposed pipeline 08:35 Model: constructor 11:35 1x1 convolution explained 13:29 Model: constructor continued 14:29 Model: helper methods 17:22 Model: forward pass 18:43 Training script 24:52 Launch training 25:20 Results 25:44 What was not