From the source
Andrej Karpathy blog Andrej Karpathy blog About Feb 12, 2026 microgpt It takes 200 lines of pure, dependency-free Python to train and inference GPT. I cannot make this any shorter. Mar 14, 2022 Deep Neural Nets: 33 years ago and 33 years from now To my knowledge, LeCun et al. 1989 is the earliest real-world application of a neural net trained end-to-end with backpropagation.