Library of Alexandria by O. Von Corven. 19th century.

Afterword

To continue deepening your knowledge, the following courses are also a good next step. Once you feel comfortable, you should graduate towards contributing to tinygrad, an autograd with 20k lines of code. Good luck on your journey. I'll see you at work.

Tensor Programming

  • Cambridge: Information Theory, Pattern Recognition and Neural Networks by David Mackay
  • Tubingen ML4202: Probabilistic Machine Learning
  • Stanford CS109: Probability for Computer Scientists by Chris Piech
  • Stanford CS124: From Languages to Information by Dan Jurafsky
  • Stanford CS229: Machine Learning by Andrew Ng
  • Stanford CS230: Deep Learning by Andrew Ng
  • Stanford CS224N: NLP with Deep Learning by Christopher Manning
  • Stanford NNZH: Neural Networks Zero to Hero by Andrej Karpathy
  • Stanford CS336: Language Modeling from Scratch by Percy Liang

Tensor Interpretation

  • Princeton COS302: Mathematics for Machine Learning by Ryan Adams
  • UPenn STAT 4830: Numerical Optimization for Machine Learning by Damek Davis
  • Brown CS053: Coding the Matrix by Philip Klein
  • MIT 18.S096: Matrix Calculus by Alan Edelman and Steven Johnson
  • MIT 18.335J: Numerical Methods by Steven Johnson
  • MIT 6.172: Performance Engineering by Charles Leiserson and Julian Shun
  • MIT 6.S894: Accelerated Computing by Jonathan Ragan-Kelley
  • Stanford CS149: Parallel Computing by Kayvon Fatahalian
  • Berkeley CS267: Applications of Parallel Computers by Katthie Yellick
  • Carnegie Mellon 18-447: Computer Architecture by Onur Mutlu
  • Carnegie Mellon 18-742: Parallel Computer Architecture by Onur Mutlu
  • ETH 227: Programming Heterogeneous Computing Systems with GPUs by Onur Mutlu

Tensor Compilation

  • Berkeley CS265: Compiler Optimization by Max Willsey
  • Cornell CS4120: Compilers by Andrew Myers
  • Cornell CS6120: Advanced by Adrian Sampson
  • Cornell CS4787: Principles of Large-Scale Machine Learning by Chris De Sa
  • Cornell CS6787: Advanced Machine Learning Systems by Chris De Sa
  • Carnegie Mellon 15-411: Compiler Design by Frank Pfenning
  • Carnegie Mellon 15-745: Optimizing Compilers by Phil Gibbons
  • Rice COMP412: Compiler Construction by Keith Cooper
  • Rice COMP512: Advanced Compiler Construction by Keith Cooper