Preface

As a compiler writer for domain specific cloud languages, I became frustrated with the non-constructiveness and disjointedness of my learning experience in the discipline of machine learning systems, particularly with domain specific tensor languages — I needed a book which provided the necessary foundation in the intersection of mathematics, compilers, and computer architecture in order to contribute meaningfully to MLSYS. You can think of these course notes, their accompanying lectures, and the capstone project as the whirlwind tour form of SICP/PAPL applied to substance of neural networks, deep learning frameworks, and massively parallel processors.

If you have similar frustrations, you may benefit from it too.

Good luck on your journey.
Are you ready to begin?