- Singularity Systems: Zero to Hero
- Dedication
- Overview
- Scalar Compilers: C89
1. Nanopasses: Parser, Optimizer, Generator
2. Calculator: Arithmetic, Bindings
3. Control flow: Branches, Loops
4. Heap:
- Scalar Compilers: C89 Redux
5. Compile Times: Batched, Incremental, Cached, Parallel
6. Run Times: AST, CFG(BB), SoN
- Vector Compilers: CUDA C
- Tiling Compilers: Triton
- Tensor Compilers: PyTorch 1/2
7. Eager Interpreters: PyTorch1
- 8. Graph Compilers: PyTorch2
- Appendix: Sources and Targets
A Scalar Processors: RISCV
B Vector Processors: NEON, SEE, NVPTX
C Tensor Processors:
- D Tensor Programs: llama2, r1
- Bibliography