Tensor Compilers: Zero to Hero

The Hacker's Guide to Tensor Compilers (from scratch)

Prerequisites

• Software 1.0: Graph Algorithms
• Software 2.0: Pretrainined Models

This textbook describes algorithms and data structures at a conceptual level, and the videos implement them with Rust. If you are coming from a C++ background, the C++ to Rust phrasebook may be helpful.

Contributing

The textbook and its from-scratch implementations are open source! To conribute or discuss, join the #singularity-systems work group in the GPU Mode Discord.

Citation

@article{j4orz2025singsys,
  author  = "j4orz",
  title   = "Tensor Compilers: Zero to Hero",
  year    = "2025",
  url     = "https://j4orz.ai/zero-to-hero/"
}