PyTorch JIT Source Code Read Note (Updated at Feb 2020)
This is my note for reading PyTorch’s JIT source. We begin by looking at torch.jit.script
to find the frontend that compiles the Python code into PyTorch’s tree views, and the backend that compiles tree views to graph. We also read the structure of the internal representation of PyTorch’s graph. Finally we go to graph executor to look at how the computation graph is further compiled into instructions and how the action of these instructions are defined and executed.