Under the hood working of XLA

So XLA takes an input language called HLO IR or just High-Level Optimizer (HLO). So XLA takes a graph defined in this HLO and then compiles it into machine instructions for different architectures.

The following diagram shows the compilation process in XLA:

Figure 4: XLA compilation process (Source: https://www.tensorflow.org/images/how-does-xla-work.png)

As we discussed earlier, that TensorFlow uses HLO in order to provide target-independent code, so in this step TensorFlow is only trying to optimize your program without any target constraints, then TensorFlow uses another HLO in order to emit target dependent optimized and analyzed code that will be finally fed to XLA backend for target-specific code generation.

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset