This makes it possible to implement certain training methods for ML models such as Distributed Data Parallel (DDP), in which only one model replica is executed per high-speed accelerator area and ...