A paper written by Nguyen T. Nguyen and Prof. Jaesik Choi in collaboration with Prof. Yong-ri Choi’s group and Prof. Sam H. Noh’s one is accepted at USENIX ATC 20.
Jay H. Park, Gyeongchan Yun, Chang M. Yi, Nguyen T. Nguyen, Seungmin Lee, Jaesik Choi, Sam H. Noh and Young-ri Choi, HetPipe: Enabling Large DNN Training on (Whimpy) Heterogeneous GPU Clusters through Integration of Pipelined Model Parallelism and Data Parallelism, USENIX ATC 2020.