kubeflow / trainer / 18653511985

push

github

feat(runtimes): add support for launcher resource allocation in MPI jobs (#2653)

* feat(runtime): add support for launcher resource allocation in MPI jobs

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Add unit tests

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Set numProcPerNode for MPI plugin

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Move util func to runtime package

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Fix torchtune plugin

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Inline if for GPU check

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Assign container resources once

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Add todo for test wrappers

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

---------

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
Co-authored-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

13 of 62 new or added lines in 5 files covered. (20.97%)

1255 of 2438 relevant lines covered (51.48%)

0.61 hits per line