kubeflow / trainer / 23444362943

58%

Build Type

push

github

Committed by web-flow

Commit Message

feat: customize R generation to include GPUs (#3325)

* feat: customize R generation to include GPUs

Flux detection of GPUs depends on hwloc plugins, and a newer
version. To get around any edge cases where the dependencies are missing,
we can easily generate the R from the expected resource spec (cores
and gpus). We can also add a shared memory mount to ensure the job
MPI gets all available shared memory of the host. The current
default is 64M (automatic from container runtime) and it can have
implications for MPI performance.

Signed-off-by: vsoch <vsoch@users.noreply.github.com>

* review: use generateRange function for gpus

Also update volume to be added to container. This still
is pending testing on AWS!

Signed-off-by: vsoch <vsoch@users.noreply.github.com>

* review and add gpu trainer example

Signed-off-by: vsoch <vsoch@users.noreply.github.com>

---------

Signed-off-by: vsoch <vsoch@users.noreply.github.com>
Co-authored-by: vsoch <vsoch@users.noreply.github.com>

Run Details

16 of 21 new or added lines in 1 file covered. (76.19%)

1 existing line in 1 file now uncovered.

2032 of 3500 relevant lines covered (58.06%)

0.67 hits per line