kubeflow / trainer / 15496964830

51%

push

github

KEP-2401: Support loading local LLMs (#2644)

* feat(torch): Support loading local models.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* test(torch): Update UTs for loading local model.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* fix(manifest): Update loading local LLMs command.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* fix(manifest): Update pvc & model dir in manifests.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* fix(test): update UTs.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* fix(torchtune): Update checkpoint dir and tokenzier path in torch plugin.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* chore: tidy up code.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* fix(torchtune): Remove CheckpointDir.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* fix(torchtune): remove DefaultTorchTuneModel.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* chore(torchtune): add extractOverridesFromRuntime func.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* chore(test): update UTs in pkg/runtime/core.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* fix(manifest): update output dir.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

---------

Signed-off-by: Electronic-Waste <2690692950@qq.com>

13 of 25 new or added lines in 1 file covered. (52.0%)

897 of 3073 relevant lines covered (29.19%)

0.34 hits per line