kubeflow / trainer / 26112685124

62%

master: 62%

Pull #3302

github

fix(torchtune): add validation for LoRA multi-node and immutable args

Add two missing validations to validateTorchTune:

1. Reject LoRA fine-tuning when numNodes > 1. getRecipeAndConfig
   silently falls through to full_finetune_distributed in this case,
   discarding LoRA args without any user-visible error.

2. Reject immutable runtime configs (output_dir, tokenizer.path,
   checkpointer.checkpoint_dir, tokenizer.merges_file) in
   spec.trainer.args. These are injected by the runtime via
   extractOverridesFromRuntime and must not be overridden by the user.

Resolves the TODO added by @Electronic-Waste in torchtune.go.

Signed-off-by: Krish Garg <gargkrish06@gmail.com>
Signed-off-by: krishdef7 <gargkrish06@gmail.com>

17 of 17 new or added lines in 1 file covered. (100.0%)

2203 of 3532 relevant lines covered (62.37%)

0.72 hits per line