opendatahub-io / kubeflow-sdk / 18532804491

76%

push

github

feat: Support LoraConfig in TorchTune BuiltinTrainer (#102)

* feat: Add lora types.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* chore: propagate lora parameters in command.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* feat(lora): Add support for QLoRA.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* fix(lora): remove extra quote symbol in lora attn module.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* fix(lora): replace direct field override with field map.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* fix(lora): remove extra flags.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* fix(lora): fix wrong default list value in LoraConfig.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* fix(lora): rmeove outdated code.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

* test(backend): Add test for lora.

Signed-off-by: Electronic-Waste <2690692950@qq.com>

---------

Signed-off-by: Electronic-Waste <2690692950@qq.com>

14 of 16 new or added lines in 1 file covered. (87.5%)

310 of 428 relevant lines covered (72.43%)

1.45 hits per line