Add LoRA support for the tensor-parallel models supplied by the installed Transformers integration.
Add LoRA support for the tensor-parallel models supplied by the installed Transformers integration.: a task in HF ML Tasksmith (Harbor dataset). A model loaded with tp plan="auto" has linear layers marked with hf tp plan and hf device mesh . LoRA should work when those layers use the supported…
Part of FineEnvs/HF_ML_Tasksmith.