Guard against targeting nn.Parameters on the root module in LoRA by detecting the degenerate empty-path case…
Guard against targeting nn.Parameters on the root module in LoRA by detecting the degenerate empty-path case…: a task in HF ML Bench v0 (Harbor dataset). PEFT's LoRA tuner supports targeting nn.Parameter objects directly via the target parameters configuration option. Internally, PEFT wraps the…
The task
PEFT's LoRA tuner supports targeting `nn.Parameter` objects directly via the `target_parameters` configuration option. Internally, PEFT wraps the **parent module** of the targeted parameter with a `lora.ParamWrapper` to intercept reads and writes to that parameter.
Part of AdithyaSK/HF_ML_Bench_v0.