Allow multiple LoRA adapters to use target parameters on the same model, provided all such adapters target…
Allow multiple LoRA adapters to use target parameters on the same model, provided all such adapters target…: a task in HF ML Bench v0 (Harbor dataset). Under the hood, target parameters is implemented by wrapping the targeted parameter with a lora.ParamWrapper . When more than one parameter on the…
The task
Under the hood, `target_parameters` is implemented by wrapping the targeted parameter with a `lora.ParamWrapper`. When more than one parameter on the same module is targeted, wrappers are **nested** — one `ParamWrapper` wraps another, and the position in that nesting encodes which parameter each adapter belongs to.
Part of AdithyaSK/HF_ML_Bench_v0.