Bridge PEFT ↔ transformers weight-conversion contract so LoRA adapters trained against one transformers…
Bridge PEFT ↔ transformers weight-conversion contract so LoRA adapters trained against one transformers…: a task in HF ML Bench v0 (Harbor dataset). Extend PEFT so that LoRA adapters saved against one transformers model-key layout can be loaded cleanly against a different layout of the same…
The task
Extend PEFT so that LoRA adapters saved against one transformers model-key layout can be loaded cleanly against a different layout of the same architecture — specifically the layout change that transformers introduces when it reshapes MoE and attention projections between major versions.
Part of AdithyaSK/HF_ML_Bench_v0.