Integrate the PVeRA parameter-efficient adapter (probabilistic vector-based random matrix adaptation) into…
Integrate the PVeRA parameter-efficient adapter (probabilistic vector-based random matrix adaptation) into…: a task in HF ML Bench v0 (Harbor dataset). Integrate a new parameter-efficient fine-tuning method into PEFT: Probabilistic Vector-based Random Matrix Adaptation (PVeRA) . PVeRA is closely…
The task
Integrate a new parameter-efficient fine-tuning method into PEFT: **Probabilistic Vector-based Random Matrix Adaptation (PVeRA)**. PVeRA is closely related to VeRA — both pair a low-rank pair of frozen random projection matrices `A` / `B` (shared across every adapted layer for a given PRNG seed) with tiny per-layer…
Part of AdithyaSK/HF_ML_Bench_v0.