PEFT is an approach that helps improve the performance of large AI models while optimizing for resources like time, energy, and computational power, by adjusting a small number of key parameters while preserving most of the pretrained model’s structure.
Parameter-efficient Fine-tuning (PEFT)
Published
· Updated
