PEFT
Technology & Computing abbreviation · Artificial Intelligence
| Stands for | Parameter-efficient fine-tuning |
|---|---|
| Categories | Technology & Computing |
PEFT stands for Parameter-efficient fine-tuning, an artificial intelligence abbreviation.
A family of techniques that adapt large pretrained models to new tasks by training only a small fraction of parameters, such as adapters, prefixes or low-rank matrices, saving memory, compute and storage.
Example: With PEFT, we fine-tuned the 7-billion-parameter model on one workstation GPU.
Usage notes
Methods include LoRA, prefix tuning, prompt tuning and adapter layers, and Hugging Face's peft library popularized the abbreviation. Because each task needs only a small adapter, one base model can serve many customized versions.
Related abbreviations
More artificial intelligence abbreviations
- NMT – Neural machine translation
- NN – Neural network
- OCR – Optical character recognition
- ONNX – Open Neural Network Exchange
- OOD – Out-of-distribution
- PCA – Principal component analysis
- POS – Part of speech
- PPO – Proximal policy optimization
- PR – Precision-recall (curve)
- QA – Question answering
- RAG – Retrieval-augmented generation
- ReLU – Rectified linear unit