LoRA
Technology & Computing abbreviation · Artificial Intelligence
| Stands for | Low-rank adaptation |
|---|---|
| Categories | Technology & Computing |
LoRA stands for Low-rank adaptation, an artificial intelligence abbreviation.
A parameter-efficient fine-tuning method that freezes a model's original weights and trains small low-rank matrices added to some layers, cutting the number of trainable parameters by orders of magnitude. The resulting adapters are small files that can be swapped on top of one base model.
Example: Load the LoRA trained on our product photos on top of the base image model.
Usage notes
Introduced by Edward Hu and colleagues at Microsoft in 2021. QLoRA (2023) combines it with 4-bit quantization so large models can be fine-tuned on a single GPU, and the Stable Diffusion community shares thousands of LoRAs for styles and characters. LoRa, with a lowercase final a, is an unrelated long-range radio technology for IoT devices.
Related abbreviations
More artificial intelligence abbreviations
- KL – Kullback-Leibler (divergence)
- KNN – K-nearest neighbors
- LDA – Linear discriminant analysis
- Llama – Large Language Model Meta AI
- LLM – Large language model
- LMM – Large multimodal model
- LSTM – Long short-term memory
- MAE – Mean absolute error
- mAP – Mean average precision
- MCP – Model Context Protocol
- MDP – Markov decision process
- ML – Machine learning