BERT
Technology & Computing abbreviation · Artificial Intelligence
| Stands for | Bidirectional Encoder Representations from Transformers |
|---|---|
| Categories | Technology & Computing |
BERT stands for Bidirectional Encoder Representations from Transformers, an artificial intelligence abbreviation.
A transformer-based language model from Google that reads text in both directions at once to understand context, trained by predicting masked words. It is used for search ranking, classification and question answering rather than for generating text.
Example: We fine-tuned BERT on support tickets to route each one to the right team.
Usage notes
Published by Google researchers in October 2018, it set records on many language benchmarks and spawned variants such as RoBERTa and DistilBERT. Google began using it in Search in 2019 to interpret queries better. Unlike decoder-only GPT models, BERT is encoder-only. The name continued a Sesame Street naming trend that began with ELMo.
Related abbreviations
More artificial intelligence abbreviations
- ANN – Approximate nearest neighbor (search)
- ASI – Artificial superintelligence
- ASL – AI Safety Level
- ASR – Automatic speech recognition
- AUC – Area under the curve
- AutoML – Automated machine learning
- BLEU – Bilingual evaluation understudy
- BoW – Bag of words
- BPE – Byte-pair encoding
- CLIP – Contrastive Language-Image Pre-training
- CNN – Convolutional neural network
- CoT – Chain of thought