BLEU

Technology & Computing abbreviation · Artificial Intelligence

BLEU
Stands forBilingual evaluation understudy
CategoriesTechnology & Computing

BLEU stands for Bilingual evaluation understudy, an artificial intelligence abbreviation.

An automatic metric for machine translation that scores how many words and short phrases in a system's output match one or more human reference translations, reported from 0 to 100 or 0 to 1.

Example: The new model improved BLEU by two points on the German-English test set.

Usage notes

Introduced by Kishore Papineni and colleagues at IBM in 2002. BLEU ignores meaning and synonyms, so it correlates only roughly with human judgment, and newer metrics such as COMET and BERTScore use neural models instead. Pronounced "blue".

More artificial intelligence abbreviations

  • ASI – Artificial superintelligence
  • ASL – AI Safety Level
  • ASR – Automatic speech recognition
  • AUC – Area under the curve
  • AutoML – Automated machine learning
  • BERT – Bidirectional Encoder Representations from Transformers
  • BoW – Bag of words
  • BPE – Byte-pair encoding
  • CLIP – Contrastive Language-Image Pre-training
  • CNN – Convolutional neural network
  • CoT – Chain of thought
  • CUDA – Compute Unified Device Architecture

See all 103 artificial intelligence abbreviations →