AI Glossary
BERT
What is BERT?
Bidirectional Encoder Representations from Transformers — a foundational transformer-based language model from Google (2018) that revolutionised natural language understanding tasks. Trained by predicting masked words from both left and right context, unlike earlier left-to-right models.
Example in practice
A search product team using BERT-based ranking would see improved results when a user searches for "Python not snake" — because BERT understands context in both directions rather than scanning left-to-right.
See also