A pre-trained language model that understands context from both directions in a sentence. Revolutionary breakthrough in natural language understanding tasks.