BERT
BERT looks at the words before and after a word to understand what it means.
What it does
BERT looks at the words before and after a word to understand what it means.
Bidirectional: Reading two directions • Context: Situation around a word
How it works
- Hide or study a word in a sentence.
- Look at words on both sides.
- Use the full sentence to understand the hidden or confusing word.
Uses & Applications
- Google Search can better understand a question.
- A reading app can help fill in a missing word.
- A chatbot can understand when “bank” means money or a river side.
In short
BERT reads in both directions, like reading the words around a blank.
Try it yourself
Fill a missing word using both sides
The blank is written [MASK]. The computer uses words around it to guess what belongs there.
Your turn
Change one setting at a time. Reset example puts everything back.
Use both sides of a masked word
Step 1Why this happens