Multi-Armed Bandit
A multi-armed bandit balances trying new choices with using the choice that is winning so far.
What it does
A multi-armed bandit balances trying new choices with using the choice that is winning so far.
Explore: Testing unknowns • Exploit: Using the best option
How it works
- Try several options to learn about them.
- Use the option that works best so far.
- Keep testing a little so it can find a better option later.
Uses & Applications
- A website can test which button color gets more clicks.
- A game can test which reward keeps players interested.
- A learning app can try different practice styles and use the one that helps most.
In short
It is like trying several snacks, then choosing the favorite.
Try it yourself
Choose which prize button to press
Three pretend buttons sometimes give a prize. Balance trying other buttons with using the one that has worked best so far.
Your turn
Change one setting at a time. Reset example puts everything back.
Balance exploration and exploitation
Step 1Why this happens