RNN (Recurrent Net)
An RNN reads things in order and keeps a small memory of what just happened.
What it does
An RNN reads things in order and keeps a small memory of what just happened.
Sequence: Data in order • Recurrent: Repeating or looping
How it works
- Read the first item.
- Pass a memory to the next step.
- Use the memory to understand later items.
Uses & Applications
- A story app can remember earlier words while reading the next words.
- A music app can study notes in order.
- A sensor app can watch changes over time.
In short
It has a looping memory.
Try it yourself
Carry a memory through a number list
Read numbers one at a time. Each step combines the next number with a little of the previous memory.
Your turn
Change one setting at a time. Reset example puts everything back.
Carry a hidden state forward
Step 1Why this happens