RNN (Recurrent Net)

โ† Back to the article

An RNN reads things in order and keeps a small memory of what just happened.

What it does

An RNN reads things in order and keeps a small memory of what just happened.

Sequence: Data in order โ€ข Recurrent: Repeating or looping

How it works

  • Read the first item.
  • Pass a memory to the next step.
  • Use the memory to understand later items.

Uses and applications

  • A story app can remember earlier words while reading the next words.
  • A music app can study notes in order.
  • A sensor app can watch changes over time.

In short

It has a looping memory.

Related methods

  • LSTM (Long Memory): Adds gates that help keep information for longer.
  • Transformer: Reads a whole sequence at once with attention.
  • ARIMA: Models ordered values with a statistical formula.

Back to Neural networks and deep learning ยท All topics

The interactive demonstration and the Python walkthrough for this topic need JavaScript.