CTC (Alignment)

← Back to the article

CTC helps match speech sounds to text even when people speak at different speeds.

What it does

CTC helps match speech sounds to text even when people speak at different speeds.

Alignment: Matching timing of sound to text • CTC: Connectionist Temporal Class.

How it works

  • Look at sound pieces over time.
  • Allow repeats and blank spaces.
  • Collapse them into the final text.

Uses and applications

  • A caption app can handle someone saying “hellooo” slowly.
  • A speech-to-text system can match fast or slow talking.
  • A voice assistant can line up sounds with words.

In short

It aligns sound with text when the timing is not exact.

Related methods

  • Wav2Vec 2.0: A speech model often trained with CTC.
  • Whisper: Generates transcripts token by token instead of using CTC alignment.
  • OCR (Text Reader): Faces the same alignment problem with characters in images.

Back to Audio and speech · All topics

The interactive demonstration and the Python walkthrough for this topic need JavaScript.