Word2Vec

→ חזרה למאמר

Word2Vec turns words into number points so words with similar meaning can be close together.

What it does

Word2Vec turns words into number points so words with similar meaning can be close together.

Vector: A point in space • Embedding: A word's math code

How it works

  • Look at words near each other in many sentences.
  • Give each word a set of numbers.
  • Place similar words near each other in number space.

Uses and applications

  • A search app can know that “happy” and “joyful” are related.
  • A recommendation tool can find similar tags.
  • A writing tool can suggest related words.

In short

It helps computers represent word meanings.

Related methods

  • BERT: Produces word vectors that change with the surrounding sentence.
  • CLIP: Places images and text in a shared vector space.
  • PCA (Data Shrinker): Another way to place items in a smaller space of numbers.

Back to Language and text models · All topics

The interactive demonstration and the Python walkthrough for this topic need JavaScript.