Skip to content

Commit

Permalink
Merge overleaf-2023-10-04-1751 into main
Browse files Browse the repository at this point in the history
  • Loading branch information
veekaybee committed Oct 4, 2023
2 parents cac0bcc + 7edaf1a commit 2cb7e61
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion embeddings.tex
Original file line number Diff line number Diff line change
Expand Up @@ -1510,7 +1510,7 @@ \subsection{Word2Vec}
\arg\max_\theta \prod_{w\in Text}\left[\prod_{c \in C(w)} p(c|w;\theta)\right]
\end{equation}

If we optimize these parameters - theta and Pi - and maximize the probability that the word belongs in the sentences, we'll learn good embeddings for our input corpus.
If we optimize these parameters - theta - and maximize the probability that the word belongs in the sentences, we'll learn good embeddings for our input corpus.

Let's focus on a detailed implementation of CBOW to better understand how this works. This time, for the code portion, we'll move on from scikit-learn, which works great for smaller data, to PyTorch for neural net operations.

Expand Down

0 comments on commit 2cb7e61

Please sign in to comment.