Skip to content

mkaufma90/word2vec-deps

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Intro

Word2vec-Dependencies is an attempt to implement Dependency-Based Word Embeddings using Keras/NumPy. This paper describes the skip-gram model of word2vec, but using dependency parses as context, instead of words.

This is for my own edification, and not production grade.

If you look at the bottom of the notebook, at [49], you can see that, despite the small amount of training data, the algorithim is already learning to cluster similar dependency types (e.g., nsubj, dobj) together. In some cases, such as nummod_foot, it is clustering them together based on dependency conext and the target arguments.

Releases

No releases published

Packages

No packages published