NNLM_implementation

Reproducing NNLM

The Neural Network Language Model from the paper " A Neural Probabilistic Language Model "

I Checked out the performance by compare the result of the paper 'How to generate a Good Word Embedding' My result is quite similar to the result of this paper' NNLM model

It was written in C

NNLM_ada_v1.c -> final version of my implementation

NNLM_ada_v1_old.c -> previous version of my first implementation

NNLM_ada_v1_acc.c -> accelerated version from NNLM_ada_v1.c

Dependency

gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.4)

reference

How to Generate a Good Word Embedding? https://arxiv.org/abs/1507.05523 (source code: https://github.com/licstar/compare) A Neural Probabilistic Language Model http://www.jmlr.org/papers/volume3/bengio03a/bengio03a.pdf