External Long-term and Working Memory augmented Recurrent Neural Networks (ELWM-RNNs)

Experiment on External Long-term and Working Memory augmented Recurrent Neural Networks (ELWM-RNNs).

Prerequisties

• Python 2.7
• Theano
• Keras

Experiment on algorithm learning

Copy Memory Use During the Copy Task

Repeat Copy (Coming soon...)

Associative Recall (Coming soon...)

Priority Sort (Coming soon...)

Experiment on language modeling

PTB (Coming soon...)

Text8 (Coming soon...)

CBT (Coming soon...)

Experiment on question answering

bAbI (Coming soon...)

Usage

To train a copy task:

    $ python main.py

Future works

• Training ELWM-RNNs with reinforcement learning method.
• Using ELWM-RNNs for other natural language processing tasks.

Author

Zhibin Quan / @SigmaQuan