Skip to content

An implementation of the Show, Attend and Tell paper in Tensorflow, for the OpenAI Im2LaTeX suggested problem

Notifications You must be signed in to change notification settings

suragnair/Im2LaTeX

Repository files navigation

Im2LaTeX

An implementation of the Show, Attend and Tell (Xu, Kelvin et. al., 2016) paper in TensorFlow, for the OpenAI Im2LaTeX suggested problem.

  • The crux of the model is contained in cnn_enc_gru_dec_attn.py that uses the embedding attention decoder from TensorFlow to attend on the output of the CNN.

  • test_cnn_enc_gru_dec_attn.py has a method to extract the attention coefficients for each time step, for which I have overwritten some TensorFlow functions from seq2seq.py.

  • An example of attention map over an input LaTeX formula image, as the decoder outputs each token.

alt tag

About

An implementation of the Show, Attend and Tell paper in Tensorflow, for the OpenAI Im2LaTeX suggested problem

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages