This model was the recreation of original paper All you need is Attention with improved performance using AdaBoost activation function and scheduled learning rate. Using SQuAD 2.0 dataset, model was utilized for Question Answering application. SQuAD 2.0 consited of answerable questions, and non answerable questions to benchmark the model on true undrestanding of given context. Non answerable questions perfomance is used to show weather model is simply returning probablity of some sentence existing in context and question or weather it is able to check weather question is unrelated to context and does not offer viable answer to the question using given context.
