attention_network_experiments

Attention networks for Toxicity challenge

The implementation involves combination of architecture from following papers -

Implementation of Attention Is All you Need from - https://arxiv.org/abs/1706.03762
transformer.py

Name		Name	Last commit message	Last commit date
Latest commit History 14 Commits
.gitignore		.gitignore
AnalyzeModel.ipynb		AnalyzeModel.ipynb
CNN_Experiments.ipynb		CNN_Experiments.ipynb
Character-CNN.ipynb		Character-CNN.ipynb
HAN.ipynb		HAN.ipynb
LICENSE		LICENSE
README.md		README.md
TC-MultiNetwork.ipynb		TC-MultiNetwork.ipynb
TC-MultiNetwork.py		TC-MultiNetwork.py
TC_LSTM_ATTENTION-AT3-MTC-Viz-Sentencelevel-Cleanup.ipynb		TC_LSTM_ATTENTION-AT3-MTC-Viz-Sentencelevel-Cleanup.ipynb
Transformer_Experiments.ipynb		Transformer_Experiments.ipynb
Words Analysis.ipynb		Words Analysis.ipynb
cnn_yk.png		cnn_yk.png
han_classifier_tox.py		han_classifier_tox.py
han_classifier_tox_cnn_han_attn_con.py		han_classifier_tox_cnn_han_attn_con.py
han_classifier_tox_cnn_lstm.py		han_classifier_tox_cnn_lstm.py
han_tox_pred.py		han_tox_pred.py
layer_normalization.py		layer_normalization.py
local_blends.py		local_blends.py
tokenizer_util.py		tokenizer_util.py
toxicity_best_network_local.py		toxicity_best_network_local.py
toxicity_best_network_local_pred.py		toxicity_best_network_local_pred.py
toxicity_best_network_multicell_stacked.py		toxicity_best_network_multicell_stacked.py
transformer.png		transformer.png
transformer.py		transformer.py