A hierarchical deep learning model for supervised sentiment classification on diverse SE datasets
Apart from Tensorflow, the implementation makes use of the classifiers and evaluation metrics implemented in the Scikit-learn library for Python. Word Tokenizer from the NLTK library was used to preprocess the corpora. To perform some linear algebra computations and store the intermediate results, the popular Numpy package was used. The Pandas package provided the necessary utilities for reading and storing the pre-processed text data.
The data being used for this project is stored in a separate repository here: https://github.com/achyudhk/SentiGH-Data. The complete dataset has more than 3000 repositories and is not a part of the repository due to its size. Further, trained Word2Vec models are also not a part of the repository due to their size and are available upon request.
When contributing to this repository, please first discuss the change you wish to make via issue, email, or any other method with the owners of this repository before making a change. Ensure any install or build dependencies are removed before the end of the layer when doing a build. Update the README.md with details of changes to the interface, this includes new environment variables, exposed ports, useful file locations and container parameters.
This project is licensed under the GNU General Public License v3.0 - see the LICENSE.md file for details.
- GloVe: Global Vectors for Word Representation: https://nlp.stanford.edu/projects/glove/. From Pennington, Jeffrey, Richard Socher, and Christopher Manning. "Glove: Global vectors for word representation." Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 2014.
- Repo-Reaper Dataset: https://reporeapers.github.io/results/1.html. From Munaiah, Nuthan, et al. "Curating GitHub for engineered software projects." Empirical Software Engineering 22.6 (2017): 3219-3253.
- Gerrit Dataset: https://github.com/senticr/SentiCR. From Ahmed, T. , Bosu, A., Iqbal, A. and Rahimi, S., "SentiCR: A Customized Sentiment Analysis Tool for Code Review Interactions", In Proceedings of the 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE). 2017.
- Kim, Yoon. "Convolutional neural networks for sentence classification." arXiv preprint arXiv:1408.5882 (2014).
- Zhou, Chunting, et al. "A C-LSTM neural network for text classification." arXiv preprint arXiv:1511.08630 (2015).