Decoder model for language modelling
-
Updated
Dec 8, 2021 - Python
Decoder model for language modelling
This code project is associated with my master thesis (at the company Omicron Ceti AB) that I have done during spring 2019 at Royal Institute of Technology. The report, to which the code project is associated, is included in this Github repository as "report.pdf".
Natural Language Processing topics and projects.
Reproduction of CIFAR-10/CIFAR-100 and Penn Treebank experiments to test claims in "LookaheadOptimizer: k steps forward, 1 step back" https://arxiv.org/abs/1907.08610
An Implementation One of Natural Language Processing Method : Language Modelling
Introduce basic nlp tasks and methods with examples
Reproduction of CIFAR-10/CIFAR-100 and Penn Treebank experiments to test claims in "LookaheadOptimizer: k steps forward, 1 step back" https://arxiv.org/abs/1907.08610
Distributed tensorflow port for character rnn
Implementation of Transformer, BERT and GPT models in both Tensorflow 2.0 and PyTorch.
Sequence CNN network inspired by the WaveNet architecture written in both Tensorflow and PyTorch.
In this project we will generate the sentences using ngrams
A simple series of programs to train gated recurrent neural networks with PyTorch and generate text based on them.
State-of-the-Art Language Modelling in Python with PyTorch.
BERT-based pre-trained non-autoregressive sequence-to-sequence model
Spelling correction and grammar detection with statistical language models
Various Deep Learning concepts implemented using TensorFlow
Code for paper: "Numeracy Enhances the Literacy of Language Models"
N-Gram language model that learns n-gram probabilities from a given corpus and generates new sentences from it based on the conditional probabilities from the generated words and phrases.
Memory Based Word Predictor/Language Model http://ilk.uvt.nl/wopr/
Add a description, image, and links to the language-modelling topic page so that developers can more easily learn about it.
To associate your repository with the language-modelling topic, visit your repo's landing page and select "manage topics."