Implementation of Transformer, BERT and GPT models in both Tensorflow 2.0 and PyTorch.
-
Updated
Sep 26, 2022 - Python
Implementation of Transformer, BERT and GPT models in both Tensorflow 2.0 and PyTorch.
In this project we will generate the sentences using ngrams
Decoder model for language modelling
This code project is associated with my master thesis (at the company Omicron Ceti AB) that I have done during spring 2019 at Royal Institute of Technology. The report, to which the code project is associated, is included in this Github repository as "report.pdf".
Natural Language Processing topics and projects.
Memory Based Word Predictor/Language Model http://ilk.uvt.nl/wopr/
Reproduction of CIFAR-10/CIFAR-100 and Penn Treebank experiments to test claims in "LookaheadOptimizer: k steps forward, 1 step back" https://arxiv.org/abs/1907.08610
Introduce basic nlp tasks and methods with examples
Reproduction of CIFAR-10/CIFAR-100 and Penn Treebank experiments to test claims in "LookaheadOptimizer: k steps forward, 1 step back" https://arxiv.org/abs/1907.08610
PyTorch implementations of word embeddings and language modelling.
State-of-the-Art Language Modelling in Python with PyTorch.
BERT-based pre-trained non-autoregressive sequence-to-sequence model
Distributed tensorflow port for character rnn
Code for paper: "Numeracy Enhances the Literacy of Language Models"
Sequence CNN network inspired by the WaveNet architecture written in both Tensorflow and PyTorch.
Spelling correction and grammar detection with statistical language models
A simple series of programs to train gated recurrent neural networks with PyTorch and generate text based on them.
An Implementation One of Natural Language Processing Method : Language Modelling
This repository contains code and data download instructions for the workshop paper "Improving Hierarchical Product Classification using Domain-specific Language Modelling" by Alexander Brinkmann and Christian Bizer.
Add a description, image, and links to the language-modelling topic page so that developers can more easily learn about it.
To associate your repository with the language-modelling topic, visit your repo's landing page and select "manage topics."