#

transformer-xl

Here are 25 public repositories matching this topic...

sooftware / conformer

[Unofficial] PyTorch implementation of "Conformer: Convolution-augmented Transformer for Speech Recognition" (INTERSPEECH 2020)

recognition speech cnn pytorch transformer speech-recognition conv convolution augmented asr conformer transformer-xl

Updated Dec 22, 2023
Python

sail-sg / Adan

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

deep-learning optimizer pytorch artificial-intelligence resnet vit diffusion mae fairseq cuda-programming bert-model gpt2 transformer-xl timm convnext adan dreamfusion

Updated Apr 4, 2024
Python

hirofumi0810 / neural_sp

End-to-end ASR/LM implementation with PyTorch

streaming speech language-modeling pytorch transformer speech-recognition seq2seq attention automatic-speech-recognition sequence-to-sequence language-model attention-mechanism asr ctc rnn-transducer transformer-xl

Updated Aug 30, 2021
Python

rusiaaman / XLnet-gen

XLNet for generating language.

text language-modeling language-model language-generation gpt2 xlnet transformer-xl

Updated Jan 30, 2021
Python

MarcoMeter / episodic-transformer-memory-ppo

Clean baseline implementation of PPO using an episodic TransformerXL memory

deep-reinforcement-learning pytorch transformer policy-gradient pomdp actor-critic proximal-policy-optimization ppo on-policy episodic-memory transformer-xl gtrxl trxl gated-transformer-xl memory-gym

Updated Apr 2, 2024
Python

SuperPiano

asigalov61 / SuperPiano

Absolutely amazing SOTA Google Colab (Jupyter) Notebooks for creating/training SOTA Music AI models and for generating music with Transformer technology (Google XLNet/Transformer-XL)

music machine-learning awesome music-composition transformers artificial-intelligence piano music-generation fastai sota performer reformer pytorch-implementation xlnet transformer-xl music-transformer piano-colab

Updated Mar 8, 2021
Jupyter Notebook

CyberZHG / keras-transformer-xl

Transformer-XL with checkpoint loader

keras transformer-xl

Updated Jan 22, 2022
Python

MarcoMeter / endless-memory-gym

Challenging Memory-based Deep Reinforcement Learning Agents

benchmark deep-reinforcement-learning transformer lstm gru recurrence pomdp gym-environment transformer-xl imperfect-information gtrxl trxl

Updated Apr 19, 2024
Python

Separius / CudaRelativeAttention

custom cuda kernel for {2, 3}d relative attention with pytorch wrapper

cuda pytorch transformer attention transformer-xl relative-embedding

Updated May 5, 2020
Python

davidsvy / transformer-xl

Music and text generation with Transformer-XL.

nlp text-generation transformer music-generation fraud transformer-xl

Updated Sep 30, 2020
Python

cyk1337 / Highway-Transformer

[ACL‘20] Highway Transformer: A Gated Transformer.

pytorch transformer language-model gated-attention transformer-xl highway-transformer gating-transformer

Updated Dec 5, 2021
Python

augustwester / transformer-xl

A lightweight PyTorch implementation of the Transformer-XL architecture proposed by Dai et al. (2019)

nlp pytorch transformer self-attention xlnet transformer-xl cross-attention

Updated Feb 7, 2023
Python

menghuanlater / Tianchi2020ChineseMedicineQuestionGeneration

2020 阿里云天池大数据竞赛-中医药文献问题生成挑战赛

pytorch sequence-to-sequence bert question-generation roberta transformer-xl

Updated Sep 2, 2021
Python

EsterHlav / Quantitative-Comparison-NLP-Embeddings-from-GloVe-to-RoBERTa

Fair quantitative comparison of NLP embeddings from GloVe to RoBERTa with Sequential Bayesian Optimization fine-tuning using Flair and SentEval. Extension of HyperOpt library to log_b priors.

natural-language-processing word2vec pytorch embeddings transformer seq2seq hyperopt glove bayesian-optimization flair bert roberta elmo transformer-xl senteval

Updated Sep 4, 2019
Jupyter Notebook

StefanHeng / Symbolic-Music-Generation

Symbolic music generation taking inspiration from NLP and human composition process

nlp midi transformer music-xml representation-learning music-generation reformer melody-extraction transformer-xl melody-generation transformers-models autoregressive-models transformer-decoder

Updated Jun 28, 2023
Python

YAIxPOZAlabs / Improving-TrXL-for-ComMU

YAI 11 x @POZAlabs : Improving & Evaluating Music Generation with ComMU

music midi generation commu transformer-xl pozalabs

Updated Apr 5, 2023
Python

Wingsdh / transformer-xl-refactoring

A refactored version of kimiyoung / transformer-xl/tf

python nlp tensorflow language-modeling transformer-xl transformerxl

Updated Jun 22, 2020
Python

asigalov61 / Incredible-REMI-Piano

Google Colab based on a fork of REMI repo. Try this incredible REMI Pop Music Transformer easily and quickly :)

music tutorial example music-composition transformer pop piano easy-to-use music-generation colab-notebook xlnet transformer-xl musicai

Updated Aug 10, 2020
Jupyter Notebook

asigalov61 / Incredible-MahlerNet

Absolutely fantastic and fully working SOTA Transformer-XL Music AI implementation MahlerNet by Elias Lousseief

music tutorial example transformers music-generation colab-notebook transformer-xl musicai

Updated Aug 22, 2020
Jupyter Notebook

rachel-pai / search_engine_transformers

search engine based on feature extracted on pretrained transformerXL.

search-engine search-in-text transformers transformer-xl

Updated Feb 1, 2020
Python

Improve this page

Add a description, image, and links to the transformer-xl topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the transformer-xl topic, visit your repo's landing page and select "manage topics."