#

transformer-encoder

Here are 68 public repositories matching this topic...

microsoft / DeBERTa

The implementation of DeBERTa

deeplearning representation-learning language-model bert natural-language-understanding self-attention roberta transformer-encoder

Updated Sep 29, 2023
Python

VITA-Group / TransGAN

[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang

pytorch transformer gan transformer-encoder transformer-models

Updated Nov 3, 2022
Python

brightmart / bert_language_understanding

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

nlp text-classification question-answering document-classification transfer-learning fasttext language-model textcnn attention-is-all-you-need self-attention transformer-encoder bert-model pre-training language-understanding

Updated Jan 1, 2019
Python

lilianweng / transformer-tensorflow

Implementation of Transformer Model in Tensorflow

transformer tensorflow-models transformer-encoder attention-is

Updated Mar 25, 2023
Python

wgcban / ChangeFormer

[IGARSS'22]: A Transformer-Based Siamese Network for Change Detection

deep-learning pytorch remote-sensing satellite-imagery attention-mechanism climate-change siamese-network change-detection transformer-encoder transformer-architecture multi-temporal

Updated Jan 31, 2024
Python

zhongkaifu / Seq2SeqSharp

Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, x86, x64, ARM), multimodal model for text and images and so on.

image translation deep-learning neural-network gpu text machine-translation cuda transformer lstm seq2seq sequence-to-sequence tensor encoder-decoder attention-model transformer-encoder transformer-architecture vision-transformer

Updated Apr 18, 2024
C#

jackaduma / SecBERT

pretrained BERT model for cyber security text, learned CyberSecurity Knowledge

Updated Apr 28, 2023
Python

Vidhiwar / multimodule-ecg-classification

Multi-module Recurrent Convolutional Neural Network with Transformer Encoder for ECG Arrhythmia Classification

deep-learning cnn pytorch transformer lstm transformer-encoder mitbih

Updated Oct 4, 2021
Jupyter Notebook

declare-lab / MIME

This repository contains PyTorch implementations of the models from the paper An Empirical Study MIME: MIMicking Emotions for Empathetic Response Generation.

natural-language-processing dialogue-systems conversational-bots transformer-encoder empathetic-responses empathetic-dialogues

Updated Mar 14, 2023
Python

microsoft / CASPR

CASPR is a deep learning framework applying transformer architecture to learn and predict from tabular data at scale.

business deep-learning tabular-data transformer attention-mechanism transformer-encoder transformer-architecture

Updated Feb 9, 2023
Python

bh1995 / AF-classification

The repo is for the Heart Disease classification project using Transformer Encoders in PyTorch.

deep-learning neural-network transformer transformer-encoder ecg-classification

Updated Aug 10, 2021
Python

helpmefindaname / transformer-smaller-training-vocab

Temporary remove unused tokens during training to save ram and speed.

python transformers transformer-encoder

Updated Apr 5, 2024
Python

ApurbaSengupta / Lyrics-Generation-using-BERT

Generating English Rock lyrics using BERT

jupyter-notebook songs transformer bert rhyming lyrics-generator pronouncing transformer-encoder bert-model

Updated May 10, 2019
Jupyter Notebook

jiangnanboy / knowledge-automatic-tagging

题目知识点预测标注。Question knowledge point prediction.

pytorch textcnn transformer-encoder knowledge-auto-tagging

Updated Sep 11, 2022
Jupyter Notebook

gazelle93 / Transformer-Various-Positional-Encoding

This project aims to implement the Transformer Encoder blocks using various Positional Encoding methods.

nlp natural-language-processing pytorch spacy transformer nltk gensim wordembeddings transformer-encoder t5 relative-positional-encoding relative-positional-representation

Updated Nov 14, 2022
Python

heartcored98 / transformer_anatomy

Official Pytorch implementation of (Roles and Utilization of Attention Heads in Transformer-based Neural Language Models), ACL 2020

interpretability interpretable-deep-learning transformer-encoder attention-head

Updated Oct 25, 2022
Python

utahnlp / therapist-observer

Code for the ACL 2019 paper "Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codes"

dialog attention hierarchical-attention-networks focal-loss psychotherapy elmo transformer-encoder acl2019 behavior-coding

Updated Jun 11, 2022
Python

zhenyuanlu / PainAttnNet

Transformer Encoder with Multiscale Deep Learning for Pain Classification Using Physiological Signals

machine-learning deep-learning transformer-encoder pain-classification

Updated Dec 18, 2023
Python

brainsqueeze / text2vec

Contextual embedding for text blobs.

natural-language-processing tensorflow text-summarization sequence-to-sequence text-embedding attention-model transformer-encoder

Updated Jul 15, 2022
Python

jaketae / realformer

PyTorch implementation of RealFormer: Transformer Likes Residual Attention

natural-language-processing pytorch transformer transformer-encoder

Updated May 17, 2021
Python

Improve this page

Add a description, image, and links to the transformer-encoder topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the transformer-encoder topic, visit your repo's landing page and select "manage topics."