BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

GPT2 for Chinese chitchat/用于中文闲聊的GPT2模型(实现了DialoGPT的MMI思想)

RoBERTa中文预训练模型: RoBERTa for Chinese

中文nlp解决方案(大模型、数据、模型、训练、推理)

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。

Human ChatGPT Comparison Corpus (HC3), Detectors, and more! 🔥

Chinese NewsTitle Generation Project by GPT2.带有超级详细注释的中文GPT2新闻标题生成项目。

Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation

TextGen: Implementation of Text Generation models, include LLaMA, BLOOM, GPT2, BART, T5, SongNet and so on. 文本生成模型，实现了包括LLaMA，ChatGLM，BLOOM，GPT2，Seq2Seq，BART，T5，UDA等模型的训练和预测，开箱即用。

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

Pre-trained Transformers for Arabic Language Understanding and Generation (Arabic BERT, Arabic GPT2, Arabic ELECTRA)

Code for producing Japanese pretrained models provided by rinna Co., Ltd.

A PyTorch implementation of "Graph Wavelet Neural Network" (ICLR 2019)

Easy-to-use CPM for Chinese text generation（基于CPM的中文文本生成）

NLP 领域常见任务的实现，包括新词发现、以及基于pytorch的词向量、中文文本分类、实体识别、摘要文本生成、句子相似度判断、三元组抽取、预训练模型等。

Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

MindSpore online courses: Step into LLM

1. Use BERT, ALBERT and GPT2 as tensorflow2.0's layer. 2. Implement GCN, GAN, GIN and GraphSAGE based on message passing.

텐서플로2와 머신러닝으로 시작하는 자연어처리 (로지스틱회귀부터 BERT와 GPT3까지) 실습자료