BERT

Bidirectional Encoder Representations from Transformers

| PAPER (theory) | Hugging Face (engineering) | |

The BERT model was proposed in BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding by Jacob Devlin, Ming-Wei Chang, Kenton Lee and Kristina Toutanova. It’s a bidirectional transformer pretrained using a combination of masked language modeling objective and next sentence prediction on a large corpus comprising the Toronto Book Corpus and Wikipedia.

How to see 😲

Just type the '.' on your keyboard now!!,

for watching the directory (codes) on Visual Studio Code -Github

Name		Name	Last commit message	Last commit date
Latest commit History 77 Commits
BERT-viz		BERT-viz
BERT		BERT
ENSEMBLE		ENSEMBLE
10fold_1014_0.784코드.ipynb		10fold_1014_0.784코드.ipynb
AEDA.ipynb		AEDA.ipynb
KERC_1014_BERTEnsemble.ipynb		KERC_1014_BERTEnsemble.ipynb
KERC_1016_7fold.ipynb		KERC_1016_7fold.ipynb
KERC_1020.ipynb		KERC_1020.ipynb
KERC_1022-4TRY.ipynb		KERC_1022-4TRY.ipynb
KERC_1022_2EPOCH_SEED2_BATCH_1616_PRIVATE_TRUE.ipynb		KERC_1022_2EPOCH_SEED2_BATCH_1616_PRIVATE_TRUE.ipynb
KERC_1022_5fold_오후앙상블2TRY.ipynb		KERC_1022_5fold_오후앙상블2TRY.ipynb
KERC_1022_5fold_오후앙상블_2TRY.ipynb		KERC_1022_5fold_오후앙상블_2TRY.ipynb
KERC_1022_PRIVATE.ipynb		KERC_1022_PRIVATE.ipynb
KERC_1022_arg;acc.ipynb		KERC_1022_arg;acc.ipynb
KERC_1022_args수정1.ipynb		KERC_1022_args수정1.ipynb
KERC_1022_batch=64,weightdecay=0.1.ipynb		KERC_1022_batch=64,weightdecay=0.1.ipynb
KERC_1022_weightdecay=0.01,lr=5e-5.ipynb		KERC_1022_weightdecay=0.01,lr=5e-5.ipynb
KERC_1022_오후앙상블1TRY.ipynb		KERC_1022_오후앙상블1TRY.ipynb
KERC_1022_오후앙상블_3TRY_10FOLD.ipynb		KERC_1022_오후앙상블_3TRY_10FOLD.ipynb
KERC_1022_이름전처리.ipynb		KERC_1022_이름전처리.ipynb
LICENSE		LICENSE
README.md		README.md
Tokenizer_Translation.ipynb		Tokenizer_Translation.ipynb
lossfunc_TEST.ipynb		lossfunc_TEST.ipynb
호반우NLP_1010_5CV.ipynb		호반우NLP_1010_5CV.ipynb
호반우NLP_EDA.ipynb		호반우NLP_EDA.ipynb
호반우NLP_ELECTRA.ipynb		호반우NLP_ELECTRA.ipynb
호반우NLP_LargeModel.ipynb		호반우NLP_LargeModel.ipynb
호반우_1005_acc+.ipynb		호반우_1005_acc+.ipynb
호반우_1008_5CV.ipynb		호반우_1008_5CV.ipynb
호반우_Cross_Validation.ipynb		호반우_Cross_Validation.ipynb
호반우_Cross_Validation_nine_Fold.ipynb		호반우_Cross_Validation_nine_Fold.ipynb
호반우_ELECTRA_K_FOLD.ipynb		호반우_ELECTRA_K_FOLD.ipynb
호반우_EN2KO_Translation.ipynb		호반우_EN2KO_Translation.ipynb
호반우_GroupKFOLD.ipynb		호반우_GroupKFOLD.ipynb
호반우_SoongsilBERT_CV.ipynb		호반우_SoongsilBERT_CV.ipynb
호반우_funnel-kor.ipynb		호반우_funnel-kor.ipynb
호반우퓨샷NLP_bad_ver.ipynb		호반우퓨샷NLP_bad_ver.ipynb

License

purang2/BERT

Folders and files

Latest commit

History

Repository files navigation

BERT

How to see 😲

About

Topics

Resources

License

Stars

Watchers

Forks

Languages