An implementation of GPT2 using the tf.estimator API. Now GPT2 training can be run with Multiple GPUs!
- Easier training and inference
- Train on multiple GPUs
- All the goodies that tf.estimator provides
- TF 2.0 compatible
Reference:
A tf.estimator version of GPT2
License
re-search/gpt2-estimator
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
A tf.estimator version of GPT2
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published