Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pretrain.py的示例似乎有点错误 #134

Open
xinghudamowang opened this issue Dec 26, 2023 · 0 comments
Open

pretrain.py的示例似乎有点错误 #134

xinghudamowang opened this issue Dec 26, 2023 · 0 comments

Comments

@xinghudamowang
Copy link

CUDA_VISIBLE_DEVICES=1,2,3,5 python3 pretrain.py --dataset_path dataset.pt
--vocab_path models/google_zh_vocab.txt
--config_path models/bert/base_config.json
--output_model_path models/output_model.bin
--world_size 4 --gpu_ranks 0 1 2 3
--data_processor bert
--embedding word pos seg
--encoder transformer --mask fully_visible
--target mlm sp
data_processor 的选项是lm,没有指定target的选项,看代码target的选项是mlm
这似乎和示例给出的预期不太一样

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant