BERT parameter

[X-fxx]

In your code, I found that the value of the parameter init_pretrained is "no". Does this mean that during the model training process, you did not use the pre-trained parameters of the BERT model, but trained a BERT model from scratch? If you are not using the BERT model and I need to use the parameters of the BERT model, what modifications do I need to make?