Pretrained model for student network

[he-y]

Thanks for the great work.

I find the pre-trained model for the teacher network.
Will you release the Pretrained model for student network?

Thanks!

[yuanli2333]

Hi,
There are many kinds of student network in our work. The teacher model can also be student (reverse-KD), and the model itself can also be student (self-teaching). So which pretrained models do you mean?
I think the simplestest way to get the model parameters is to train by youself based on our codes. It is simple and fast to run our codes.

[he-y]

Thanks for the reply.
Is it possible to release the student model based on the accuracy table? This might be easier for us to use.

For example, for every accuracy (such as 71.05) in the table below, a model corresponds to the setting could be released.

This will save lots of time for rerunning the experiments.
Thank you very much!