You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, thank you for sharing such an awesome project.
For the TF-reg KD, in line 47 of my_loss_function.py, should we also divide the temperature T on the output variable, like: loss_soft_regu = nn.KLDivLoss()(F.log_softmax(outputs / T, dim=1), F.softmax(teacher_soft/T, dim=1))*params.multiplier
As in Eq (9) of your paper, the loss function is $$D_{KL}(p^d_\tau, p_\tau)$$.
I would really appreciate it if you could help me. Look forward to your reply, thanks!
The text was updated successfully, but these errors were encountered:
Hi, thank you for sharing such an awesome project.
For the TF-reg KD, in line 47 of my_loss_function.py, should we also divide the temperature T on the output variable, like:
loss_soft_regu = nn.KLDivLoss()(F.log_softmax(outputs / T, dim=1), F.softmax(teacher_soft/T, dim=1))*params.multiplier
As in Eq (9) of your paper, the loss function is $$D_{KL}(p^d_\tau, p_\tau)$$.
I would really appreciate it if you could help me. Look forward to your reply, thanks!
The text was updated successfully, but these errors were encountered: