oscillation of loss while training

[Body123]

While training there are oscillations in the validation loss clearly, can you help me why or in there any advice to do while training
and does the variable (num_iteration in epoch ) have an effect on that?

[Body123]

is there any help

[Karol-G]

Hey,

The reported pseudo-dice during training looks promising even though it is not the best. However, this is most likely due to the difficulty of the task or because the dataset is relatively small. An oscillation of the loss is always normal and is larger in cases like the previously mentioned ones.

Best,
Karol