You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Since we added the generation rollout MBS parameter to SPIN for PR-133, we set it up in such a way that this new rollout MBS cannot be less that the DP size of your model training.
Since we added the generation rollout MBS parameter to SPIN for PR-133, we set it up in such a way that this new rollout MBS cannot be less that the DP size of your model training.
More details can be viewed here
We should now update SPIN to correctly handle the case of rollout MBS < DP size, and this can be done during the upcoming TRTLLM integration work
The text was updated successfully, but these errors were encountered: