You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have noticed that LightLLM currently seems to only support decoding through sampling. Additional decoding methods such as BeamSearch and GreedySearch are not yet supported. I would like to know about the development plans in this regard.
The text was updated successfully, but these errors were encountered:
We have an internal version that supports beam search, but we feel like beam search doesn't add much value to diversity generation, so we have been keeping it out to maintain simplicity in the framework. Is there a rigid use case where beam search is a must-have?
I have noticed that LightLLM currently seems to only support decoding through sampling. Additional decoding methods such as BeamSearch and GreedySearch are not yet supported. I would like to know about the development plans in this regard.
The text was updated successfully, but these errors were encountered: