We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Hello, Seeing this issue #238, it was said The log probs of input tokens are not supported now, it will be supported in near future.
The log probs of input tokens are not supported now, it will be supported in near future.
Are we supporting log probs of input tokens right now with C++ inflight batching backend?
The text was updated successfully, but these errors were encountered:
Yes, it should be supported now.
Sorry, something went wrong.
byshiue
No branches or pull requests
Hello, Seeing this issue #238, it was said
The log probs of input tokens are not supported now, it will be supported in near future.
Are we supporting log probs of input tokens right now with C++ inflight batching backend?
The text was updated successfully, but these errors were encountered: