Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cli中的confidence实例, 可以支持batch推理吗 #2400

Open
yangyyt opened this issue Mar 11, 2024 · 3 comments
Open

cli中的confidence实例, 可以支持batch推理吗 #2400

yangyyt opened this issue Mar 11, 2024 · 3 comments

Comments

@yangyyt
Copy link

yangyyt commented Mar 11, 2024

Is your feature request related to a problem? Please describe.
希望加速模型推理,能够输出置信度和对齐的时间信息。

Describe the solution you'd like
batch推理。

Describe alternatives you've considered
数据太多了的情况下,调用https://github.com/wenet-e2e/wenet/pull/2083这个推理接口,发现处理时间太长。

Additional context

@Mddct
Copy link
Collaborator

Mddct commented Mar 11, 2024

可以自己改一下 decode接口本身是支持batch的

@yangyyt
Copy link
Author

yangyyt commented Apr 9, 2024

可以自己改一下 decode接口本身是支持batch的

今天在用这个工具打印置信度的时候遇到了一个新的问题,处理大于3min的音频的时候,位置编码过长导致报错,请问cli中的实例应该怎么修改呢
image

@robin1001 @Mddct @xingchensong

@Mddct
Copy link
Collaborator

Mddct commented Apr 9, 2024

不支持这么长的 该位置编码的max len可以 但是效果会变差

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants