Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

does triton support different model-repository assemble into a batch? #7159

Open
tricky61 opened this issue Apr 25, 2024 · 1 comment
Open

does triton support different model-repository assemble into a batch? #7159

tricky61 opened this issue Apr 25, 2024 · 1 comment

Comments

@tricky61
Copy link

If I have model-repository1 and model-repository2 which share the same structure but different parameters.
Does triton support the requests to model-repository1 and model-repository2 assemble into a batch?
@tricky61
Copy link
Author

or how does different model-repository do parallel computing on one gpu?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@tricky61