Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

In a multi-model scenario pass model name as argument to input_fn() and output_fn() #77

Open
RajeshRamchander opened this issue Jan 21, 2021 · 0 comments

Comments

@RajeshRamchander
Copy link

Describe the feature you'd like
In cases where the input being inferenced is different for each of the hosted models, the input_fn() would need to branch based on the model that was invoked. Currently, input_fn() is only passed the input data and so branching based on model name in the input_fn() is not possible. Same for output_fn().

How would this feature be used? Please describe.
This feature would be used in multi-model endpoints where different kinds of models work on different kinds on inputs. These input would need some preprocessing based on the model that was invoked.

Describe alternatives you've considered
The only workaround is to pass the model name as a feature in the input data.

Additional context
None.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants