Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adlik serving can not run faster_rcnn model when batch size > 1 with openvino runtime. #543

Open
EmberYS opened this issue Nov 18, 2021 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@EmberYS
Copy link
Contributor

EmberYS commented Nov 18, 2021

When batch size = 4,
Traceback (most recent call last):
File "fasterrcnn_client.py", line 150, in
_main()
File "fasterrcnn_client.py", line 130, in _main
result = context.run(inputs={input_name: i_inputs_1, 'image_info': i_input_2},
File "/home/intel/miniconda3/envs/tf24/lib/python3.8/site-packages/adlik_serving/init.py", line 191, in run
response = self._runner.predict(request)
File "/home/intel/miniconda3/envs/tf24/lib/python3.8/site-packages/adlik_serving/init.py", line 100, in predict
response = self._stub.predict(request)
File "/home/intel/.local/lib/python3.8/site-packages/grpc/_channel.py", line 826, in call
return _end_unary_response_blocking(state, call, False, None)
File "/home/intel/.local/lib/python3.8/site-packages/grpc/_channel.py", line 729, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.INVALID_ARGUMENT
details = "unexpected size 89600 for inference output 'detection_output', expecting maximum22400"
debug_error_string = "{"created":"@1637220868.582537096","description":"Error received from peer ipv6:[::1]:8500","file":"src/core/lib/surface/call.cc","file_line":1061,"grpc_message":"unexpected size 89600 for inference output 'detection_output', expecting maximum22400","grpc_status":3}"

message report from Adlik/adlik_serving/runtime/openvino/model/ir_model.cc:183.

@amadeus-zte amadeus-zte added the bug Something isn't working label Nov 29, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants