DRAFT: Add a feature to inferencing output shape in the interpreter #12981
Conversation
This PR allows the interpreter to determine the unknown output shape, when it is able to infer the output shape. As a result, the output value of the inferred unknown shape can also be output. Signed-off-by: Seungho Henry Park <shs.park@samsung.com>
|
This draft changes to get the size of output_node from the runtime module, not from the shape of origin model. The runtime module actually calculates the model's output along with the input value, and ultimately calculates and holds the shape of the result. |
| throw std::runtime_error("Cannot find tensor size for output node named \"" + name + "\"."); | ||
| } | ||
|
|
||
| size_t tensor_size = luci::size(output_node->dtype()); |
There was a problem hiding this comment.
It would be better to use luci-interpreter's interface (luci-interpreter::size() is different from luci::size()).
| size_t tensor_size = luci::size(output_node->dtype()); | |
| size_t tensor_size = luci_interpreter::size(tensor->element_type()); |
There was a problem hiding this comment.
@jinevening,
Thanks for the suggestion!
There was a problem hiding this comment.
The luci_interpreter::size() doesn't seem to exist.
Should I make this one..? or do I miss something..?
/git/ONE/compiler/luci-interpreter/src/Interpreter.cpp:137:42: error: ‘size’ is not a member of ‘luci_interpreter’
137 | size_t tensor_size = luci_interpreter::size(tensor->element_type());There was a problem hiding this comment.
Ah, sorry for confusion. I've seen different interface in luci_interpreter in onert-micro (it uses the same namespace..).
luci-interpreter::getDataTypeSize() may be useful. :)
| for (int i = 0; i < tensor->shape().num_dims(); i++) | ||
| tensor_size *= tensor->shape().dim(i); |
There was a problem hiding this comment.
(optional) There is interface for this purpose.
| for (int i = 0; i < tensor->shape().num_dims(); i++) | |
| tensor_size *= tensor->shape().dim(i); | |
| tensor_size *= tensor->shape().num_elements(); |
Signed-off-by: Seungho Henry Park <shs.park@samsung.com>
|
Close as all related PRs are merged into master. |
This PR allows the interpreter to determine the unknown output shape, when it is able to infer the output shape.
As a result, the output value of the inferred unknown shape can also be output.
for issue #12979