Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about quantization gemm example #1102

Open
allnes opened this issue Apr 17, 2024 · 0 comments
Open

Question about quantization gemm example #1102

allnes opened this issue Apr 17, 2024 · 0 comments

Comments

@allnes
Copy link

allnes commented Apr 17, 2024

HI!

I'm looking for ways for reusing yours quantization kernels in OpenVINO and see this example.

I see that you use main gemm kernel and after that I see next stage

And I have next question, could I get QASSYM8 data type from main gemm kernel and inside current kernel do requatization through using QuantizationInfo from dst?

@allnes allnes changed the title Questions about quantization gemm example Question about quantization gemm example Apr 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants