Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[onert] Let's support int4 weight #12741

Open
4 tasks
chunseoklee opened this issue Mar 12, 2024 · 5 comments · May be fixed by #12750
Open
4 tasks

[onert] Let's support int4 weight #12741

chunseoklee opened this issue Mar 12, 2024 · 5 comments · May be fixed by #12750

Comments

@chunseoklee
Copy link
Contributor

chunseoklee commented Mar 12, 2024

Let's prepare to support int4 weight (compiler side's issue is at #12717)

todo

@chunseoklee
Copy link
Contributor Author

@seanshpark Is it possible to generate int4 weight model with circlechef(recipe?) ?

@seanshpark
Copy link
Contributor

... int4 weight model with circlechef(recipe?) ?

not yet, but I hope to support within this month :)

@chunseoklee
Copy link
Contributor Author

@seanshpark tflite2circle is able to convert tflite model(with 4bit packed weight) into circle ?

@seanshpark
Copy link
Contributor

tflite2circle is able to convert tflite model(with 4bit packed weight) into circle ?

also not yet 😭
all of our tools needs update to support INT4.

@seanshpark
Copy link
Contributor

please try with #12743 draft (there maybe some problems... please noti me if any)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants