Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] Add LLAMA3 ACC CI Test #239

Merged
merged 66 commits into from May 27, 2024
Merged

[CI] Add LLAMA3 ACC CI Test #239

merged 66 commits into from May 27, 2024

Conversation

intellinjun
Copy link
Contributor

Type of Change

feature or bug fix or documentation or others
API changed or not
not

Description

Add llama2 model acc ut for piqa task, llama2 rtn quant config is wint4 cint8 group_size 32

intellinjun and others added 2 commits April 30, 2024 14:20
@intellinjun
Add llama2 acc ut
29218a1 
Signed-off-by: intellinjun <jun.lin@intel.com>
@pre-commit-ci
[pre-commit.ci] auto fixes from pre-commit.com hooks
f1a8e15 
for more information, see https://pre-commit.ci
zhentaoyu
zhentaoyu reviewed May 13, 2024
View reviewed changes
tests/requirements.txt Outdated Show resolved Hide resolved
@zhentaoyu zhentaoyu requested a review from VincyZhang May 13, 2024 02:04
@zhentaoyu
Copy link
Contributor

@VincyZhang, could you please have a look at this? Thanks.

@intellinjun
add ns ci
72fde97 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
add ns ci
4c9b361 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
update ci
e2e6088 
Signed-off-by: intellinjun <jun.lin@intel.com>
intellinjun and others added 15 commits May 13, 2024 19:18
@intellinjun
add lm_eval in conda_env
5f530c6 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
add lm_eval in conda_env
536cc5d 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
add lm_eval in conda_env
f7a31c5 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
Update cpp_graph_inference.sh
a00e0dd
@intellinjun
Update prepare_env_with_conda.sh
d67d72c
@intellinjun
update requirements
0acc498 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
Merge branch 'add_acc_ut' of https://github.com/intel/neural-speed in…
7878dce 
…to add_acc_ut
@pre-commit-ci
[pre-commit.ci] auto fixes from pre-commit.com hooks
b839232 
for more information, see https://pre-commit.ci
@intellinjun
add libxcrypt
5741daf 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
Merge branch 'add_acc_ut' of https://github.com/intel/neural-speed in…
3a24794 
…to add_acc_ut
@intellinjun
Update cpp_graph_inference.sh
ab9e925
@intellinjun
Update cpp_graph_inference.sh
dce1102
@intellinjun
Update cpp_graph_inference.sh
2be9578
@intellinjun
update ci scripts
fc49409 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
Merge branch 'add_acc_ut' of https://github.com/intel/neural-speed in…
b5dc618 
…to add_acc_ut
intellinjun and others added 27 commits May 17, 2024 13:47
@intellinjun
Update calculate_percentiles.py
33ad688
@intellinjun
Update calculate_percentiles.py
43a4f70
@intellinjun
update ci
498e2be 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
Merge branch 'add_acc_ut' of https://github.com/intel/neural-speed in…
7cfe85e 
…to add_acc_ut
@intellinjun
update script
6ff243a 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
update ci
da2936a 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
update ci
ca1530c 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
update ci
44b8ae4 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
update ci
0d52ad6 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
update ci
d10a5c9 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
update ci
1247394 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
Update cpp_graph_inference.sh
647442e
@intellinjun
update ci
719ce59 
Signed-off-by: intellinjun <jun.lin@intel.com>
@pre-commit-ci
[pre-commit.ci] auto fixes from pre-commit.com hooks
423b473 
for more information, see https://pre-commit.ci
@intellinjun
update ce
42c24ac 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
Merge branch 'add_acc_ut' of https://github.com/intel/neural-speed in…
4f2d1df 
…to add_acc_ut
@intellinjun
Update cpp_graph_inference.sh
3368fea
@intellinjun
Update cpp_graph_inference.sh
08a2ae4
@intellinjun
Update cpp_graph_inference.sh
aaf8206
@intellinjun
update ci
c2d7904 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
update ci
1cd0acc 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
Update cpp_graph_inference.sh
506040a
@intellinjun
Update cpp_graph_inference.sh
a0f4747
@intellinjun
update cal_acc script for gguf model inference with llama.cpp
3d574b3 
Signed-off-by: intellinjun <jun.lin@intel.com>
@intellinjun
Merge branch 'add_acc_ut' of https://github.com/intel/neural-speed in…
b7f3072 
…to add_acc_ut
@intellinjun
Update cal_acc.py
03ddaf1
@intellinjun
Update cpp_graph_inference.sh
58450de
zhentaoyu
zhentaoyu approved these changes May 27, 2024
View reviewed changes
Copy link
Contributor

@zhentaoyu zhentaoyu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your effort. LGTM.

@intellinjun
Copy link
Contributor Author

https://inteltf-jenk.sh.intel.com/job/neural_speed_extension/159/artifact/report.html
acc extension test result

@a32543254 a32543254 merged commit bf251bd into main May 27, 2024
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@a32543254 a32543254 a32543254 approved these changes

@zhentaoyu zhentaoyu zhentaoyu approved these changes

@VincyZhang VincyZhang Awaiting requested review from VincyZhang

Assignees
No one assigned
Labels
CI
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@intellinjun @zhentaoyu @a32543254