Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SURVEY] Important Test Cases #211

Closed
tiokim opened this issue Jan 6, 2021 · 2 comments · Fixed by #229
Closed

[SURVEY] Important Test Cases #211

tiokim opened this issue Jan 6, 2021 · 2 comments · Fixed by #229
Assignees
Labels
help wanted Extra attention is needed question Further information is requested

Comments

@tiokim
Copy link
Contributor

tiokim commented Jan 6, 2021

I'd like to know core test cases to add on build workflows like below in order to check the riskiness of PR.
Please leave comments on important test cases, for example common/sigmgr.

image

@tiokim tiokim added help wanted Extra attention is needed question Further information is requested labels Jan 6, 2021
@tdrozdovsky
Copy link
Contributor

This is a good practice! I was on vacation and couldn't answer right away. I think everyone will agree that tests run for every PR.
At the end of 2020, I prepared a workflow to automatically run tests on PR. But I discovered that we have a lot of mistakes. I fixed some inaccuracies in the #212 PR. but there are more serious errors for testing in files:

src / controller / discoverymgr / mnedc / client / client_test.go
src / controller / discoverymgr / mnedc / clientcontrol_test.go
src / controller / discoverymgr / mnedc / servercontrol_test.go
src / orchestrationapi / orchestration_test.go
src / orchestrationapi / orchestrationapi_test.go.

(there may be problems with the architecture, as function calls are looping)

I think that we will fix them in the near future, and when all tests pass successfully, we will add them to the test workflow. And this will allow us to review only successfully tested code, and also raise the level of the best practices of our project.

Thank @t25kim for this proposal, testing is very important for open source projects.

@tiokim
Copy link
Contributor Author

tiokim commented Jan 10, 2021

This is a good practice! I was on vacation and couldn't answer right away. I think everyone will agree that tests run for every PR.
At the end of 2020, I prepared a workflow to automatically run tests on PR. But I discovered that we have a lot of mistakes. I fixed some inaccuracies in the #212 PR. but there are more serious errors for testing in files:

src / controller / discoverymgr / mnedc / client / client_test.go
src / controller / discoverymgr / mnedc / clientcontrol_test.go
src / controller / discoverymgr / mnedc / servercontrol_test.go
src / orchestrationapi / orchestration_test.go
src / orchestrationapi / orchestrationapi_test.go.

(there may be problems with the architecture, as function calls are looping)

I think that we will fix them in the near future, and when all tests pass successfully, we will add them to the test workflow. And this will allow us to review only successfully tested code, and also raise the level of the best practices of our project.

Thank @t25kim for this proposal, testing is very important for open source projects.

@tdrozdovsky Thank you for the comment and PR!
I know there are some issues with mnedc due to the refactoring and hope they will be resolved as soon as possible.
How about running some important TCs through workflows at the moment since some TCs are not working correctly?
We can add whole TCs when all TCs work correctly.

MoonkiHong pushed a commit that referenced this issue Jan 22, 2021
Signed-off-by: Taras Drozdovskyi <t.drozdovsky@samsung.com>

- During the launch of a new PR or push command, a test suite (unit testing) will be launched (Fixes #211).
- It should be noted that testing for the following packages (src/controller/discoverymgr, src/controller/servicemgr/executor/containerexecutor src/orchestrationapi) is temporary excluded due to non-working tests!
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed question Further information is requested
Projects
None yet
4 participants