Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tough test, stress test, recursive test, and parallel test #127

Open
zaikunzhang opened this issue Oct 5, 2023 · 0 comments
Open

Tough test, stress test, recursive test, and parallel test #127

zaikunzhang opened this issue Oct 5, 2023 · 0 comments

Comments

@zaikunzhang
Copy link
Collaborator

zaikunzhang commented Oct 5, 2023

These tests intend to verify that the solver works properly under different conditions.

Tough test: whether the solver works properly when the objective / constraint function fails or returns exceptional values randomly. For example
https://github.com/libprima/prima/blob/main/matlab/tests/private/tough.m

Stress test: whether the solver works properly when the problem is exceptionally large (e.g., 500 variables and 5000 constraints). For example
https://github.com/libprima/prima/blob/main/matlab/tests/stress.m

Recursive test: whether the solver works properly when invoked recursively. For example
https://github.com/libprima/prima/blob/main/matlab/tests/recursive.m

Parallel test: whether the solver works properly when invoked in parallel. For example
https://github.com/libprima/prima/blob/main/matlab/tests/parallel.m

N.B.

  1. We have to test all platforms (linux, macos, windows and different versions of Python). The behavior may be different when the platform changes.
  2. We need to run these tests periodically on randomized data. Success on a particular problem does not mean anything.
  3. You will need this: https://github.com/orgs/community/discussions/58716
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant