ShapeWorks 6.2 Testing #1509

akenmorris · 2021-10-13T18:04:34Z

TODO: clean up this note to remove the "done" portions below.
@sheryjoe there are several people missing from our repo who attend our weekly meetings.

Please edit and add a ✅ indicating success and ❌ indicating failure or 🕒 for a test in progress with your username when you complete a task for a given platform. Also, go ahead and add new tasks that might not already be on here.

When a test fails, please add a github issue:

add the Testing label and any others that are pertinent (bug, etc)
set Milestone to the 6.2 release
link it to this issue (ShapeWorks 6.2 Testing #1509) (when the issue is fixed and ready to test again it will make a comment below).

Please use the most recent release candidate for all testing (be careful which shapeworks is in your $PATH).

The most recent is RC9:

https://github.com/SCIInstitute/ShapeWorks/releases/tag/v6.2.0-rc9

Example:

	Windows	Mac
Notebooks		🕒 (@archanasri - A)
Usecase: Ellipsoid	✅ (@akenmorris - A)
Usecase: All tiny-test	❌ (#1073)	✅ (@cchriste - A)

Systems chart

Username	System
(@HeavenlyBerserker - A)	Ubuntu 20.04.2 LTS (Linux) [Binaries]
(@HeavenlyBerserker - B)	Microsoft Windows 10 Education (Windows) [Release Branch]
(@iyerkrithika21 - A)	Microsoft Windows 10 Home OS Build 19042.1052 (Windows) [Binaries]
(@archanasri - A)	macOS Monterey 12.0.1 (OSX) [Binaries]
(@cchriste - A)	maxOS Big Sur 11.3.1 (OSX)
(@cchriste - B)	openSUSE 15.1 (Linux)
(@cchriste - C)	Windows 10
(@akenmorris - A)	Windows 10
(@akenmorris - B)	openSUSE Leap 15.3
(@akenmorris - C)	MacOS 10.5.7
(@akenmorris - D)	Ubuntu 20.04 LTS
(@jadie1 - A)	openSUSE 15.0 (Linux)
@patkins - A)	OpenSUSE 15.2
@patkins - B)	Windows 10
(@username - B)	System (System Type)

Instructions for running and testing items

Testing modes:

Binary downloads

Go to https://github.com/SCIInstitute/ShapeWorks, click releases, click the system you are testing, download and unzip the first asset.
Set your paths to the release binaries instead of your regular paths. Make sure python scripts are running them.

Release/master branch

Fetch, checkout master, and pull; Make sure it builds. If you're on your usual repository directory, you might need to delete the dependencies directory and rerun source build_dependencies.sh.

Clean installation

Find a different machine or create a VM and download the binaries (or clone branches and build if you're feeling industrious).
Run 1 or 2 items in each category.

General instructions

Before testing anything, activate the shapeworks Anaconda environment via conda activate shapeworks. You might have to update it via source conda_installs.sh.
Now follow the specific instructions for each item type below.

Notebooks

Go to ShapeWorks/Examples/Python/notebooks/tutorials on terminal/CMD.
Run the jupyter notebook command.
Open whichever file you wish to test.
Make sure it runs to completion and each input matches what the explanation says.

UseCases

Go to ShapeWorks/Examples/Python/ on terminal/CMD or on your favorite IDE that runs python.
Run the python RunUseCase.py --use_case <use_case> command, where <use_case> is replaced by the command given. For instance python RunUseCase.py --use_case femur, or python RunUseCase.py --use_case femur --groom_images.
Wait until it finishes. A Studio Analyze window should pop up. Make sure sampling, correspondence, and analyze->PCA->animate are reasonable.

Studio

Go to ShapeWorks/Examples/Python/<item> on terminal/CMD, where "" is the item you're testing.
Run the command ShapeWorksStudio <item>.xlsx.
Click on "Run Groom" and make sure it's reasonable. Click on the "Optimize" tab, and click "Run Optimize". Go to the "Analyze" tab and make sure sampling, correspondence, and analyze->PCA->animate are reasonable.

Studio: MeshGrooming

Download test_meshes.zip and unzip.
Run command ShapeWorksStudio, or open ShapeWorksStudio somehow.
"Start New Project" -> "+ to import shapes" -> Select all 4 downloaded shapes and open.
Play with the mesh groom parameters and the views. Adjust parameters and make sure it still makes sense; e.g. check Groom->Smooth and adjust laplacian, then "Run Groom"; e.g. move around, click Center, increase viewers, run groom with other parameters, etc.

Ok, now the real thing!

*(not sure where to find results in Use Cases documentation for comparison)

	Windows	Mac	Linux
Clean installation	✅ (@akenmorris - A)-rc6 ✅(@iyerkrithika21 - A)-rc7	✅ (@akenmorris - C)-rc6	✅ (@akenmorris - D)-rc6
Notebooks: getting-started-with-notebooks	✅ (@akenmorris - A)-rc6 ✅(@iyerkrithika21 - A)-rc7	✅ (@akenmorris - C) ✅(@archanasri - A)-rc7	✅ (@akenmorris - D)-rc6
Notebooks: getting-started-with-segmentations	✅ (@akenmorris - A)-rc6 ✅(@iyerkrithika21 - A)-rc7 #1573	✅ (@akenmorris - C) ✅(@archanasri - A)-rc7	✅ (@akenmorris - D)-rc6
Notebooks: getting-started-with-exploring-segmentations	✅ (@akenmorris - A)-rc6 ✅(@iyerkrithika21 - A)-rc7 #1573	✅ (@akenmorris - C) ✅ (@archanasri - A)-rc7	✅ (@akenmorris - D)-rc6
Notebooks: getting-started-with-meshes	(@akenmorris - A)-rc6 ✅(@iyerkrithika21 - A)-rc7 #1573	✅ (@akenmorris - C) ✅(@archanasri - A)-rc7	✅ (@akenmorris - D)-rc6
Notebooks: getting-started-with-data-augmentation	✅ (@akenmorris - A)-rc6 #1573	✅ (@akenmorris - C) ✅(@archanasri - A)-rc7	✅ (@akenmorris - D)-rc6
Notebooks: getting-started-with-shape-cohort-generation	✅ (@akenmorris - A)-rc6 ✅(@iyerkrithika21 - A)-rc7	✅ (@akenmorris - C) ✅(@archanasri - A)-rc7	✅ (@akenmorris - D)-rc6
Usecase: ellipsoid	✅ (@cchriste - C) ✅(@iyerkrithika21 - A)-rc7	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@akenmorris - B)-rc6
Usecase: ellipsoid_cut	✅ (@akenmorris - A)-rc6 ✅(@iyerkrithika21 - A)-rc7	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@akenmorris - B)-rc6
Usecase: ellipsoid_evaluate	✅ (@akenmorris - A)-rc6 ✅(@iyerkrithika21 - A)-rc7	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@akenmorris - B)-rc6
Usecase: ellipsoid_pca	✅ (@cchriste - C) ✅(@iyerkrithika21 - A)-rc7	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@akenmorris - B)-rc6
Usecase: ellipsoid_fd	✅ (@cchriste - C) ✅(@iyerkrithika21 - A)-rc7	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@akenmorris - B)-rc6
Usecase: ellipsoid_mesh	✅ (@cchriste - C)✅(@iyerkrithika21 - A)-rc7	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@akenmorris - B)-rc6
Usecase: ellipsoid_multiple_domain	✅ (@cchriste - C) ❌(#1572)	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@akenmorris - B)-rc6
Usecase: ellipsoid_multiple_domain_mesh	✅ (@akenmorris - A)-rc6 ✅(@iyerkrithika21 - A)-rc7	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@jadie1 - A-rc5)
Usecase: femur	✅ (@akenmorris - A)-rc6	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@jadie1 - A-rc5)
Usecase: femur --groom_images	✅ (@akenmorris - A)-rc6	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@jadie1 - A-rc5)
Usecase: femur_mesh	✅ (@akenmorris - A)-rc6	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@jadie1 - A-rc5)
Usecase: femur_cut	✅ (@akenmorris - A)-rc6	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@akenmorris - B)-rc6
Usecase: femur_cut --groom_images	✅ (@akenmorris - A)-rc6	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@jadie1 - A-rc5)
Usecase: femur_pvalues	✅ (@cchriste - C) ✅(@iyerkrithika21 - A)-rc7	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@akenmorris - B)-rc6
Usecase: left_atrium	✅ (@cchriste - C)	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@akenmorris - B)-rc6
Usecase: left_atrium --groom_images	✅ (@akenmorris - A)-rc6	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@akenmorris - B)-rc6
Usecase: lumps	✅ (@cchriste - C) ✅(@iyerkrithika21 - A)-rc7	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@akenmorris - B)-rc6
Usecase: thin_cavity_bean	✅ (@akenmorris - A)-rc6	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@akenmorris - B)-rc6
Usecase: supershapes_1mode_contour	✅ (@akenmorris - A)-rc6 ✅(@iyerkrithika21 - A)-rc7	✅ (@akenmorris - C)-rc6 ✅(@archanasri - A)-rc7	✅ (@akenmorris - B)-rc6
Usecase: deep_ssm*	✅ (@akenmorris - A)-rc6	✅ (@akenmorris - C)-rc6	✅ (@akenmorris - D)-rc6
Studio: ellipsoid	✅ (@akenmorris - A)-rc6 ✅(@iyerkrithika21 - A)-rc7	✅ (@akenmorris - C)-rc6	✅ (@akenmorris - D)-rc6
Studio: FeatureMap	✅ (@akenmorris - A)-rc6 ✅(@iyerkrithika21 - A)-rc7	✅ (@akenmorris - C)-rc6	✅ (@akenmorris - D)-rc6
Studio: MeshGrooming	✅ (@akenmorris - A)-rc6 ✅(@iyerkrithika21 - A)-rc7	✅ (@akenmorris - C)-rc6	✅ (@akenmorris - D)-rc6
Studio: EllipsoidMultipleDomain	✅(@iyerkrithika21 - A)-rc7
...

* Edit deep_ssm.py so that num_samples = 3 on line 76 and "epochs": 3, on line 132, otherwise it will take upwards of two days.

Please keep comments on this issue to a minimum. Let's try to keep the status in the table and not in the comments.

The text was updated successfully, but these errors were encountered:

patkins · 2021-10-15T16:36:38Z

I can't seem to edit above, but I have OpenSUSE 15.2 and Windows 10 that I can test on.

cchriste · 2021-10-15T17:37:56Z

I can't seem to edit above, but I have OpenSUSE 15.2 and Windows 10 that I can test on.

Thanks Penny. I'm not sure why you cannot edit, especially since you can be assigned! But please keep commenting and one of us can add the details you share above.

jadie1 · 2021-10-21T20:38:32Z

Should we be testing RC3?

akenmorris · 2021-10-21T20:44:59Z

Yes. I am working on automated verification though.

cchriste · 2021-10-21T20:51:36Z

Should we be testing RC3?

Hi Jadie, I think it would be really helpful to have a demonstration of how to manually verify a use case is correct by looking at the results in Studio. If you have expertise doing something like this, would it be possible to record a short video demonstrating and explaining how one might go about this? This aid can help everyone to better ensure not only that the use cases complete, but that their results seem correct (or incorrect).

jadie1 · 2021-10-21T21:03:33Z

@cchriste All of the use cases have updated results in the documentation. I would just recommend running the use cases then comparing what you see in studio with the snapshots and videos of expected output in the documentation.

iyerkrithika21 · 2021-10-26T19:12:22Z

ellipsoid_multiiple_domain misspelled in help (someone please correct this with another PR since it's really expensive to only do it for one pr)

I will create a PR for the the typos in ellipsoid pca and multiple domains.

iyerkrithika21 · 2021-10-26T19:14:25Z

ellipsoid_multiple_domain looks good, the single sample median never changes (maybe the first sample is the median)

In the joint dataset, only one ellipsoid changes rotation and or size w.r.t to the first one. So one of the ellipsoids will not have any modes of variation. I am not sure if you are referring to this.

akenmorris · 2021-10-27T18:46:37Z

When should this Difference portion of the GUI be active? Should it be in a dropdown like the metrics?
image

It will be active if there are groups present (e.g. group_<> columns). I think maybe a tooltip or message why it's greyed out could be helpful. I think it's in the right place.

akenmorris · 2021-11-05T07:07:26Z

RC6 on linux:

---------------------------------------------
Testing Results:
---------------------------------------------
The following use cases passed (40)
[ PASSED ] :     29 seconds : ellipsoid --tiny_test
[ PASSED ] :     22 seconds : ellipsoid_mesh --tiny_test
[ PASSED ] :     39 seconds : ellipsoid_fd --tiny_test
[ PASSED ] :     30 seconds : ellipsoid_cut --tiny_test
[ PASSED ] :     21 seconds : lumps --tiny_test
[ PASSED ] :     48 seconds : left_atrium --tiny_test
[ PASSED ] :     64 seconds : femur --tiny_test
[ PASSED ] :     25 seconds : ellipsoid --tiny_test
[ PASSED ] :     17 seconds : ellipsoid_mesh --tiny_test
[ PASSED ] :     34 seconds : ellipsoid_fd --tiny_test
[ PASSED ] :     28 seconds : ellipsoid_cut --tiny_test
[ PASSED ] :     18 seconds : lumps --tiny_test
[ PASSED ] :     40 seconds : left_atrium --tiny_test
[ PASSED ] :     31 seconds : femur --tiny_test
[ PASSED ] :     88 seconds : femur --groom_images --tiny_test
[ PASSED ] :     24 seconds : femur_mesh --tiny_test
[ PASSED ] :     71 seconds : femur_cut --tiny_test
[ PASSED ] :     90 seconds : femur_cut --groom_images --tiny_test
[ PASSED ] :     88 seconds : deep_ssm --tiny_test
[ PASSED ] :     36 seconds : supershapes_1mode_contour --tiny_test
[ PASSED ] :     16 seconds : thin_cavity_bean --tiny_test
[ PASSED ] :     31 seconds : ellipsoid_multiple_domain --tiny_test
[ PASSED ] :     23 seconds : ellipsoid_multiple_domain_mesh --tiny_test
[ PASSED ] :     12 seconds : ellipsoid_pca --tiny_test
[ PASSED ] :     83 seconds : ellipsoid --verify
[ PASSED ] :     78 seconds : ellipsoid_cut --verify
[ PASSED ] :     36 seconds : ellipsoid_fd --verify
[ PASSED ] :     41 seconds : ellipsoid_mesh --verify
[ PASSED ] :    410 seconds : ellipsoid_multiple_domain --verify
[ PASSED ] :    184 seconds : ellipsoid_multiple_domain_mesh --verify
[ PASSED ] :   7636 seconds : femur --verify
[ PASSED ] :   8507 seconds : femur --groom_images --verify
[ PASSED ] :    525 seconds : femur_mesh --verify
[ PASSED ] :   7433 seconds : femur_cut --verify
[ PASSED ] :   6244 seconds : femur_cut --groom_images --verify
[ PASSED ] :   4341 seconds : left_atrium --verify
[ PASSED ] :   3119 seconds : left_atrium --groom_images --verify
[ PASSED ] :    429 seconds : lumps --verify
[ PASSED ] :   1658 seconds : thin_cavity_bean --verify
[ PASSED ] :     36 seconds : supershapes_1mode_contour --verify

---------------------------------------------

100.00% tests passed, 0 failed out of 40

Total Test time: 41687 seconds

akenmorris · 2021-11-05T14:35:32Z

RC6 on Mac:

[ PASSED ] : 26 seconds : ellipsoid_fd --tiny_test
[ PASSED ] : 16 seconds : ellipsoid_cut --tiny_test
[ PASSED ] : 12 seconds : lumps --tiny_test
[ PASSED ] : 38 seconds : left_atrium --tiny_test
[ PASSED ] : 55 seconds : femur --tiny_test
[ PASSED ] : 14 seconds : ellipsoid --tiny_test
[ PASSED ] : 10 seconds : ellipsoid_mesh --tiny_test
[ PASSED ] : 24 seconds : ellipsoid_fd --tiny_test
[ PASSED ] : 14 seconds : ellipsoid_cut --tiny_test
[ PASSED ] : 10 seconds : lumps --tiny_test
[ PASSED ] : 28 seconds : left_atrium --tiny_test
[ PASSED ] : 21 seconds : femur --tiny_test
[ PASSED ] : 71 seconds : femur --groom_images --tiny_test
[ PASSED ] : 22 seconds : femur_mesh --tiny_test
[ PASSED ] : 54 seconds : femur_cut --tiny_test
[ PASSED ] : 74 seconds : femur_cut --groom_images --tiny_test
[ PASSED ] : 90 seconds : deep_ssm --tiny_test
[ PASSED ] : 34 seconds : supershapes_1mode_contour --tiny_test
[ PASSED ] : 10 seconds : thin_cavity_bean --tiny_test
[ PASSED ] : 18 seconds : ellipsoid_multiple_domain --tiny_test
[ PASSED ] : 12 seconds : ellipsoid_multiple_domain_mesh --tiny_test
[ PASSED ] : 4 seconds : ellipsoid_pca --tiny_test
[ PASSED ] : 90 seconds : ellipsoid --verify
[ PASSED ] : 73 seconds : ellipsoid_cut --verify
[ PASSED ] : 24 seconds : ellipsoid_fd --verify
[ PASSED ] : 44 seconds : ellipsoid_mesh --verify
[ PASSED ] : 537 seconds : ellipsoid_multiple_domain --verify
[ PASSED ] : 334 seconds : ellipsoid_multiple_domain_mesh --verify
[ PASSED ] : 11024 seconds : femur --verify
[ PASSED ] : 11734 seconds : femur --groom_images --verify
[ PASSED ] : 917 seconds : femur_mesh --verify
[ PASSED ] : 11018 seconds : femur_cut --verify
[ PASSED ] : 12882 seconds : femur_cut --groom_images --verify
[ PASSED ] : 5271 seconds : left_atrium --verify
[ PASSED ] : 5340 seconds : left_atrium --groom_images --verify
[ PASSED ] : 783 seconds : lumps --verify
[ PASSED ] : 4715 seconds : thin_cavity_bean --verify
[ PASSED ] : 46 seconds : supershapes_1mode_contour --verify

100.00% tests passed, 0 failed out of 40

Total Test time: 65601 seconds

akenmorris · 2021-11-05T19:54:04Z

RC6 on Windows:

---------------------------------------------
Testing Results:
---------------------------------------------
The following use cases passed (40)
[ PASSED ] :     18 seconds : ellipsoid --tiny_test
[ PASSED ] :     13 seconds : ellipsoid_mesh --tiny_test
[ PASSED ] :     32 seconds : ellipsoid_fd --tiny_test
[ PASSED ] :     21 seconds : ellipsoid_cut --tiny_test
[ PASSED ] :     14 seconds : lumps --tiny_test
[ PASSED ] :     40 seconds : left_atrium --tiny_test
[ PASSED ] :     22 seconds : femur --tiny_test
[ PASSED ] :     15 seconds : ellipsoid --tiny_test
[ PASSED ] :     11 seconds : ellipsoid_mesh --tiny_test
[ PASSED ] :     24 seconds : ellipsoid_fd --tiny_test
[ PASSED ] :     17 seconds : ellipsoid_cut --tiny_test
[ PASSED ] :     10 seconds : lumps --tiny_test
[ PASSED ] :     27 seconds : left_atrium --tiny_test
[ PASSED ] :     21 seconds : femur --tiny_test
[ PASSED ] :     69 seconds : femur --groom_images --tiny_test
[ PASSED ] :     16 seconds : femur_mesh --tiny_test
[ PASSED ] :     80 seconds : femur_cut --tiny_test
[ PASSED ] :     70 seconds : femur_cut --groom_images --tiny_test
[ PASSED ] :     77 seconds : deep_ssm --tiny_test
[ PASSED ] :     40 seconds : supershapes_1mode_contour --tiny_test
[ PASSED ] :     11 seconds : thin_cavity_bean --tiny_test
[ PASSED ] :     20 seconds : ellipsoid_multiple_domain --tiny_test
[ PASSED ] :     14 seconds : ellipsoid_multiple_domain_mesh --tiny_test
[ PASSED ] :      3 seconds : ellipsoid_pca --tiny_test
[ PASSED ] :     92 seconds : ellipsoid --verify
[ PASSED ] :     95 seconds : ellipsoid_cut --verify
[ PASSED ] :     27 seconds : ellipsoid_fd --verify
[ PASSED ] :     51 seconds : ellipsoid_mesh --verify
[ PASSED ] :    527 seconds : ellipsoid_multiple_domain --verify
[ PASSED ] :    314 seconds : ellipsoid_multiple_domain_mesh --verify
[ PASSED ] :  10425 seconds : femur --verify
[ PASSED ] :  10957 seconds : femur --groom_images --verify
[ PASSED ] :   1202 seconds : femur_mesh --verify
[ PASSED ] :  11932 seconds : femur_cut --verify
[ PASSED ] :  12688 seconds : femur_cut --groom_images --verify
[ PASSED ] :   5157 seconds : left_atrium --verify
[ PASSED ] :   5517 seconds : left_atrium --groom_images --verify
[ PASSED ] :   1005 seconds : lumps --verify
[ PASSED ] :   8059 seconds : thin_cavity_bean --verify
[ PASSED ] :     44 seconds : supershapes_1mode_contour --verify

---------------------------------------------

100.00% tests passed, 0 failed out of 40

Total Test time: 68778 seconds

akenmorris · 2021-11-13T17:21:16Z

RC8 Windows:

Testing Results:

The following use cases passed (40)
[ PASSED ] : 45 seconds : ellipsoid --tiny_test
[ PASSED ] : 15 seconds : ellipsoid_mesh --tiny_test
[ PASSED ] : 34 seconds : ellipsoid_fd --tiny_test
[ PASSED ] : 22 seconds : ellipsoid_cut --tiny_test
[ PASSED ] : 17 seconds : lumps --tiny_test
[ PASSED ] : 50 seconds : left_atrium --tiny_test
[ PASSED ] : 107 seconds : femur --tiny_test
[ PASSED ] : 16 seconds : ellipsoid --tiny_test
[ PASSED ] : 11 seconds : ellipsoid_mesh --tiny_test
[ PASSED ] : 25 seconds : ellipsoid_fd --tiny_test
[ PASSED ] : 17 seconds : ellipsoid_cut --tiny_test
[ PASSED ] : 11 seconds : lumps --tiny_test
[ PASSED ] : 27 seconds : left_atrium --tiny_test
[ PASSED ] : 22 seconds : femur --tiny_test
[ PASSED ] : 70 seconds : femur --groom_images --tiny_test
[ PASSED ] : 17 seconds : femur_mesh --tiny_test
[ PASSED ] : 105 seconds : femur_cut --tiny_test
[ PASSED ] : 71 seconds : femur_cut --groom_images --tiny_test
[ PASSED ] : 118 seconds : deep_ssm --tiny_test
[ PASSED ] : 40 seconds : supershapes_1mode_contour --tiny_test
[ PASSED ] : 11 seconds : thin_cavity_bean --tiny_test
[ PASSED ] : 20 seconds : ellipsoid_multiple_domain --tiny_test
[ PASSED ] : 14 seconds : ellipsoid_multiple_domain_mesh --tiny_test
[ PASSED ] : 3 seconds : ellipsoid_pca --tiny_test
[ PASSED ] : 104 seconds : ellipsoid --verify
[ PASSED ] : 103 seconds : ellipsoid_cut --verify
[ PASSED ] : 30 seconds : ellipsoid_fd --verify
[ PASSED ] : 58 seconds : ellipsoid_mesh --verify
[ PASSED ] : 593 seconds : ellipsoid_multiple_domain --verify
[ PASSED ] : 344 seconds : ellipsoid_multiple_domain_mesh --verify
[ PASSED ] : 11822 seconds : femur --verify
[ PASSED ] : 11077 seconds : femur --groom_images --verify
[ PASSED ] : 1201 seconds : femur_mesh --verify
[ PASSED ] : 12112 seconds : femur_cut --verify
[ PASSED ] : 12766 seconds : femur_cut --groom_images --verify
[ PASSED ] : 5452 seconds : left_atrium --verify
[ PASSED ] : 5744 seconds : left_atrium --groom_images --verify
[ PASSED ] : 841 seconds : lumps --verify
[ PASSED ] : 8487 seconds : thin_cavity_bean --verify
[ PASSED ] : 51 seconds : supershapes_1mode_contour --verify

100.00% tests passed, 0 failed out of 40

Total Test time: 71674 seconds

sheryjoe · 2021-11-13T17:24:38Z

@akenmorris are we ready to release 6.2?

akenmorris · 2021-11-13T17:32:20Z

The use cases appear to all work according to the verify script. I have not examined the shape models in Studio yet.

Someone needs to re-test all of the jupyter notebooks on all three platforms.

We also need to resolve #1580.

sheryjoe · 2021-11-13T17:35:20Z

@jadie1 @iyerkrithika21 could you re-test the notebooks?

akenmorris · 2021-11-13T17:35:49Z

Linux RC8:

Testing Results:

The following use cases passed (40)
[ PASSED ] : 23 seconds : ellipsoid --tiny_test
[ PASSED ] : 15 seconds : ellipsoid_mesh --tiny_test
[ PASSED ] : 30 seconds : ellipsoid_fd --tiny_test
[ PASSED ] : 29 seconds : ellipsoid_cut --tiny_test
[ PASSED ] : 14 seconds : lumps --tiny_test
[ PASSED ] : 36 seconds : left_atrium --tiny_test
[ PASSED ] : 56 seconds : femur --tiny_test
[ PASSED ] : 19 seconds : ellipsoid --tiny_test
[ PASSED ] : 13 seconds : ellipsoid_mesh --tiny_test
[ PASSED ] : 26 seconds : ellipsoid_fd --tiny_test
[ PASSED ] : 26 seconds : ellipsoid_cut --tiny_test
[ PASSED ] : 12 seconds : lumps --tiny_test
[ PASSED ] : 26 seconds : left_atrium --tiny_test
[ PASSED ] : 22 seconds : femur --tiny_test
[ PASSED ] : 67 seconds : femur --groom_images --tiny_test
[ PASSED ] : 16 seconds : femur_mesh --tiny_test
[ PASSED ] : 55 seconds : femur_cut --tiny_test
[ PASSED ] : 70 seconds : femur_cut --groom_images --tiny_test
[ PASSED ] : 70 seconds : deep_ssm --tiny_test
[ PASSED ] : 31 seconds : supershapes_1mode_contour --tiny_test
[ PASSED ] : 10 seconds : thin_cavity_bean --tiny_test
[ PASSED ] : 23 seconds : ellipsoid_multiple_domain --tiny_test
[ PASSED ] : 16 seconds : ellipsoid_multiple_domain_mesh --tiny_test
[ PASSED ] : 4 seconds : ellipsoid_pca --tiny_test
[ PASSED ] : 69 seconds : ellipsoid --verify
[ PASSED ] : 81 seconds : ellipsoid_cut --verify
[ PASSED ] : 27 seconds : ellipsoid_fd --verify
[ PASSED ] : 35 seconds : ellipsoid_mesh --verify
[ PASSED ] : 297 seconds : ellipsoid_multiple_domain --verify
[ PASSED ] : 169 seconds : ellipsoid_multiple_domain_mesh --verify
[ PASSED ] : 5889 seconds : femur --verify
[ PASSED ] : 7203 seconds : femur --groom_images --verify
[ PASSED ] : 521 seconds : femur_mesh --verify
[ PASSED ] : 7879 seconds : femur_cut --verify
[ PASSED ] : 8087 seconds : femur_cut --groom_images --verify
[ PASSED ] : 2984 seconds : left_atrium --verify
[ PASSED ] : 3010 seconds : left_atrium --groom_images --verify
[ PASSED ] : 437 seconds : lumps --verify
[ PASSED ] : 1690 seconds : thin_cavity_bean --verify
[ PASSED ] : 28 seconds : supershapes_1mode_contour --verify

100.00% tests passed, 0 failed out of 40

Total Test time: 39113 seconds

akenmorris · 2021-11-13T17:36:18Z

Mac RC8:

Testing Results:

The following use cases passed (40)
[ PASSED ] : 48 seconds : ellipsoid --tiny_test
[ PASSED ] : 12 seconds : ellipsoid_mesh --tiny_test
[ PASSED ] : 26 seconds : ellipsoid_fd --tiny_test
[ PASSED ] : 15 seconds : ellipsoid_cut --tiny_test
[ PASSED ] : 12 seconds : lumps --tiny_test
[ PASSED ] : 39 seconds : left_atrium --tiny_test
[ PASSED ] : 67 seconds : femur --tiny_test
[ PASSED ] : 14 seconds : ellipsoid --tiny_test
[ PASSED ] : 10 seconds : ellipsoid_mesh --tiny_test
[ PASSED ] : 25 seconds : ellipsoid_fd --tiny_test
[ PASSED ] : 13 seconds : ellipsoid_cut --tiny_test
[ PASSED ] : 10 seconds : lumps --tiny_test
[ PASSED ] : 29 seconds : left_atrium --tiny_test
[ PASSED ] : 21 seconds : femur --tiny_test
[ PASSED ] : 74 seconds : femur --groom_images --tiny_test
[ PASSED ] : 36 seconds : femur_mesh --tiny_test
[ PASSED ] : 65 seconds : femur_cut --tiny_test
[ PASSED ] : 75 seconds : femur_cut --groom_images --tiny_test
[ PASSED ] : 97 seconds : deep_ssm --tiny_test
[ PASSED ] : 34 seconds : supershapes_1mode_contour --tiny_test
[ PASSED ] : 10 seconds : thin_cavity_bean --tiny_test
[ PASSED ] : 18 seconds : ellipsoid_multiple_domain --tiny_test
[ PASSED ] : 12 seconds : ellipsoid_multiple_domain_mesh --tiny_test
[ PASSED ] : 4 seconds : ellipsoid_pca --tiny_test
[ PASSED ] : 90 seconds : ellipsoid --verify
[ PASSED ] : 74 seconds : ellipsoid_cut --verify
[ PASSED ] : 25 seconds : ellipsoid_fd --verify
[ PASSED ] : 44 seconds : ellipsoid_mesh --verify
[ PASSED ] : 548 seconds : ellipsoid_multiple_domain --verify
[ PASSED ] : 346 seconds : ellipsoid_multiple_domain_mesh --verify
[ PASSED ] : 11130 seconds : femur --verify
[ PASSED ] : 11715 seconds : femur --groom_images --verify
[ PASSED ] : 887 seconds : femur_mesh --verify
[ PASSED ] : 11206 seconds : femur_cut --verify
[ PASSED ] : 12559 seconds : femur_cut --groom_images --verify
[ PASSED ] : 5284 seconds : left_atrium --verify
[ PASSED ] : 5331 seconds : left_atrium --groom_images --verify
[ PASSED ] : 797 seconds : lumps --verify
[ PASSED ] : 4609 seconds : thin_cavity_bean --verify
[ PASSED ] : 45 seconds : supershapes_1mode_contour --verify

100.00% tests passed, 0 failed out of 40

Total Test time: 65453 seconds

archanasri · 2021-11-13T18:20:38Z

I can test the notebooks on Mac

akenmorris · 2021-11-13T19:50:35Z

You might hold off testing notebooks until after #1580 is resolved. Fixing all the incompatible mess of versions we have of conda/pip packages may end up breaking things. The notebooks would be the most likely to break since they use these extremely brittle packages like pyvista.

archanasri · 2021-11-16T13:17:38Z

Mac RC9:

Testing Results:

The following use cases passed (40)
[ PASSED ] : 69 seconds : ellipsoid --tiny_test
[ PASSED ] : 31 seconds : ellipsoid_mesh --tiny_test
[ PASSED ] : 26 seconds : ellipsoid_fd --tiny_test
[ PASSED ] : 33 seconds : ellipsoid_cut --tiny_test
[ PASSED ] : 30 seconds : lumps --tiny_test
[ PASSED ] : 251 seconds : left_atrium --tiny_test
[ PASSED ] : 907 seconds : femur --tiny_test
[ PASSED ] : 32 seconds : ellipsoid --tiny_test
[ PASSED ] : 23 seconds : ellipsoid_mesh --tiny_test
[ PASSED ] : 19 seconds : ellipsoid_fd --tiny_test
[ PASSED ] : 25 seconds : ellipsoid_cut --tiny_test
[ PASSED ] : 14 seconds : lumps --tiny_test
[ PASSED ] : 44 seconds : left_atrium --tiny_test
[ PASSED ] : 40 seconds : femur --tiny_test
[ PASSED ] : 96 seconds : femur --groom_images --tiny_test
[ PASSED ] : 48 seconds : femur_mesh --tiny_test
[ PASSED ] : 949 seconds : femur_cut --tiny_test
[ PASSED ] : 102 seconds : femur_cut --groom_images --tiny_test
[ PASSED ] : 309 seconds : deep_ssm --tiny_test
[ PASSED ] : 36 seconds : supershapes_1mode_contour --tiny_test
[ PASSED ] : 25 seconds : thin_cavity_bean --tiny_test
[ PASSED ] : 31 seconds : ellipsoid_multiple_domain --tiny_test
[ PASSED ] : 27 seconds : ellipsoid_multiple_domain_mesh --tiny_test
[ PASSED ] : 3 seconds : ellipsoid_pca --tiny_test
[ PASSED ] : 78 seconds : ellipsoid --verify
[ PASSED ] : 80 seconds : ellipsoid_cut --verify
[ PASSED ] : 20 seconds : ellipsoid_fd --verify
[ PASSED ] : 41 seconds : ellipsoid_mesh --verify
[ PASSED ] : 556 seconds : ellipsoid_multiple_domain --verify
[ PASSED ] : 353 seconds : ellipsoid_multiple_domain_mesh --verify
[ PASSED ] : 11488 seconds : femur --verify
[ PASSED ] : 10850 seconds : femur --groom_images --verify
[ PASSED ] : 783 seconds : femur_mesh --verify
[ PASSED ] : 10748 seconds : femur_cut --verify
[ PASSED ] : 11377 seconds : femur_cut --groom_images --verify
[ PASSED ] : 8340 seconds : left_atrium --verify
[ PASSED ] : 5377 seconds : left_atrium --groom_images --verify
[ PASSED ] : 750 seconds : lumps --verify
[ PASSED ] : 5241 seconds : thin_cavity_bean --verify
[ PASSED ] : 34 seconds : supershapes_1mode_contour --verify

100.00% tests passed, 0 failed out of 40

Total Test time: 69289 seconds

akenmorris · 2021-11-16T15:28:41Z

RC9 on Linux:

Testing Results:

The following use cases passed (40)
[ PASSED ] : 48 seconds : ellipsoid --tiny_test
[ PASSED ] : 22 seconds : ellipsoid_mesh --tiny_test
[ PASSED ] : 73 seconds : ellipsoid_fd --tiny_test
[ PASSED ] : 35 seconds : ellipsoid_cut --tiny_test
[ PASSED ] : 29 seconds : lumps --tiny_test
[ PASSED ] : 54 seconds : left_atrium --tiny_test
[ PASSED ] : 35 seconds : femur --tiny_test
[ PASSED ] : 23 seconds : ellipsoid --tiny_test
[ PASSED ] : 17 seconds : ellipsoid_mesh --tiny_test
[ PASSED ] : 44 seconds : ellipsoid_fd --tiny_test
[ PASSED ] : 25 seconds : ellipsoid_cut --tiny_test
[ PASSED ] : 15 seconds : lumps --tiny_test
[ PASSED ] : 30 seconds : left_atrium --tiny_test
[ PASSED ] : 23 seconds : femur --tiny_test
[ PASSED ] : 100 seconds : femur --groom_images --tiny_test
[ PASSED ] : 16 seconds : femur_mesh --tiny_test
[ PASSED ] : 31 seconds : femur_cut --tiny_test
[ PASSED ] : 103 seconds : femur_cut --groom_images --tiny_test
[ PASSED ] : 66 seconds : deep_ssm --tiny_test
[ PASSED ] : 42 seconds : supershapes_1mode_contour --tiny_test
[ PASSED ] : 10 seconds : thin_cavity_bean --tiny_test
[ PASSED ] : 25 seconds : ellipsoid_multiple_domain --tiny_test
[ PASSED ] : 15 seconds : ellipsoid_multiple_domain_mesh --tiny_test
[ PASSED ] : 5 seconds : ellipsoid_pca --tiny_test
[ PASSED ] : 115 seconds : ellipsoid --verify
[ PASSED ] : 103 seconds : ellipsoid_cut --verify
[ PASSED ] : 39 seconds : ellipsoid_fd --verify
[ PASSED ] : 37 seconds : ellipsoid_mesh --verify
[ PASSED ] : 383 seconds : ellipsoid_multiple_domain --verify
[ PASSED ] : 241 seconds : ellipsoid_multiple_domain_mesh --verify
[ PASSED ] : 6726 seconds : femur --verify
[ PASSED ] : 6680 seconds : femur --groom_images --verify
[ PASSED ] : 493 seconds : femur_mesh --verify
[ PASSED ] : 6035 seconds : femur_cut --verify
[ PASSED ] : 6445 seconds : femur_cut --groom_images --verify
[ PASSED ] : 3444 seconds : left_atrium --verify
[ PASSED ] : 3145 seconds : left_atrium --groom_images --verify
[ PASSED ] : 471 seconds : lumps --verify
[ PASSED ] : 1729 seconds : thin_cavity_bean --verify
[ PASSED ] : 33 seconds : supershapes_1mode_contour --verify

100.00% tests passed, 0 failed out of 40

Total Test time: 37005 seconds

sheryjoe · 2021-11-22T01:26:19Z

6.2 has been released. Thanks everyone!

This comment has been minimized.

Sign in to view

akenmorris assigned cchriste, sheryjoe, iyerkrithika21, archanasri and jadie1 Oct 13, 2021

cchriste added the Status: QA/Testing Needed to ensure things keep working label Oct 15, 2021

cchriste assigned akenmorris, riddhishb, HeavenlyBerserker and patkins Oct 15, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ShapeWorks 6.2 Testing #1509

ShapeWorks 6.2 Testing #1509

akenmorris commented Oct 13, 2021 •

edited

This comment has been minimized.

patkins commented Oct 15, 2021

cchriste commented Oct 15, 2021

jadie1 commented Oct 21, 2021

akenmorris commented Oct 21, 2021

cchriste commented Oct 21, 2021

jadie1 commented Oct 21, 2021

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

iyerkrithika21 commented Oct 26, 2021

iyerkrithika21 commented Oct 26, 2021

akenmorris commented Oct 27, 2021

akenmorris commented Nov 5, 2021

akenmorris commented Nov 5, 2021

akenmorris commented Nov 5, 2021

akenmorris commented Nov 13, 2021

sheryjoe commented Nov 13, 2021 •

edited

akenmorris commented Nov 13, 2021

sheryjoe commented Nov 13, 2021

akenmorris commented Nov 13, 2021

akenmorris commented Nov 13, 2021

archanasri commented Nov 13, 2021

akenmorris commented Nov 13, 2021

archanasri commented Nov 16, 2021

akenmorris commented Nov 16, 2021

sheryjoe commented Nov 22, 2021

ShapeWorks 6.2 Testing #1509

ShapeWorks 6.2 Testing #1509

Comments

akenmorris commented Oct 13, 2021 • edited

This comment has been minimized.

patkins commented Oct 15, 2021

cchriste commented Oct 15, 2021

jadie1 commented Oct 21, 2021

akenmorris commented Oct 21, 2021

cchriste commented Oct 21, 2021

jadie1 commented Oct 21, 2021

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

iyerkrithika21 commented Oct 26, 2021

iyerkrithika21 commented Oct 26, 2021

akenmorris commented Oct 27, 2021

akenmorris commented Nov 5, 2021

akenmorris commented Nov 5, 2021

akenmorris commented Nov 5, 2021

akenmorris commented Nov 13, 2021

Testing Results:

sheryjoe commented Nov 13, 2021 • edited

akenmorris commented Nov 13, 2021

sheryjoe commented Nov 13, 2021

akenmorris commented Nov 13, 2021

Testing Results:

akenmorris commented Nov 13, 2021

Testing Results:

archanasri commented Nov 13, 2021

akenmorris commented Nov 13, 2021

archanasri commented Nov 16, 2021

Testing Results:

akenmorris commented Nov 16, 2021

Testing Results:

sheryjoe commented Nov 22, 2021

akenmorris commented Oct 13, 2021 •

edited

sheryjoe commented Nov 13, 2021 •

edited