Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide tools for analyzing a p2 aggregtor model's constituent parts #3

Open
merks opened this issue Jun 2, 2022 · 0 comments
Open

Comments

@merks
Copy link
Contributor

merks commented Jun 2, 2022

As you can see, I've repeatedly been force-pushing changes to this branch of my fork:

I've also set up this build (which uses a Jenkins file) for testing purposes:

It reuses JustJ's update site promoter to create the following two update sites:

The intent is to provide more regular builds with a more regular structure, including support for mirror URLs in the sites, without the use of various shell scripts for moving things around.

Functionally there is support a tool for analyzing and understanding the contributions (to SimRel), including a dependency graph like this one:

image

In addition significant improvements were made to the aggregator itself, not only performance improvements, but also producing *.xz files and computing modern checksum (sha-256) as needed when aggregating older content lacking those.

To demonstrate this, I "forked" the org.eclipse.simrel.build repository:

The pom.xml and Jenkins files are simplified and improved and are used in this proof-of-concept build:

Aggregation takes less than 7 minutes compared to the 50 or more minutes it currently uses:

The test result is published here:

https://download.eclipse.org/justj/?file=modeling/emf/emf/archive/staging/2022-06

merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 2, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 2, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 2, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 2, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 2, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 2, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 2, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 2, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 3, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 3, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 3, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 3, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 4, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 4, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 4, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 7, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 16, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 17, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 17, 2022
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 17, 2022
Refactor metadata repository representation to make it reusable in the
analzyer model's editor.

Provide better progress reporting on repository loading.

Do artifact mirroring in parallel. Compute sha-256 if those are missing.
Avoid saving the artifacts.jar repeatedly while mirroring. Produce also
the *.xz versions.

Do the verifications in parallel.

eclipse-cbi#3
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 18, 2022
Refactor metadata repository representation to make it reusable in the
analzyer model's editor.

Provide better progress reporting on repository loading.

Do artifact mirroring in parallel. Compute sha-256 if those are missing.
Avoid saving the artifacts.jar repeatedly while mirroring. Produce also
the *.xz versions.

Do the verifications in parallel.

Provide support for opening *.aggrcon which opens the corresponding
*.aggr and selects the contribution in that editor.

eclipse-cbi#3
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 18, 2022
Refactor metadata repository representation to make it reusable in the
analzyer model's editor.

Provide better progress reporting on repository loading.

Do artifact mirroring in parallel. Compute sha-256 if those are missing.
Avoid saving the artifacts.jar repeatedly while mirroring. Produce also
the *.xz versions.

Do the verifications in parallel.

Provide support for opening *.aggrcon which opens the corresponding
*.aggr and selects the contribution in that editor.

Support additional things such as expand all, collapse all, revert.
Eliminate child creation icons.

eclipse-cbi#3
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 18, 2022
Refactor metadata repository representation to make it reusable in the
analzyer model's editor.

Provide better progress reporting on repository loading.

Do artifact mirroring in parallel. Compute sha-256 if those are missing.
Avoid saving the artifacts.jar repeatedly while mirroring. Produce also
the *.xz versions.

Do the verifications in parallel.

Provide support for opening *.aggrcon which opens the corresponding
*.aggr and selects the contribution in that editor.

Support additional things such as expand all, collapse all, revert.
Eliminate child creation icons.

Mostly remove the bogus P2viewEditor.

eclipse-cbi#3
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 18, 2022
Refactor metadata repository representation to make it reusable in the
analzyer model's editor.

Provide better progress reporting on repository loading.

Do artifact mirroring in parallel. Compute sha-256 if those are missing.
Avoid saving the artifacts.jar repeatedly while mirroring. Produce also
the *.xz versions.

Do the verifications in parallel.

Provide support for opening *.aggrcon which opens the corresponding
*.aggr and selects the contribution in that editor.

Support additional things such as expand all, collapse all, revert.
Eliminate child creation icons.

Mostly remove the bogus P2viewEditor.

Fix the fix versions dialog to avoid NPE.

eclipse-cbi#3
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 19, 2022
Refactor metadata repository representation to make it reusable in the
analzyer model's editor.

Provide better progress reporting on repository loading.

Do artifact mirroring in parallel. Compute sha-256 if those are missing.
Avoid saving the artifacts.jar repeatedly while mirroring. Produce also
the *.xz versions.

Do the verifications in parallel.

Provide support for opening *.aggrcon which opens the corresponding
*.aggr and selects the contribution in that editor.

Support additional things such as expand all, collapse all, revert.
Eliminate child creation icons.

Mostly remove the bogus P2viewEditor.

Fix the fix versions dialog to avoid NPE.

Fix problems with random drag and drop not being able to set or compute
certain features while copying.

eclipse-cbi#3
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 19, 2022
Refactor metadata repository representation to make it reusable in the
analzyer model's editor.

Provide better progress reporting on repository loading.

Do artifact mirroring in parallel. Compute sha-256 if those are missing.
Avoid saving the artifacts.jar repeatedly while mirroring. Produce also
the *.xz versions.

Do the verifications in parallel.

Provide support for opening *.aggrcon which opens the corresponding
*.aggr and selects the contribution in that editor.

Support additional things such as expand all, collapse all, revert.
Eliminate child creation icons.

Mostly remove the bogus P2viewEditor.

Fix the fix versions dialog to avoid NPE.

Fix problems with random drag and drop not being able to set or compute
certain features while copying.

eclipse-cbi#3
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 19, 2022
Refactor metadata repository representation to make it reusable in the
analzyer model's editor.

Provide better progress reporting on repository loading.

Do artifact mirroring in parallel. Compute sha-256 if those are missing.
Avoid saving the artifacts.jar repeatedly while mirroring. Produce also
the *.xz versions.

Do the verifications in parallel.

Provide support for opening *.aggrcon which opens the corresponding
*.aggr and selects the contribution in that editor.

Support additional things such as expand all, collapse all, revert.
Eliminate child creation icons.

Mostly remove the bogus P2viewEditor.

Fix the fix versions dialog to avoid NPE.

Fix problems with random drag and drop not being able to set or compute
certain features while copying.

eclipse-cbi#3
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 19, 2022
Refactor metadata repository representation to make it reusable in the
analzyer model's editor.

Provide better progress reporting on repository loading.

Do artifact mirroring in parallel. Compute sha-256 if those are missing.
Avoid saving the artifacts.jar repeatedly while mirroring. Produce also
the *.xz versions.

Do the verifications in parallel.

Provide support for opening *.aggrcon which opens the corresponding
*.aggr and selects the contribution in that editor.

Support additional things such as expand all, collapse all, revert.
Eliminate child creation icons.

Mostly remove the bogus P2viewEditor.

Fix the fix versions dialog to avoid NPE.

Fix problems with random drag and drop not being able to set or compute
certain features while copying.

eclipse-cbi#3
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 20, 2022
Refactor metadata repository representation to make it reusable in the
analzyer model's editor.

Provide better progress reporting on repository loading.

Do artifact mirroring in parallel. Compute sha-256 if those are missing.
Avoid saving the artifacts.jar repeatedly while mirroring. Produce also
the *.xz versions.

Do the verifications in parallel.

Provide support for opening *.aggrcon which opens the corresponding
*.aggr and selects the contribution in that editor.

Support additional things such as expand all, collapse all, revert.
Eliminate child creation icons.

Mostly remove the bogus P2viewEditor.

Fix the fix versions dialog to avoid NPE.

Fix problems with random drag and drop not being able to set or compute
certain features while copying.

eclipse-cbi#3
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 20, 2022
Refactor metadata repository representation to make it reusable in the
analzyer model's editor.

Provide better progress reporting on repository loading.

Do artifact mirroring in parallel. Compute sha-256 if those are missing.
Avoid saving the artifacts.jar repeatedly while mirroring. Produce also
the *.xz versions.

Do the verifications in parallel.

Provide support for opening *.aggrcon which opens the corresponding
*.aggr and selects the contribution in that editor.

Support additional things such as expand all, collapse all, revert.
Eliminate child creation icons.

Mostly remove the bogus P2viewEditor.

Fix the fix versions dialog to avoid NPE.

Fix problems with random drag and drop not being able to set or compute
certain features while copying.

eclipse-cbi#3
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 20, 2022
Improve the build to use a Jenkins file and improve update site
publishing to reuse JustJ's update site management support.

Refactor metadata repository representation to make it reusable in the
analzyer model's editor.

Provide better progress reporting on repository loading.

Do artifact mirroring in parallel. Compute sha-256 if those are missing.
Avoid saving the artifacts.jar repeatedly while mirroring. Produce also
the *.xz versions.

Do the verifications in parallel.

Provide support for opening *.aggrcon which opens the corresponding
*.aggr and selects the contribution in that editor.

Support additional things such as expand all, collapse all, revert.
Eliminate child creation icons.

Mostly remove the bogus P2viewEditor.

Fix the fix versions dialog to avoid NPE.

Fix problems with random drag and drop not being able to set or compute
certain features while copying.

eclipse-cbi#3
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 20, 2022
Improve the build to use a Jenkins file and improve update site
publishing to reuse JustJ's update site management support.

Refactor metadata repository representation to make it reusable in the
analzyer model's editor.

Provide better progress reporting on repository loading.

Do artifact mirroring in parallel. Compute sha-256 if those are missing.
Avoid saving the artifacts.jar repeatedly while mirroring. Produce also
the *.xz versions.

Do the verifications in parallel.

Provide support for opening *.aggrcon which opens the corresponding
*.aggr and selects the contribution in that editor.

Support additional things such as expand all, collapse all, revert.
Eliminate child creation icons.

Mostly remove the bogus P2viewEditor.

Fix the fix versions dialog to avoid NPE.

Fix problems with random drag and drop not being able to set or compute
certain features while copying.

eclipse-cbi#3
merks added a commit to merks/p2repo-aggregator that referenced this issue Jun 20, 2022
Improve the build to use a Jenkins file and improve update site
publishing to reuse JustJ's update site management support.

Refactor metadata repository representation to make it reusable in the
analyzer model's editor.

Provide better progress reporting on repository loading.

Do artifact mirroring in parallel. Compute sha-256 if those are missing.
Avoid saving the artifacts.jar repeatedly while mirroring. Produce also
the *.xz versions.

Do the verifications in parallel.

Provide support for opening *.aggrcon which opens the corresponding
*.aggr and selects the contribution in that editor.

Support additional things such as expand all, collapse all, and revert.
Eliminate child creation icons.

Mostly remove the bogus P2viewEditor and related artifacts.

Fix the fix versions dialog to avoid NPE.

Fix problems with random drag and drop not being able to set or compute
certain features while copying.

eclipse-cbi#3
merks added a commit that referenced this issue Jun 20, 2022
…#4)

Improve the build to use a Jenkins file and improve update site
publishing to reuse JustJ's update site management support.

Refactor metadata repository representation to make it reusable in the
analyzer model's editor.

Provide better progress reporting on repository loading.

Do artifact mirroring in parallel. Compute sha-256 if those are missing.
Avoid saving the artifacts.jar repeatedly while mirroring. Produce also
the *.xz versions.

Do the verifications in parallel.

Provide support for opening *.aggrcon which opens the corresponding
*.aggr and selects the contribution in that editor.

Support additional things such as expand all, collapse all, and revert.
Eliminate child creation icons.

Mostly remove the bogus P2viewEditor and related artifacts.

Fix the fix versions dialog to avoid NPE.

Fix problems with random drag and drop not being able to set or compute
certain features while copying.

#3
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant