[feature request] compare between two or more selected experiment

[gongbudaizhe]

As a user, we want to compare, for example, the captured output or the configurations, between two or more selected experiments.

[chovanecm]

Hi, could you please specify the idea in more detail?
Is a side-by-side view something you are looking for? Perhaps with colored differences between them?

[gongbudaizhe]

Hi, the idea goes like this:

1. We need a mechanism for adding experiments to "comparison cart" which is something like "shopping cart" in online shoping store.
2. We need a button to start comparison, just like "paying for your shopping cart".
3. We need a panel for displaying the differences between all these selected experiments. This may take most of the coding effort. Several options are available to achieve this:

• option 1: All the selected experiments remain in the main panel while others are filtered out. Now the user manually compares selected experiments by navigating the configurations or captured output. This will be the easiest to implement since all need to done is just add a new filtering utility where runs are filtered by user selection instead of run configurations.
• option 2: First, convert configurations and captured output into text format(maybe convert configurations to json format?). Then text comparison should suffice which highlight differences like insertions, deletions and substitutions. vimdiff stands out as a good example. Check this for a example

4. finally, we want a way to exit comparison.