Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(Non) Interop Score Line in the graph #3621

Open
karlcow opened this issue Dec 7, 2023 · 2 comments
Open

(Non) Interop Score Line in the graph #3621

karlcow opened this issue Dec 7, 2023 · 2 comments
Labels
interop Issues with the Interop dashboards

Comments

@karlcow
Copy link

karlcow commented Dec 7, 2023

It would be great to have a 4th line on the graph probably $COLOR color. which would be the equivalent of the interop score. That would represent the baseline.

The current graph represents tests that fail in 1 browser over 3.
I guess this confusing graph we discussed many representing failures more than success. The baseline would be the number of tests which are failing in every browsers. This is basically the base.

safari:fail firefox:fail chrome:fail

@foolip foolip added the interop Issues with the Interop dashboards label Dec 21, 2023
@stof
Copy link
Contributor

stof commented Feb 9, 2024

What is the goal of a line counting tests that fail in all browsers ?

Btw, saying that this is equivalent to the interop score is wrong. the interop score is about tests that pass in all browsers (and it is already displayed in the chart).

@karlcow
Copy link
Author

karlcow commented Feb 11, 2024

@stof it gives a better understanding of the minimal bar. The line of 3 fails shows the real common base. The line of 3 pass shows the start of real interop. The in between is where the real work is interesting.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
interop Issues with the Interop dashboards
Projects
None yet
Development

No branches or pull requests

3 participants