Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Publish raw benchmark results #25

Open
flying-sheep opened this issue Apr 3, 2024 · 0 comments
Open

Publish raw benchmark results #25

flying-sheep opened this issue Apr 3, 2024 · 0 comments
Labels

Comments

@flying-sheep
Copy link
Member

flying-sheep commented Apr 3, 2024

One rather intricate solution is to make a website:

Each check run’s details tab has a link that reads “View more details on scverse-benchmark”. Without overriding it, it links to the GH app’s public URL, which currently goes nowhere useful.

We could make the official bot URL point to the website and override an individual run’s link using the details_url body parameter to link to subpage that provides a run’s JSON for download.


A simpler option would be to use the “update a check run” endpoint’s output.annotations[].raw_details, which can contain 64 kb of data and is rendered like this:

It wouldn’t be a great fit, as it’s attached to a certain file, but the only field that is explicitly for bigger data than a line or so.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant