Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance runner #9

Open
ngryman opened this issue May 12, 2017 · 0 comments
Open

Performance runner #9

ngryman opened this issue May 12, 2017 · 0 comments

Comments

@ngryman
Copy link
Collaborator

ngryman commented May 12, 2017

0.3.0 will offer a way to integrate SR in a classic development workflow. The aim of this version is to provide an easy way to track any performance regression.

Snapshots

A new command will be introduced: test. It will act like the run command but for a different purpose: see if all races are as fast or faster than before.

In order to achieve this, we'll introduce the concept of snapshots for SR. Like test runners offering a snapshot feature, SR will create and save a report snapshot for each race on the first run. Subsequent runs will compare new reports with their snapshot and display appropriate results.

If the new report is as fast or faster, the test is considered as passed. If not, a diff will be displayed and the test command will return a non-zero error code.

Visual diff

The visual diff should be clear enough to highlight the parts where the run has been slower. Because reports are a DSL, we'll use an in-house diffing/display mechanism instead of a general purpose one (i.e. jest-snapshot).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant