Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What should we benchmark? #263

Open
ccbaumler opened this issue Dec 20, 2022 · 1 comment
Open

What should we benchmark? #263

ccbaumler opened this issue Dec 20, 2022 · 1 comment

Comments

@ccbaumler
Copy link

Following the same process as sourmash-bio/sourmash#2410, we will benchmark the genome-grist workflow with a combination of the six sequences listed in the sourmash-bio/sourmash#2410. My instinct is to:

  1. Run each sequences alone
  2. Run a variety of sequences from small to large sets
  3. Run the all six together

We could also include benchmarking different databases across the steps above.

@ctb
Copy link
Member

ctb commented Dec 21, 2022

I don't think that genome-grist has any individually expensive steps or computationally complex scripts that are part of it; it's just the workflow overall that involves an awful lot of steps, much like charcoal. That may change your benchmarking strategy.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants