Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add egfr_extended codegen and simulation to benchmarks #527

Open
wants to merge 12 commits into
base: master
Choose a base branch
from

Conversation

jmuhlich
Copy link
Member

This lets us track codegen and simulation performance separately. Also:

  • Switch from setup to setup_cache to reduce setup overhead.
  • Remove Earm10 test with empty cython_directives since it's broken
    after a previous refactoring and is about to be obviated by an upcoming
    improvement in ScipyOdeSimulator.

@codecov-io
Copy link

codecov-io commented Dec 18, 2020

Codecov Report

Merging #527 (3717bd9) into master (65a4b8d) will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #527   +/-   ##
=======================================
  Coverage   80.29%   80.29%           
=======================================
  Files         101      101           
  Lines       10680    10680           
=======================================
  Hits         8576     8576           
  Misses       2104     2104           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 65a4b8d...3717bd9. Read the comment docs.

@jmuhlich jmuhlich changed the title Split simulator egfr benchmark into codegen and run Add egfr_extended codegen and simulation to benchmarks Jan 5, 2021
@jmuhlich
Copy link
Member Author

jmuhlich commented Jan 5, 2021

Sorry, I just realized the egfr_extended codegen and simulation benchmarks that this PR introduces are completely new. I created this branch by cherry-picking some commits from another branch where I'd introduced a combined egfr_extended simulator benchmark, and it was so long ago that I forgot that benchmark was only on that branch!

@jmuhlich
Copy link
Member Author

jmuhlich commented Jan 5, 2021

I edited the PR title to make more sense in light of this revelation.

* Move python version window up to only currently-supported versions.
* Specify extra dependencies in matrix req rather than a conda env.
* Add OMP_NUM_THREADS=1 to the env to avoid useless BLAS threading.
Copy link
Member

@alubbock alubbock left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ran into a couple of issues getting asv run to work with these changes; see inline comments

// "six": ["", null], // test with and without six installed
// "pip+emcee": [""], // emcee is only available for install with pip.
// },
"matrix": {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can't find this format for matrix documented anywhere, and asv run gives me the error TypeError: sequence item 1: expected str instance, dict found. The required format seems to match what's commented out above. Am I missing something?

"python-dateutil": "2.8.1",
"cython": "0.29.21",
"alubbock::bionetgen": "2.5.1",
"alubbock::cupsoda": "v1.1_986c895"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CupSODA is not available as an Anaconda package for Mac (Macs haven't had NVIDIA GPUs for a while now, and although an eGPU might work, I haven't had access to one to try it). There doesn't seem to be a way to specify a package for specific platforms either, unfortunately. Maybe we should just leave a comment for Mac users to comment this line out, unless there's a better solution?

@codecov-commenter
Copy link

Codecov Report

Merging #527 (a8b07fe) into master (b5b7d40) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #527   +/-   ##
=======================================
  Coverage   80.16%   80.16%           
=======================================
  Files         100      100           
  Lines       10650    10650           
=======================================
  Hits         8538     8538           
  Misses       2112     2112           

📣 Codecov can now indicate which changes are the most critical in Pull Requests. Learn more

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants