Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adapt deepBGC to use GPUs #326

Open
Darcy220606 opened this issue Dec 19, 2023 · 4 comments
Open

Adapt deepBGC to use GPUs #326

Darcy220606 opened this issue Dec 19, 2023 · 4 comments
Labels
enhancement Improvement for existing functionality

Comments

@Darcy220606
Copy link
Contributor

Description of feature

Adapt deepBGC to use GPU, at the moment it uses CPU and for large input datasets takes ages to run.

@Darcy220606 Darcy220606 added the enhancement Improvement for existing functionality label Dec 19, 2023
@Darcy220606 Darcy220606 self-assigned this Jan 31, 2024
@jfy133
Copy link
Member

jfy133 commented Feb 9, 2024

I don't think we will be able to do this for 1.2, because of having to re-building the container or something along those lines? @Darcy220606 thoughts?

@Darcy220606
Copy link
Contributor Author

@jfy133 i was told once that we can assign a single process in the pipeline to use GPUs, in the configuration file somewhere here

process {
  withLabel:process_low {
    cpus = { check_max( 2 * task.attempt, 'cpus' ) }
    memory = { check_max( 14.GB * task.attempt, 'memory' ) }
    time = { check_max( 6.h * task.attempt, 'time' ) }
  }

@jfy133
Copy link
Member

jfy133 commented Feb 9, 2024

Hmm. Ok.. but I thought the tool has to be compiled for the particular GPU yo be used? I'm speaking completely naively though... Never had to dealt with it before myself

@jfy133
Copy link
Member

jfy133 commented Feb 9, 2024

Looking at deepBGC repo maybe I'm talking out of my butt...

I have a feeling though, if you are right it's about specifying this in a config file, that would imply you just send it to a node with a GPU? This would then be specific to particular clusters and thus not generally applicable within the code itself? 🤔

/Stream of consciousness

@Darcy220606 Darcy220606 removed their assignment Feb 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Improvement for existing functionality
Projects
None yet
Development

No branches or pull requests

2 participants