Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GPU availability check before deployment #269

Open
burnpiro opened this issue Jan 15, 2024 · 2 comments
Open

GPU availability check before deployment #269

burnpiro opened this issue Jan 15, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@burnpiro
Copy link

Is your feature request related to a problem? Please describe.
When I want to deploy the pod in the specific location I cannot get information about availability in that location. Current gpu_query allows only to specify gpu_id and gpu_count to get the list of GPUs.

Describe the solution you'd like
I would like to be able to send a get request to check if there is a GPU with given parameters (the same as I latter provide to create_pod()).

Describe alternatives you've considered
Maybe an external API to request data from (beside python lib)?

Additional context
None

@burnpiro burnpiro added the enhancement New feature or request label Jan 15, 2024
@justinmerrell
Copy link
Member

I can add a general availability check; however, this would not help when the GPU becomes unavailable between checking and creating the pod. Is that what you are looking for?

@dvejmz
Copy link

dvejmz commented Mar 29, 2024

I've just raised #307 to retrieve the machine information necessary from the runpod GraphQL API to enable this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants