Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Waiting for gpu state to dss list #89

Open
misohu opened this issue Apr 23, 2024 · 1 comment
Open

Add Waiting for gpu state to dss list #89

misohu opened this issue Apr 23, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@misohu
Copy link
Member

misohu commented Apr 23, 2024

Why it needs to get done

In kubernetes is not possible to share a single GPU between pods. because of these when we try to create two gpu backed notebooks the latter one will go to Pending state with status of Insufficient resources .... There can be only one active Pod at a time using the single GPU in the computer.

Because of this we want to introduce a state Waiting for gpu in dss list. To recover from this state user can stop the notebook currently using the GPU. This will cause that the next notebook will get the gpu assigned.

What needs to get done

Add Waiting for gpu state to dss list which indicates that the notebook is trying to allocate gpu resource but there are currently no available.

When is the task considered done

dss list is supporting this state

@misohu misohu added the enhancement New feature or request label Apr 23, 2024
Copy link

Thank you for reporting us your feedback!

The internal ticket has been created: https://warthogs.atlassian.net/browse/KF-5603.

This message was autogenerated

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant