Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

spark-notebook does not shutdown all processes when dynamic allocation is switched on #934

Open
antonkulaga opened this issue Jan 2, 2018 · 1 comment
Open

spark-notebook does not shutdown all processes when dynamic allocation is switched on #934

antonkulaga opened this issue Jan 2, 2018 · 1 comment
Assignees
@antonkulaga
Labels
to investigate

Comments

@antonkulaga
Copy link
Contributor

When shutting down the notebook Spark-notebook does not shut down all apps related to the notebook when dynamic allocation is switched on the spark-standalone cluster.
To reproduce the bug - switch on dynamic allocation and external scheduling service on spark standalone cluster, give some tasks that will lead to several allocations per notebook and shutdown notebook inside spark-notebook UI
@andypetrella
Copy link
Collaborator

Good one!

As it is quite a task to reproduce, could you investigate what we could do?
That'd be super useful.

many thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@antonkulaga antonkulaga

Labels
to investigate
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@frbayart @andypetrella @antonkulaga