Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spark jobs priority with Chronos #875

Open
DatPhanTien opened this issue Jun 20, 2018 · 0 comments
Open

Spark jobs priority with Chronos #875

DatPhanTien opened this issue Jun 20, 2018 · 0 comments

Comments

@DatPhanTien
Copy link

Dear,

We are interesting in running Spark jobs using Chronos.
There are two type of Spark jobs in our cluster.

  1. Batch jobs that have high workload but do not require fast response.
  2. Interactive jobs, that are triggered from user side, which have strict response time requirement (order of seconds or less).

We would like to know whether it is possible to put priority for such jobs, so that the interactive jobs have higher priority? Once the interactive jobs are triggered, batch jobs are supposed to quickly free resources (e.g., by getting killed) so that the interactive jobs can have the maximum resources allocated in order to meet the response time requirement.

So far, we could not find any documentation about Chronos that mentions this.
Could you please enlighten us.

Best

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant