Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace ThreadPoolExecutor creation with ThreadUtils API [databricks] #10812

Merged

Conversation

razajafri
Copy link
Collaborator

This PR replaces the manual thread pool creation with the TrampolieUtil API which uses the org.apache.spark.util.ThreadUtils under the hood.

fixes #10759

@razajafri razajafri force-pushed the SP-10759-replace-threadpool-creation branch from daa6e35 to 54c9837 Compare May 14, 2024 02:04
@razajafri razajafri marked this pull request as ready for review May 14, 2024 18:24
@razajafri
Copy link
Collaborator Author

@jlowe I have addressed your concern. PTAL

@sameerz sameerz added task Work required that improves the product but is not user facing tech debt labels May 14, 2024
@jlowe
Copy link
Member

jlowe commented May 15, 2024

build

@jlowe jlowe merged commit a50adf4 into NVIDIA:branch-24.06 May 15, 2024
43 of 44 checks passed
@razajafri razajafri deleted the SP-10759-replace-threadpool-creation branch May 16, 2024 16:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
task Work required that improves the product but is not user facing tech debt
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Use Spark ThreadUtils to create thread pools
3 participants