Skip to content

Parallel process pool that throttles the task producer thread to avoid out-of-memory issues

License

Notifications You must be signed in to change notification settings

isarandi/throttledpool

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ThrottledPool

Parallel process pool that throttles the task producer thread to avoid out-of-memory issues.

Example usage

results = []
with throttledpool.ThrottledPool() as pool:
    for item in items:
        pool.apply_async(process_fn, (item, other_arg), kwargs=dict(a=1), callback=results.append)

About

Parallel process pool that throttles the task producer thread to avoid out-of-memory issues

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages