CHANGES.md

CHANGES

2.1.23 (2023-12-16) commits

Bugfix

• Fix catching out of memory errors when executing broadcast tasks.

2.1.22 (2023-12-16) commits

Bugfix

• Fix logging memory errors and treat BrokenPipeError as mem error.

2.1.21 (2023-12-15) commits

Bugfix

• Log memory errors when to debug level.

2.1.20 (2023-12-14) commits

Bugfix

• Silently exit child worker(s) when parent process missing.

2.1.19 (2023-11-11) commits

Bugfix

• Prevent lost tasks when OOM kills parent worker process, improvement.

2.1.18 (2023-11-11) commits

Bugfix

• Prevent lost tasks when OOM kills parent worker process.

2.1.17 (2023-11-10) commits

Bugfix

• Fix typo.

2.1.16 (2023-11-10) commits

Bugfix

• Fix function decorator callbacks after_worker_started, etc.

2.1.15 (2023-11-10) commits

Bugfix

• Unsubscribe from pubsub while worker processes are waiting to exit.

2.1.14 (2023-11-09) commits

Bugfix

• Add missing wrapped log.handlers property.

2.1.13 (2023-11-09) commits

Misc

• Ignore logging errors.

2.1.12 (2023-11-09) commits

Bugfix

• Only refork crashed workers once per wait_timeout.

2.1.11 (2023-11-09) commits

Bugfix

• Postpone forking workers at startup if until ram usage below max threshold.

2.1.10 (2023-11-09) commits

Bugfix

• Postpone forking missing child workers while using too much RAM.

2.1.9 (2023-11-08) commits

Bugfix

• Prevent UnboundLocalError from using task_name var before assignment.

2.1.8 (2023-11-08) commits

Bugfix

• Prevent ValueError when unpacking invalid message from child process.

2.1.7 (2023-11-08) commits

Bugfix

• Prevent ValueError if no worker processes spawned when checking max mem usage.

2.1.6 (2023-10-11) commits

Misc

• Log time task took until exited when killed because max_mem_percent reached.

2.1.5 (2023-10-11) commits

Bugfix

• Prevent reset max_mem_reached_at when unrelated child process exits.

2.1.4 (2023-10-11) commits

Misc

• Less noisy logs when max_mem_percent reached.
• Allow restarting child worker processes more than once per soft timeout.

2.1.3 (2023-10-11) commits

Bugfix

• Wait for child worker to finish processing current task when max_mem_percent reached.

2.1.2 (2023-10-09) commits

Misc

• Log mem usage and current task when max_mem_percent threshold reached.

2.1.1 (2023-10-09) commits

Bugfix

• Fix setting max_mem_percent on WakaQ.

2.1.0 (2023-09-22) commits

Feature

• Include number of workers connected when inspecting queues.
• Log queue params on startup.

Misc

• Improve docs in readme.

2.0.2 (2022-12-09) commits

Bugfix

• Make sure to catch system exceptions to prevent worker infinite loops.

2.0.1 (2022-12-09) commits

Bugfix

• Always catch SoftTimeout even when nested in exception context.

2.0.0 (2022-11-18) commits

Feature

• Support bytes in task arguments.

Misc

• Tasks always receive datetimes in UTC without tzinfo.

1.3.0 (2022-10-05) commits

Feature

• Add username, password, and db redis connection options. #6

1.2.1 (2022-09-20) commits

Bugfix

• Prevent reading from Redis when no queues defined.

Misc

• Improve error message when app path not WakaQ instance.

1.2.0 (2022-09-17) commits

Feature

• Util functions to peek at tasks in queues.

1.1.8 (2022-09-15) commits

Bugfix

• Ignore SoftTimeout in child when not processing any task.

1.1.7 (2022-09-15) commits

Bugfix

• Allow custom timeouts defined on task decorator.

1.1.6 (2022-09-15) commits

Bugfix

• All timeouts should accept timedelta or int seconds.

1.1.5 (2022-09-15) commits

Bugfix

• Fix typo.

1.1.4 (2022-09-15) commits

Bugfix

• Fix setting task and queue on child from ping.

1.1.3 (2022-09-15) commits

Bugfix

• Fix sending task and queue to parent process.

1.1.2 (2022-09-14) commits

Bugfix

• Fix getattr.

1.1.1 (2022-09-14) commits

Bugfix

• Add missing child timeout class attributes.

1.1.0 (2022-09-14) commits

Feature

• Ability to overwrite timeouts per task or queue.

1.0.6 (2022-09-08) commits

Bugfix

• Prevent unknown task crashing worker process.

1.0.5 (2022-09-08) commits

Bugfix

• Make sure logging has current task set.

1.0.4 (2022-09-07) commits

Bugfix

• Fix auto retrying tasks on soft timeout.

1.0.3 (2022-09-07) commits

Bugfix

• Ignore SoftTimeout when waiting on BLPOP from Redis list.

1.0.2 (2022-09-05) commits

Bugfix

• Ping parent before blocking dequeue in case wait timeout is near soft timeout.

1.0.1 (2022-09-05) commits

Bugfix

• All logger vars should be strings.

1.0.0 (2022-09-05) commits

• First major release.

0.0.11 (2022-09-05) commits

Feature

• Add task payload to logger variables.

0.0.10 (2022-09-05) commits

Bugfix

• Prevent logging error from crashing parent process.

0.0.9 (2022-09-05) commits

Bugfix

• Prevent parent process looping forever while stopping children.

0.0.8 (2022-09-05) commits

Bugfix

• Prevent parent process crash leaving zombie child processes.

0.0.7 (2022-09-05) commits

Feature

• Ability to retry tasks when they soft timeout.

Bugfix

• Ping parent process at start of task to make sure soft timeout timer is reset.

0.0.6 (2022-09-03) commits

Feature

• Implement exclude_queues option.

Bugfix

• Prevent parent process crash if write to child broadcast pipe fails.

0.0.5 (2022-09-01) commits

Bugfix

• Run broadcast tasks once per worker instead of randomly.

0.0.4 (2022-09-01) commits

Feature

• Allow defining schedules as tuple of cron and task name, without args.

0.0.3 (2022-09-01) commits

Bugfix

• Prevent worker process crashing on any exception.

Feature

• Ability to wrap tasks with custom dectorator function.

0.0.2 (2022-09-01) commits

Breaking

• Run in foreground by default.
• Separate log files and levels for worker and scheduler.
• Decorators for after worker started, before task, and after task callbacks.

Bufix

• Keep processing tasks after SoftTimeout.
• Scheduler should sleep until scheduled time.

0.0.1 (2022-08-30)

• Initial release.