3.5.0

What's Changed

• worker: Log which outputs are missing when task is unexpectedly incomplete by @progval in #3258
• Update dropbox.py for compatibility with Dropbox SDK v11.X.X by @smrohrer in #3259
• Add python 3.11 support by @ukky17 in #3265
• Migrate readthedocs to version 2 by @pablocasares in #3269
• Added Veridas to companies using Luigi by @ironbar in #3268
• Release 3.5.0 by @RRap0so in #3274

New Contributors

• @smrohrer made their first contribution in #3259
• @ukky17 made their first contribution in #3265
• @pablocasares made their first contribution in #3269
• @ironbar made their first contribution in #3268

Full Changelog: 3.4.0...3.5.0

3.4.0

What's Changed

Added

• Add CodeQL workflow by @jorgectf in #3244

Fixed

• Fix compatibility with cythonized tasks. by @MichaelGrupp in #3246
• fix flake8 error in master by @dlstadther in #3248
• Do not escape
  tags in task tooltips, so that the line breaks are… by @ewallace-RI in #3250
• Silence false positive UnconsumedParameterWarning by @starhel in #3235
• Fix pymssql import by @grihabor in #3252

Full Changelog: 3.3.0...3.4.0

3.3.0

Added

• Add host_config_options to allow configuration of DockerTask for GPU resources #3234

Fixed

• Fix bigquery retry #3238
• Fix for applying logging configurations using the a TOML configuration file #3237

3.2.1

Fixed

luigi

• Fix XSS vulnerability #3230
• Fix typo in range_test.py #3228
• Using default_scheduler_url as a mounting point for not root pat… #3216
• Deduplicate outputs in luigi.task.flatten_output (#3106) #3174

3.2.0

Added

luigi

• Improve control over dynamic requirements #3179
• Can pass a JSON schema to DictParameter and ListParameter #3217
• support Python 3.10 #3140

Fixed

luigi

• Update random seed for python 3.11 compatibility #3204
• Fix md5 hash error for FIPS in python 3.9 #3209
• Catch io.UnsupportedOperation exception #3215
• Fix schema validation and add custom validators #3220

3.1.1

3.1.1

Added

luigi

• Add worker config to cache task completion results. (#3178)

Fixed

luigi

• Close requests.Socket in RemoteScheduler before exiting (#3173) (#3175)
• Use int-parameters for random.randrange() (#3177)
• Alternate (probably more correct) fix for #3182 (supercedes #3183) #3185

3.1.0

3.1.0

Added

luigi

• Documentation guidance around release version increments #3074
• Add support for naming tasks in @requires #3077
• Add traceback_max_length parameter for error email notifications #3086
• Document cause of Unfulfilled dependency error #3105
• Add additional OptionalParameter datatype options #3079
• UI: Add rerun command snippet on "show error" modal #3117
• Add support for updating default config parser after loading luigi #3135
• Allow batch_email.email_interval to be set in config as email-internal-minutes #3125
• Allow TimeDeltaParameter to accept input as "seconds" #3125
• Add EnumListParameter to top-level attribute imports #3144
• Enable metrics_custom_import for MetricCollectors #3146
• Improve warning when a parameter is not consumed by a task #3170

luigi.contrib

• Add configure_job BigQuery property #3098
• Add parquet support to BigQuery #3099
• Add network retry logic to BigQuery #3088
• Add run_task_kwargs property to ECS #3083
• Add pickle_protocol attribute and configuration option to Spark #3001
• Add pg8000 driver support to Postgres #3142

Fixed

luigi

• Fix default value for task.disable_window #3081
• Fix deconstructor of LocalTarget when is_tmp attribute dne #3085
• Improved documentation reference to luigi.format.Nop import #3047
• Fix Python 3.10 deprecation warnings #3150
• Remove unnecessary extra call to cls.get_task_namespace() #3129
• Fix documentation typo in notifications_test.py #3151
• Fix docs ci #3158
• Fix task history rendering #3153
• Move max_shown_tasks and max_graph_nodes documentation to correct section #3156
• Fix ability to subclass Task's Register metaclass #3154
• Replace legacy TravicCI readme badge with GithubActions #3159

luigi.contrib

• Fix apache ci
  • #3091
  • #3113
• Fix documentation typo in sqla #3110
• Fix spark cluster mode error for missing path #3111
• Fix connection object passed to rdbms.CopyToTable's _add_metadata_columns() #3011

Removed

luigi

• Remove @Tarrasch from codeowners #3127

Changed

luigi

• Update license copyright year #3108
• Improve error message on parsing default parameter value #3115
• Group tasks by task class in svg graph #3122
• Upgrade tenacity version #3147
• Enable task search to be case insensitive #3157

luigi.contrib

• Update ExternalPythonProgramTask parameters to OptionalParameter #3130
• Allow newer versions of prometheus-client package #3163

3.0.3

Added:

luigi

• Adding retry on _obj_exists #3022
• don't use absolute path in redirect for visualizer #2785

luigi.contrib

• kubernetes: labels are applied to pod #3007

Fixed:

luigi

• Flush stream_for_searching_tracking_url #3000

luigi.contrib

• Fix azureblob tests: use json instead of numpy #3032

Changed:

luigi

• replace naive retry with tenacity #3026

3.0.2

3.0.2

Fixed:

luigi

• Garbage collect task result queue when worker context exits #2973
• Fixing problem with ListParameter and Dynamic Dependencies #2970

Changed:

luigi

• Drop Python 3.3 and 3.4 support #2978

luigi.contrib

• Use updated uri for gcs batch reqs #2998

3.0.1

Added:

luigi

• Worker_timeout can be 0. #2968
• Return bq job id from biquery.run_job() #2957
• Documentation for check_complete_on_run config #2961