3.0.1

Added:

luigi

• Worker_timeout can be 0. #2968
• Return bq job id from biquery.run_job() #2957
• Documentation for check_complete_on_run config #2961

3.0.0

3.0.0

This is a major release without many feature changes compared to 2.8.13. The reason we decided to give it a major bump is the drop of Python2 support. From this version on, Luigi stops supporting Python2 for the obvious reason. 3.0.0 release includes a series of PRs deprecating Python2, plus a few other changes listed below. Special thanks go to @drowoseque for doing all the great work!

Added:

luigi

• Show task progress in visualizer workers tab. #2932

Fixed:

luigi

• Fix TravisCI build #2948
• Use is_alive in favour of isAlive for Python 3.9 compatibility. #2940

2.8.13

Added:

luigi.contrib

• Presto support in Luigi (#2885)

Fixed:

luigi

• removed wrong type of Target.init path arg from doc master (#2927)
• remove StreamingBodyAdaptor that didn't allow choosing the chunk size (#2929)
• Fix docs explaining write modes for Luigi Targets. Closes #2783 (#2931)
• All configuration parameters in docs now use underscore in their names for consistency. (#2890)

Changed:

luigi

• Allowed wider popovers in grapth. (#2093)
• update documentation to prefer pykube-ng (#2924)

2.8.12

Added:

luigi

• EnumListParameter #2801

Fixed:

luigi

• Import ABC from collections.abc instead of collections for Python 3.9 compatibility #2895

Changed:

luigi.contrib

• [luigi.contrib.hive] HiveTableTarget inherits HivePartitionTarget #2872
• [luigi.contrib.pyspark_runner] SparkSession support in PySparkTask #2862

3.0.0b2

This the second 3.0.0 beta release including a series of PRs deprecating Python2, plus following:

Special thanks go to @drowoseque for doing all the great work!

Added:

luigi

• Add internal version info #2760
• EnumListParameter #2801 (new since 3.0.0b1)

luigi.contrib

• [luigi.contrib.spark] pyspark python options added #2818

Fixed:

luigi

• Fix params hashing #2540
• Check for autoload_range istead of autoload-range
• autoload_range doc fix #2878 (new since 3.0.0b1)

Removed:

luigi

• [luigi.file] removed #2832
• [luigi.mock.MockFile] removed #2839

Changed:

luigi

• Allow python-daemon >= 2.2.0 if not on windows #2796
• Make URLLibFetcher aware of basic auth info in scheduler URL. #2791

luigi.contrib

• [luigi.contrib.external_program.ExternalProgramTask] logs_output_pattern_to_url provided #2822
• [luigi.contrib.hive] HiveTableTarget inherits HivePartitionTarget #2872 (new since 3.0.0b1)
• [luigi.contrib.pyspark_runner] SparkSession support in PySparkTask #2862 (new since 3.0.0b1)

2.8.11

Added:

luigi

• Add internal version info #2760

luigi.contrib

• [luigi.contrib.spark] pyspark python options added #2818

Fixed:

luigi

• Fix params hashing #2540
• Check for autoload_range istead of autoload-range
• autoload_range doc fix #2878

Removed:

luigi

• [luigi.file] removed #2832
• [luigi.mock.MockFile] removed #2839

Changed:

luigi

• Allow python-daemon >= 2.2.0 if not on windows #2796
• Make URLLibFetcher aware of basic auth info in scheduler URL. #2791

luigi.contrib

• [luigi.contrib.external_program.ExternalProgramTask] logs_output_pattern_to_url provided #2822

2.8.10

Added:

luigi

• Add HEAD endpoint to scheduler server for status/health checks #2789

luigi.contrib

• [luigi.contrib.hive] WarehouseHiveClient #2826

Fixed:

luigi.contrib

• Add Python version-agnostic get_writer_schema. #2827
• PySparkTask: handle special characters in name (#2778) #2779

Changed:

luigi.contrib

• [luigi.contrib.spark] tracking_url_pattern as a property #2820
• Add pod_creation_wait_interal #2813
• Added optional argument 'aws_session_token' to S3Client #2798

2.8.9

Added:

luigi

• Adds "Force Commit" button in UI to set tasks to DONE #2751
• Show task history link in visualizer when recording. #2759

Fixed:

luigi

• Replace documentation reference to outdated test environment py27-nonhdfs #2762
• Issue 2644: Tasks can be run several times under certain conditions #2645

luigi & luigi.contrib

• Ensure ignored tests are picked up by tox #2758

Changed:

luigi

• Update tornado requirement for new enough python versions #2761

luigi.contrib

• contrib/ftp: Clean up temporary files #2755

2.8.8

Added:

luigi

• Expandable Namespace Folders for the Visualiser Sidebar #2716
• Added new companies to the luigi users list: #2730 #2747

luigi.contrib

• Enable Overriding Poll Interval for Kubernetes Jobs #2724

Fixed:

luigi

• Code example correction #2754

Changed:

luigi

• Update release process #2727
• Change GET request to POST requests in luigi/rpc #2732
• Fix SendGrid email API documentation. #2745

2.8.7

Added:

luigi

• Add check_complete_on_run to optionally mark tasks as failed if complete() is false when run finishes (#2710)
• Add section "Running Luigi on Windows" to docs (#2720)
• Add Giphy to list of companies using Luigi to docs (#2713)

luigi.contrib

• Add DropboxTarget for luigi (#2696)

Fixed:

luigi

• UI: Fix time graph - y axis to account for timezones. (#2711)

Changed:

luigi

• Bump dependencies used by SendGrid integration. (#2715)
• Update copyright year in LICENSE (#2723)

luigi.contrib

• Make RedisTarget compatible with redis-py >= 3 (#2722)