Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Python3.12 #3266

Merged
merged 8 commits into from May 9, 2024
Merged

Support Python3.12 #3266

merged 8 commits into from May 9, 2024

Conversation

ukky17
Copy link
Contributor

@ukky17 ukky17 commented Dec 20, 2023

Description

Motivation and Context

Support Python 3.12

Have you tested this? If so, how?

All CI tests have passed.

@ukky17 ukky17 marked this pull request as ready for review December 20, 2023 13:27
@ukky17 ukky17 requested review from dlstadther and a team as code owners December 20, 2023 13:27
Copy link
Collaborator

@dlstadther dlstadther left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not a fan of skipping the 1 boto unit test for the 3.12 version. The correct thing would be to ensure that the s3 module is 3.12 ready by replacing boto usage with boto3 equivalent functionality.

@@ -107,6 +108,7 @@ def test_read_no_file_sse(self):
t = self.create_target(encrypt_key=True)
self.assertRaises(FileNotFoundException, t.open)

@unittest.skipIf(tuple(sys.version_info) >= (3, 12), "boto is not supported on Python 3.12+")
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the better thing to do here would be to make the s3 module compatible with boto3

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can the s3 module be improved in another PR? Ubuntu 24 came out with Python 3.12 as default, and the lack of support in Luigi will block updates for many users (although fortunately, the changes only affect tests, so it's not critical).

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Given the need for 3.12 Luigi support, i'm ok getting this PR out the door.

@ukky17 , if you can resolve the merge conflict, i can merge if tests still pass.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dlstadther I have resolved the conflict. Please review again and merge if it looks good to you.

@dlstadther dlstadther merged commit b87e686 into spotify:master May 9, 2024
48 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants