Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

replace dateutil with fromisoformat in google backend #183

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

kmichel-aiven
Copy link
Collaborator

@kmichel-aiven kmichel-aiven commented May 1, 2024

About this change - What it does

replace dateutil with fromisoformat in google backend.

Why this way

dateutil.parser.parse is particularly slow and covers a lot of use cases that are not relevant to parsing RFC 3339 datetimes.

This was bad enough that rohmu could eat >50% of CPU while listing entries from Google object storage.

(The next high CPU user is json.decode, but that's still far behind dateutil and harder to fix since it's inside googleapiclient.)

dateutil_slow

dateutil.parser.parse is particularly slow and covers a lot of use cases
that are not relevant to parsing RFC 3339 datetimes.

This was bad enough that rohmu could eat 50% of CPU while listing
entries from Google object storage.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant