Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Add datetime string substitutions to prefix field #942

Open
asher-goldberg opened this issue Apr 8, 2024 · 0 comments
Open

[FEATURE] Add datetime string substitutions to prefix field #942

asher-goldberg opened this issue Apr 8, 2024 · 0 comments
Labels
type/feature Indicates new functionality

Comments

@asher-goldberg
Copy link

Is your feature request related to a problem? Please describe.
Now that the new partitioner doesn't add a datetime based prefix to the file it would be useful if we could provide the date/time as part of the prefix while using partitioner: topic through placeholders.

Describe the solution you'd like
Something like being able to specify %Y-%M-%D in the prefix field of the config and have the writer substitute those placeholders for the actual date values (doesn't have to be those exact placeholders but thats the idea)

Describe alternatives you've considered
The alternative is to continue using the legacy partitioner along with the time settings but it seems like the legacy partitioner is eventually going to be deprecated so we figured this was more future-proof.

Additional context
Add any other context or screenshots about the feature request here.

@asher-goldberg asher-goldberg added the type/feature Indicates new functionality label Apr 8, 2024
@asher-goldberg asher-goldberg changed the title [FEATURE] Allow datetime string substitutions in prefix field [FEATURE] Add datetime string substitutions to prefix field Apr 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/feature Indicates new functionality
Projects
None yet
Development

No branches or pull requests

1 participant