You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
My dataset contains 28k rows. I tried writing this to Parquet with num_rows_per_file=700. I expected several Parquet files each with 700 rows, but instead got a single file with all the rows.
Medium: It is a significant difficulty but I can work around it.
The text was updated successfully, but these errors were encountered:
bveeramani
added
bug
Something that is supposed to be working; but isn't
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
data
Ray Data-related issues
labels
May 16, 2024
What happened + What you expected to happen
My dataset contains 28k rows. I tried writing this to Parquet with
num_rows_per_file=700
. I expected several Parquet files each with 700 rows, but instead got a single file with all the rows.Versions / Dependencies
4d37e55
Reproduction script
Issue Severity
Medium: It is a significant difficulty but I can work around it.
The text was updated successfully, but these errors were encountered: