Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: output of do_preprocess saved in the wrong order of files #1086

Merged
merged 2 commits into from
Apr 26, 2024
Merged

fix: output of do_preprocess saved in the wrong order of files #1086

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
2008d5f
fix wrong order in file saving
ikrommyd Apr 25, 2024
b248249
Merge branch 'master' into fix-do-preprocess
lgray Apr 25, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
6 changes: 3 additions & 3 deletions src/coffea/dataset_tools/dataset_query.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -556,11 +556,11 @@ def do_preprocess(
)
with gzip.open(f"{output_file}_available.json.gz", "wt") as file:
print(f"Saved available fileset chunks to {output_file}_available.json.gz")
json.dump(self.preprocessed_total, file, indent=2)
json.dump(self.preprocessed_available, file, indent=2)
with gzip.open(f"{output_file}_all.json.gz", "wt") as file:
print(f"Saved all fileset chunks to {output_file}_all.json.gz")
json.dump(self.preprocessed_available, file, indent=2)
return self.preprocessed_total, self.preprocessed_available
json.dump(self.preprocessed_total, file, indent=2)
return self.preprocessed_available, self.preprocessed_total

def load_dataset_definition(
self,
Expand Down