Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

core_eia860m__changelog_generators contains NULL valid_until_date values #3614

Open
TrentonBush opened this issue May 6, 2024 · 0 comments
Labels
bug Things that are just plain broken.

Comments

@TrentonBush
Copy link
Member

Describe the bug

core_eia860m__changelog_generators contains 950+ NULL values in the valid_until_date column. I don't think they should exist because this column is derived from report_date and none of those are NULL. Most of the NULLs (700+) are from the last report_date in the series (currently 2023-12-01), but ~200 others exist throughout the time span of the data. Maybe it has to do with the last date in each generator's series?

Bug Severity

This table is encoded as a changelog between two dates -- valid_until_date specifies one of the boundaries. It is hard to interpret the data without that boundary.

To Reproduce

SELECT
    valid_until_date,
    count(*) as count
FROM core_eia860m__changelog_generators
GROUP BY 1
ORDER BY 1 desc

Software Environment?

in pudl.sqlite version v2024.2.6

@TrentonBush TrentonBush added the bug Things that are just plain broken. label May 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Things that are just plain broken.
Projects
Status: New
Development

No branches or pull requests

1 participant