Skip to content
This repository has been archived by the owner on Apr 13, 2021. It is now read-only.

mvn install giving me IllegalStateException due to higher percentage of invalid records #9

Open
riaz opened this issue May 1, 2020 · 3 comments

Comments

@riaz
Copy link

riaz commented May 1, 2020

$mvn clean install

[WARNING]
java.lang.IllegalStateException: Percentage of Invalid Record 7.26158 did not meet the threshold 5.00000
at com.yahoo.covid19.database.DatabaseBuilder.validateDbRecordCount(DatabaseBuilder.java:436)
at com.yahoo.covid19.database.DatabaseBuilder.build(DatabaseBuilder.java:283)
at com.yahoo.covid19.database.DataFetcher.fetchDataAndProcess(DataFetcher.java:46)
at com.yahoo.covid19.database.DatabaseBuilder.main(DatabaseBuilder.java:496)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:282)
at java.lang.Thread.run(Thread.java:748)

@aklish
Copy link
Member

aklish commented May 1, 2020

Our build fails if the data quality drops below some threshold.

From the data repo:
this is probably due to zipcode and UK boroughs being included
"I am not sure how you determine validity zipcodes have no wikiId
region type for zipcode is “PostalZip” for boroughs it is “TertiaryAdminArea”

We are looking into it.

@aklish
Copy link
Member

aklish commented May 1, 2020

You can bump the threshold until we fix the DQ checks or the data.

@riaz
Copy link
Author

riaz commented May 1, 2020

ok cool, thank you for letting me know

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants