Skip to content

AbbasElHachem/qcpcp

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

qcpcp (qcp2): quality control of precipitation observations

Space-Time Statistical Quality Control of Extreme Precipitation Observation

Goal:

  1. Transform data using Box-Cox transormation with suitable parameter (example code 1)
  2. Find outlier in precipitation data by cross-validation approach using neighboring observations (example code 2)
  3. Identified outliers (a false observation or a single event) should be verified by discharge or radar data.
  4. Repeat the procedure over several temporal aggregations (to account for advection)

DOI


Reference paper:

El Hachem, A., Seidel, J., Imbery, F., Junghänel, T., and Bárdossy, A.: Technical Note: Space-Time Statistical Quality Control of Extreme Precipitation Observations, Hydrol. Earth Syst. Sci. Discuss. [preprint], https://doi.org/10.5194/hess-2022-177, in review, 2022.


Flowchart - Procedure

flowchart_outliers_2


Example data and codes on Github


Study area

Location_case_study


Box-Cox transformation [Python code 1]

Skewness before and after transformation

Skew_before_after

Average transformation factor

Transf_factor_lambda


Identified outlier [Python code 2]

Time series target and neighbors

stn_P03231_ngbrs_2008_05_14 08_00_00

Event spatial configuration with Radar image

radar_stn_P03231_2008_05_14 08_00_00__after


Data availability:

The precipitation data and the radar data were made available by the German Weather Service (DWD) [https://opendata.dwd.de/climate_environment/CDC/]. The discharge data were made available by the environmental state of Bavaria and can be requested [https://www.lfu.bayern.de/index.htm]


Used packages for Github example code:

  1. PyKrige: Benjamin Murphy, Roman Yurchak, & Sebastian Müller. (2022). GeoStat-Framework/PyKrige: v1.7.0 (v1.7.0). Zenodo. https://doi.org/10.5281/zenodo.7008206
  2. adjusttext: https://adjusttext.readthedocs.io/en/latest/
  3. statsmodels: https://www.statsmodels.org/devel/

Note: this is an exmaple case, in the paper a modified code was used with Variogram estimation and personal kriging code. These are not updated to keep things simple.