Skip to content

WorldHealthOrganization/xform-covid-casecount-who

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Transformer Template Project

About

This is a template project for creating data transformers that can be registered with the Data Registry. The workflow for transformation is managed via GitHub Actions.

Usage

  1. From the repo GitHub page click the "Use this template" button to create a new repo for your transformer.
  2. Search the repo for TODO and make the appropriate changes for your transformer.
  3. Update xform.yml to provide metadata for the data source and outputs.
  4. Update this README file with relevant information about the data source.

Development

There are three primary files that can be changed for your specific needs:

  1. xform.sh
    • This script handles installing dependencies and executing your transformer.
  2. install.sh
    • This script can be used to install additional dependencies that your transformer requires.
    • This file can be deleted if it's not needed.
  3. xform.R
    • This is the default transformer file.
    • This file can be deleted or replaced with code for any other programming language. You will need to update xform.sh to call your new code if not using R.

To schedule your transformer in GitHub Actions you will need to uncomment the scheduling section in .github/workflows/main.yml.

Search the codebase for TODO to find additional items that may need to be configured for your instance.

Testing

Each action runs in its own Docker container in GitHub Actions and locally for testing. Each action has its own Makefile with common commands to run and test each step of the workflow. The main Makefile has commands for executing each action.

Primary Commands:

  • make run-workflow
  • make run-xform
    • Run the xform.
  • make run-validate-csv
    • The the CSV validation.
  • make run-git-push
    • Run git push.

See Makefile for all commands and each individual Makefile in the actions folders.

About

Data transformer for COVID-19 case counts from WHO

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published