-
Notifications
You must be signed in to change notification settings - Fork 15
Home
Welcome to the evo-odas wiki!
-
Ingestion documentation on google doc this document contains most of the technical information required to the development of the ingestion system.
- Most relevant python libraries used and examples
- Details about the data formats for Sentinel 1 & 2
- Explanation about some of the technical choices
-
Sentinel1 ingestion flow diagram this diagram shows the various steps of the Sentinel1 Ingestion flow, here is the related chapter on the ingestion document
-
Landsat8 ingestion flow diagram this diagram shows the workflow of Landsat8 data ingestion and this document shows more details about the work-flow.
-
Workflow engine comparison This document contains a comparison among several workflow engines.
We first decided to choose Airflow comparing it at the last decisional step with mistral . Then a new product called Apache NiFi entered in the radar after a presentation at an OGC event it's written in java and we were mostly focused on searching for python products. The final decision is still pending.
Few other resources about Airflow and NiFi
-
Airflow Deploy diagram This deployment diagram shows the architecture of the Airflow environment in a multi workers fashion, using docker and celery.
-
NiFi watchers review Investigation about how to work with the NiFi content repository and raster data management use cases mismatch.
-
Sentinel1
- official ESA website of the mission
- Product description for sentinel 1 radar data
The objective of this project regarding Sentinel1 data is to ingest data of level1 both SLC and GRD products
-
Sentinel2
- official ESA website of the mission
- Product description for sentinel 2 optical data
The objective of this project regarding Sentinel2 data is to ingest data from level-1C
-
Landsat8
- Official USGS website of the mission
- Band designations of Landsat8
- Landsat8 user handbook
The objective of this project is to ingest Collection-1 level Landsat8 scenes