This plugin moves data from the Mailchimp API to S3. Implemented for camapigns, connected-sites connected-sites-details, conversations, conversations-details, lists, lists-details, reports, reports-details.
This hook handles the authentication and request to Mailchimp. Based on python-mailchimp
Core Airflow S3Hook with the standard boto dependency.
This operator composes the logic for this plugin. It fetches a specific endpoint and saves the result in a S3 Bucket, under a specified key, in njson format. The parameters it can accept include the following.
mailchimp_conn_id: The Airflow id used to store the Mailchimp credentials.mailchimp_resource: The mailchimp resource we are fetching data from.mailchimp_args: Mailchimp extra argss3_conn_id: S3 connection id from Airflow.s3_bucket: The output s3 bucket.s3_key: The input s3 key.s3_bucket: The s3 bucket where the result should be stored