Skip to content

stav121/apache-airflow-goodies

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Airgoodies

GitHub Actions Workflow Status GitHub Actions Workflow Status PyPI - Version GitHub License PyPI - Downloads GitHub contributors

Airgoodies is a project that contains various APIs to interact with external services inside Apache Airflow using minimum configuration (see airgoodies.{module}.variables.json for each module).

Current version matrix:

Airgoodies Version Apache Airflow Version Python Version Project tag
0.0.4 2.7.2 3.11 v0.0.4
0.0.3 2.7.2 3.11 v0.0.3
0.0.2 2.7.2 3.11 v0.0.2
0.0.1-alpha 2.7.2 3.11 v0.0.1-alpha

Provided goodies for version 0.0.4:

Module Description Dependency Versions
airgoodies.command API for dynamic task configuration through YAML pyyaml==6.0.1
airgoodies.aws API for easy interaction with AWS pandas==2.1.1
apache-airflow-providers-amazon===8.7.1
airgoodies.mongo API for easy interaction with MongoDB pymongo==4.5.0
airgoodies.xcom API for managing variables through XCom None

Installation

Add the following requirement in your requirements.txt

# requirements.txt
airgoodies=0.0.4

Example usage

For the official documentation, see here

For an example of how to use this project, see here

Building the project

To build the project:

$ python3 setup.py sdist bdist_wheel

License

This project is available under the MIT License.

Author

Stavros Grigoriou (stav121)