大数据采集,抽取平台,zdh_web是zdh系列服务的可视化管理平台,包含数据采集,调度,权限,审批流,私域营销等模块
-
Updated
May 26, 2024 - Java
大数据采集,抽取平台,zdh_web是zdh系列服务的可视化管理平台,包含数据采集,调度,权限,审批流,私域营销等模块
Terraform module designed to easily backup EFS filesystems to S3 using DataPipeline
Roadmap for Data Engineering
High Performance Tensorflow Data Pipeline with State of Art Augmentations and low level optimizations.
Domain-specific language to help build and maintain AWS Data Pipelines
Ethereum client written in Go, modified for full-hierarchy data exports and block specimen production
Tensorflow 2 Tutorials (use tensorflow and keras in a better way!)
Global Tree Cover Loss Analysis using Geotrellis and SPARK
Building Json data pipeline within Snowflake using Streams and Tasks
An ETL data pipeline that extracts data from source and loads it to destination, automated using mage.ai
Материалы для курса Введение в Data Engineering: дата пайплайны
Simple Airflow on Kubernetes (GKE)
Awesome list for datapipeline
A data pipeline project build on databricks and azure to demostrate lifecycle of a cloud data project.
Go library that provides easy-to-use interfaces and tools for TensorFlow users, in particular allowing to train existing TF models on .tar and .tgz datasets
Insurance Premium Prediction
A GitHub Action to lint, test, build-docs, package, and run your kedro pipelines. Supports any Python version you'll give it (that is also supported by pyenv).
Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
This is an ETL project - extracting data from an ecommerce transactional database on RDS, transforming the data using AWS glue job, and loading it to a Redshift data warehouse, and connected it to Tableau for BI
Add a description, image, and links to the datapipeline topic page so that developers can more easily learn about it.
To associate your repository with the datapipeline topic, visit your repo's landing page and select "manage topics."