🌥️ A lightweight data pipeline based on Google Cloud's Storage, Functions, Tasks and Scheduler.
-
Updated
Jun 9, 2023 - HCL
Google Cloud Platform, offered by Google, is a suite of cloud computing services. It provides Infrastructure as a Service, Platform as a Service, and serverless computing environments. Alongside a set of management tools, it provides a series of modular cloud services including computing, data storage, data analytics and machine learning.
🌥️ A lightweight data pipeline based on Google Cloud's Storage, Functions, Tasks and Scheduler.
A python script for upload Online File to Google Cloud Storage (GCS) built on Docker
A local Google Cloud Build Local runner for non-production and development purposes based on the original (now archived) Google respository.
This repository is for sharing knowledge, thoughts and approaches to multi-cloud and best-practice ways of working.
Stream CSV data from Google Cloud Storage to BigQuery using Apache Beam Dataflow, featuring dynamic schema detection and flexible runner options.
Use Bigquery Python Package
Terragrunt Infrastructure for a project called Crypto4All
Use serverless approach to build scalable web-app / spend as less costs as possible / IaaC approach / CI/CD
This repository is an example how to use autopilot in GKE.
An IaC to bootstrap KubeSphere on GKE with Terraform.
Analysis of NYC's citibike data. Technologies: Python , Prefect, dbt, Terraform , Looker data studio
Kogito Serverless Workflow Google GCP example
A reference implementation of Vertex Pipelines for creating a production-ready MLOps solution on Google Cloud.
This repo contains code that creates a continuous integration and delivery (CI/CD) pipeline on Google Cloud [app]
Apache Beam pipeline to analyze London bicycle hiring dataset with GCP Dataflow
Released April 7, 2008