v0.5.0-beta

0.5.0-beta (2024-03-04)

Features

• Add arguments to run MongToBQ template (f0bfd4c)
• Add integration test for MongoToBigQuery Python template (906e26f)
• Add preliminary documentation for MongoToBigQuery template (99146fa)
• added support for running python templates on an existing dataproc cluster (bed0d62)
• Built java KafkaToBQDstream template for Dataproc (220cd0e)
• Built Java KafkaToGCSDstream template for Dataproc (d6c6232)
• Connection to MongoDB established via the template (8ba9e18)
• Initialise MongoToBQ Python template test file (1345dfc)
• MongoToBigQuery template initiated with config to run from main.py (4178ec9)
• MongoToBQ template writes successfully to destination table (21f44ba)

Bug Fixes

• Add Usage details of MongoToBQ template to README (3cb21f1)
• integration test for MongoToBigQuery python (955db75)
• removed dupliacted code for read and write operations (b3e8f98)
• removed dupliacted code for read and write operations (9d5c5f4)

Documentation

• Add recommended jar versions to run MongoToGCS template (#871) (3d1b729)
• added instructions for CLUSTER mode in python README (ecb2955)
• added jenkins status for python cluster integration tests (73967d1)
• added links in README for KafkaToBQDstream template (bfc076c)
• added links in README for KafkaToGCSDstream template (8def950)
• adding blog for cassandra to gcs (5ab3342)
• adding blog for cassandra to gcs (47a478b)
• adding blogpost for MongodbToGCS (2960f71)
• adding updates in a few python templates (1597691)
• clarify serverless and cluster modes, improve template execution instructions (7a8e529)
• enhanced instructions for better clarity on serverless and cluster modes (5ae1999)
• hyperlink blog guide for RedshiftToGCS java template (4dcf0a5)
• updating GCS to Cloud Storage in Java templates (426b772)
• updating gcs to cloud storage in remaining python templates (ec9925b)