Skip to content

20.2.1
Compare
Choose a tag to compare
@weberjm weberjm released this 04 Nov 14:48
· 1563 commits to master since this release
v20.2.1
ee1a8e6
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

New Features

Transformations inside of Connectors

It is no longer necessary to include a separate Transformer Component inside of Flows for standard transformations. The Ferryman library now includes a transform()function to perform this functionality directly inside of a Connector (example).

Flow Templates

A new service has been added to the framework called Template Repository. This service contains "recipes" or templates from which Flows can be generated. This allows for the sharing of Flows without leakage of Secrets.

Enhancements

Improved Orchestrator Performance

Caching has been added to the Component Orchestrator to help it process flows more quickly.

Deployment Configuration Improvements

Deployment scripts for the Reference Implementation on Kubernetes have been updated. Configuration and Secrets have been pulled out of the Deployment files and moved to their own Config Maps and Kubernetes Secret files. This allows users to more easily implement their own deployments based on the Reference Implementation.

Failure Handling for Flows

In the case of failures when changing Flow states, especially when starting a Flow, inconsistencies could arise between the reported state in the Flow Repository and the Component Orchestrator. Failing Flows will now report their status and be transitioned back to Inactive. This also provides fixes for Flows which were "stuck" in a transitional state.

Fixes

  • Data Hub: The Data Hub service has been updated to operate with the new framework features introduced in 20.2.0.
  • Local Components: Fixes an issue where Local Components were not able to start.

Other

"help wanted" Label for Community Contributions

We want to make it easier for the community to contribute and know where help is needed. As a first step, we will start labeling issues with help wanted.

Developer Tooling

  • Addition of Load Testing scripts in the dev-tools/
  • Improved Installation Documentation

Out-factoring Logging Service

The Logging Service was removed from the core framework repository and moved into its own repository. This Service is tightly couple to execution on Google Cloud Platform and aggregated logs from its Cloud Logging service. The Framework is intended to remain agnostic from deployment platform, therefore this service was removed from the monorepo.

Libraries

Ferryman: v1.1.5
Component Orchestrator: v1.1.5
Attachment Storage Service: v0.0.4
Event Bus: v1.2.0
Secret Service: v1.7.1
Webhooks: v1.2.0
Scheduler: v1.2.0
IAM Utils: v1.6.0

Assets 2