Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ability to exclude columns from replication #69

Open
nurikk-sa opened this issue Dec 8, 2023 · 6 comments
Open

Ability to exclude columns from replication #69

nurikk-sa opened this issue Dec 8, 2023 · 6 comments

Comments

@nurikk-sa
Copy link

nurikk-sa commented Dec 8, 2023

Hello! Thanks for a great software! TF provider is really good addition to airbyte.

I'm looking for a way to exclude column from replication. Currently terraform provider doesn't support field list/exclusion.
Example reason: remove sensitive columns from replica, like emails/passowrds

@hirads
Copy link

hirads commented Jan 31, 2024

I plus one this! Thanks for the really nice tool, I was so happy to see specially the Terraform provider and everything else looks amazing, but this little use-case which is missing is actually a huge deal-breaker for our use-case. It would be amazing if we could directly select columns via Terraform, otherwise the manual selection via UI is reset every time you configure the connection and you have to redo the selection for each and every stream (eg. when adding a new stream to the connection). I couldn't find any workarounds for it, there is no way to select them on the source (in my case redshift) and I've even tried creating a view on top of my table to contain only the columns needed but the streams don't include the views in the stream.

@dantonbertuol
Copy link

That would be excellent!

Having a way to use terraform with airbyte in itself is incredible, but with this functionality it would be amazing.

Anxiously awaiting a response.

@dis-sid
Copy link

dis-sid commented Mar 4, 2024

Not having column selection here prevents us (and I believe everyone who needs this feature) from using this TF provider for connections. It's still great to have source and destinations defined once and versioned as TF configurations 👍

@rGaillard
Copy link

+1 this feature is really missing :(

@kamegg13
Copy link

It would be great if this feature will be available soon. Terraform is not used to his full potential. Getting streams on a connection is good, but not enough. Airbyte UI can be a source of error if we misclick on the webpage.

@Roman77450
Copy link

+1 We also need this feature. Today we are waiting for it to be available to use airbyte

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants