Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Better fields filtering in encoders #27

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

efirs
Copy link
Contributor

@efirs efirs commented Sep 12, 2019

Currently output schema can only less fields than input schema, meaning we can only filter fields from input schema. If it happens that input schema has less fields, for example, column is dropped in the source table, then it'll brake ingestion.

The idea behind this diff is to make filtering more generic and allow to filter both input and output schema columns.

@efirs efirs changed the title Better fields filtering in encoders [WIP] Better fields filtering in encoders Sep 13, 2019
@CLAassistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.


Evgeniy Firsov seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants