Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add create in Featurestore, EntityType, Feature; add create_entity_type in Featurestore; add create_feature, batch_create_features in EntityType; add ingest_from_* for bq and gcs in EntityType; add and update delete with force delete nested resources #872

Merged

Conversation

morgandu
Copy link
Contributor

@morgandu morgandu commented Dec 1, 2021

  • add create method in Featurestore, EntityType, Feature classes;
  • add create_entity_type in Featurestore;
  • add create_feature, batch_create_features in EntityType;
  • add ingest_from_bq and ingest_from_gcs methods in EntityType class
  • add and update delete methods with force delete nested resources
  • add unit tests
  • update integration test

@google-cla google-cla bot added the cla: yes This human has signed the Contributor License Agreement. label Dec 1, 2021
@product-auto-label product-auto-label bot added the api: aiplatform Issues related to the AI Platform API. label Dec 1, 2021
@morgandu morgandu self-assigned this Dec 1, 2021
@morgandu morgandu force-pushed the mor--feature-store-create-and-ingest branch 2 times, most recently from b9d6932 to 8af8486 Compare December 2, 2021 00:39
@morgandu morgandu changed the title feat: add create method in Featurestore, EntityType, Feature classes; add create_entity_type in Featurestore; add create_feature, batch_create_features in EntityType; add ingest_from_bq and ingest_from_gcs methods in EntityType class feat: add create method in Featurestore, EntityType, Feature classes; add create_entity_type in Featurestore; add create_feature, batch_create_features in EntityType; add ingest_from_bq and ingest_from_gcs methods in EntityType class; add and update delete methods with force delete nested resources Dec 2, 2021
@morgandu morgandu changed the title feat: add create method in Featurestore, EntityType, Feature classes; add create_entity_type in Featurestore; add create_feature, batch_create_features in EntityType; add ingest_from_bq and ingest_from_gcs methods in EntityType class; add and update delete methods with force delete nested resources feat: add create in Featurestore, EntityType, Feature; add create_entity_type in Featurestore; add create_feature, batch_create_features in EntityType; add ingest_from_* for bq and gcs in EntityType; add and update delete with force delete nested resources Dec 2, 2021
@morgandu morgandu force-pushed the mor--feature-store-create-and-ingest branch 4 times, most recently from f38cd2d to 56d0db5 Compare December 2, 2021 19:50
google/cloud/aiplatform/featurestore/feature.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/featurestore/featurestore.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/featurestore/featurestore.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/featurestore/featurestore.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/featurestore/featurestore.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/featurestore/featurestore.py Outdated Show resolved Hide resolved
tests/system/aiplatform/test_featurestore.py Outdated Show resolved Hide resolved
@morgandu morgandu force-pushed the mor--feature-store-create-and-ingest branch from 56d0db5 to 9b1b72a Compare December 4, 2021 00:53
google/cloud/aiplatform/featurestore/entity_type.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/featurestore/entity_type.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/featurestore/entity_type.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/featurestore/entity_type.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/featurestore/entity_type.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/utils/featurestore_utils.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/utils/featurestore_utils.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/utils/featurestore_utils.py Outdated Show resolved Hide resolved
tests/system/aiplatform/e2e_base.py Outdated Show resolved Hide resolved
@morgandu morgandu force-pushed the mor--feature-store-create-and-ingest branch from 9b1b72a to 75ac97e Compare December 10, 2021 06:18
@morgandu morgandu force-pushed the mor--feature-store-create-and-ingest branch 2 times, most recently from 41580d9 to 03aa950 Compare December 11, 2021 01:04
Copy link
Member

@sasha-gitg sasha-gitg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One high level comment: if possible, please avoid force updating the commit history as some of the previous commits are no longer accessible and it becomes difficult to follow previous comments. It also seems to break "Show changes since last review" view. Thanks!

google/cloud/aiplatform/featurestore/entity_type.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/featurestore/entity_type.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/featurestore/entity_type.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/featurestore/entity_type.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/featurestore/entity_type.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/featurestore/featurestore.py Outdated Show resolved Hide resolved
Copy link
Member

@sasha-gitg sasha-gitg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks!

… add create_entity_type in Featurestore; add create_feature, batch_create_features in EntityType; add ingest_from_bq and ingest_from_gcs methods in EntityType class
…hanging feature_config.request_dict to get_create_feature_request() with parent option
…irectly to api method; update docstring for feature_source_fields and node_count
…and feature_time for oneof, changed method validate_id to _is_resource_id, changed method validate_value_type to return None
…o setting for values if None; fix potential delete breaking change; change request_metadata to None and tests; update unit test for get_timestamp_proto; refactor feature_source_fields; remove optional batch_create from ingest and tests;
@morgandu morgandu force-pushed the mor--feature-store-create-and-ingest branch from a5ab277 to 1e1c2fb Compare December 17, 2021 02:35
@morgandu morgandu added the automerge Merge the pull request once unit tests and other checks pass. label Dec 17, 2021
@gcf-merge-on-green gcf-merge-on-green bot merged commit ba11c3d into googleapis:main Dec 17, 2021
@gcf-merge-on-green gcf-merge-on-green bot removed the automerge Merge the pull request once unit tests and other checks pass. label Dec 17, 2021
@morgandu morgandu deleted the mor--feature-store-create-and-ingest branch December 17, 2021 03:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: aiplatform Issues related to the AI Platform API. cla: yes This human has signed the Contributor License Agreement.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants