Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Adds support for google.protobuf.Value pipeline parameters in the parameter_values field #808

Merged
merged 4 commits into from Nov 2, 2021
Merged
Show file tree
Hide file tree
Changes from 2 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
Expand Up @@ -43,15 +43,24 @@ class AutoMlTables(proto.Message):
class AutoMlTablesInputs(proto.Message):
r"""

This message has `oneof`_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Attributes:
optimization_objective_recall_value (float):
Required when optimization_objective is
"maximize-precision-at-recall". Must be between 0 and 1,
inclusive.
This field is a member of `oneof`_ ``additional_optimization_objective_config``.
optimization_objective_precision_value (float):
Required when optimization_objective is
"maximize-recall-at-precision". Must be between 0 and 1,
inclusive.
This field is a member of `oneof`_ ``additional_optimization_objective_config``.
prediction_type (str):
The type of prediction the Model is to
produce. "classification" - Predict one out of
Expand Down Expand Up @@ -149,23 +158,38 @@ class AutoMlTablesInputs(proto.Message):
class Transformation(proto.Message):
r"""

This message has `oneof`_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Attributes:
auto (google.cloud.aiplatform.v1.schema.trainingjob.definition_v1.types.AutoMlTablesInputs.Transformation.AutoTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
numeric (google.cloud.aiplatform.v1.schema.trainingjob.definition_v1.types.AutoMlTablesInputs.Transformation.NumericTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
categorical (google.cloud.aiplatform.v1.schema.trainingjob.definition_v1.types.AutoMlTablesInputs.Transformation.CategoricalTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
timestamp (google.cloud.aiplatform.v1.schema.trainingjob.definition_v1.types.AutoMlTablesInputs.Transformation.TimestampTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
text (google.cloud.aiplatform.v1.schema.trainingjob.definition_v1.types.AutoMlTablesInputs.Transformation.TextTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
repeated_numeric (google.cloud.aiplatform.v1.schema.trainingjob.definition_v1.types.AutoMlTablesInputs.Transformation.NumericArrayTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
repeated_categorical (google.cloud.aiplatform.v1.schema.trainingjob.definition_v1.types.AutoMlTablesInputs.Transformation.CategoricalArrayTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
repeated_text (google.cloud.aiplatform.v1.schema.trainingjob.definition_v1.types.AutoMlTablesInputs.Transformation.TextArrayTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
"""

class AutoTransformation(proto.Message):
Expand Down
Expand Up @@ -43,15 +43,24 @@ class AutoMlTables(proto.Message):
class AutoMlTablesInputs(proto.Message):
r"""

This message has `oneof`_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Attributes:
optimization_objective_recall_value (float):
Required when optimization_objective is
"maximize-precision-at-recall". Must be between 0 and 1,
inclusive.
This field is a member of `oneof`_ ``additional_optimization_objective_config``.
optimization_objective_precision_value (float):
Required when optimization_objective is
"maximize-recall-at-precision". Must be between 0 and 1,
inclusive.
This field is a member of `oneof`_ ``additional_optimization_objective_config``.
prediction_type (str):
The type of prediction the Model is to
produce. "classification" - Predict one out of
Expand Down Expand Up @@ -149,23 +158,38 @@ class AutoMlTablesInputs(proto.Message):
class Transformation(proto.Message):
r"""

This message has `oneof`_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Attributes:
auto (google.cloud.aiplatform.v1beta1.schema.trainingjob.definition_v1beta1.types.AutoMlTablesInputs.Transformation.AutoTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
numeric (google.cloud.aiplatform.v1beta1.schema.trainingjob.definition_v1beta1.types.AutoMlTablesInputs.Transformation.NumericTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
categorical (google.cloud.aiplatform.v1beta1.schema.trainingjob.definition_v1beta1.types.AutoMlTablesInputs.Transformation.CategoricalTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
timestamp (google.cloud.aiplatform.v1beta1.schema.trainingjob.definition_v1beta1.types.AutoMlTablesInputs.Transformation.TimestampTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
text (google.cloud.aiplatform.v1beta1.schema.trainingjob.definition_v1beta1.types.AutoMlTablesInputs.Transformation.TextTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
repeated_numeric (google.cloud.aiplatform.v1beta1.schema.trainingjob.definition_v1beta1.types.AutoMlTablesInputs.Transformation.NumericArrayTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
repeated_categorical (google.cloud.aiplatform.v1beta1.schema.trainingjob.definition_v1beta1.types.AutoMlTablesInputs.Transformation.CategoricalArrayTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
repeated_text (google.cloud.aiplatform.v1beta1.schema.trainingjob.definition_v1beta1.types.AutoMlTablesInputs.Transformation.TextArrayTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
"""

class AutoTransformation(proto.Message):
Expand Down
Expand Up @@ -176,17 +176,29 @@ class AutoMlForecastingInputs(proto.Message):
class Transformation(proto.Message):
r"""

This message has `oneof`_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Attributes:
auto (google.cloud.aiplatform.v1beta1.schema.trainingjob.definition_v1beta1.types.AutoMlForecastingInputs.Transformation.AutoTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
numeric (google.cloud.aiplatform.v1beta1.schema.trainingjob.definition_v1beta1.types.AutoMlForecastingInputs.Transformation.NumericTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
categorical (google.cloud.aiplatform.v1beta1.schema.trainingjob.definition_v1beta1.types.AutoMlForecastingInputs.Transformation.CategoricalTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
timestamp (google.cloud.aiplatform.v1beta1.schema.trainingjob.definition_v1beta1.types.AutoMlForecastingInputs.Transformation.TimestampTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
text (google.cloud.aiplatform.v1beta1.schema.trainingjob.definition_v1beta1.types.AutoMlForecastingInputs.Transformation.TextTransformation):

This field is a member of `oneof`_ ``transformation_detail``.
"""

class AutoTransformation(proto.Message):
Expand Down
64 changes: 33 additions & 31 deletions google/cloud/aiplatform_v1/services/dataset_service/async_client.py
Expand Up @@ -19,13 +19,15 @@
from typing import Dict, Sequence, Tuple, Type, Union
import pkg_resources

import google.api_core.client_options as ClientOptions # type: ignore
from google.api_core.client_options import ClientOptions # type: ignore
from google.api_core import exceptions as core_exceptions # type: ignore
from google.api_core import gapic_v1 # type: ignore
from google.api_core import retry as retries # type: ignore
from google.auth import credentials as ga_credentials # type: ignore
from google.oauth2 import service_account # type: ignore

OptionalRetry = Union[retries.Retry, object]

from google.api_core import operation as gac_operation # type: ignore
from google.api_core import operation_async # type: ignore
from google.cloud.aiplatform_v1.services.dataset_service import pagers
Expand Down Expand Up @@ -186,18 +188,18 @@ def __init__(

async def create_dataset(
self,
request: dataset_service.CreateDatasetRequest = None,
request: Union[dataset_service.CreateDatasetRequest, dict] = None,
*,
parent: str = None,
dataset: gca_dataset.Dataset = None,
retry: retries.Retry = gapic_v1.method.DEFAULT,
retry: OptionalRetry = gapic_v1.method.DEFAULT,
timeout: float = None,
metadata: Sequence[Tuple[str, str]] = (),
) -> operation_async.AsyncOperation:
r"""Creates a Dataset.

Args:
request (:class:`google.cloud.aiplatform_v1.types.CreateDatasetRequest`):
request (Union[google.cloud.aiplatform_v1.types.CreateDatasetRequest, dict]):
The request object. Request message for
[DatasetService.CreateDataset][google.cloud.aiplatform.v1.DatasetService.CreateDataset].
parent (:class:`str`):
Expand Down Expand Up @@ -277,17 +279,17 @@ async def create_dataset(

async def get_dataset(
self,
request: dataset_service.GetDatasetRequest = None,
request: Union[dataset_service.GetDatasetRequest, dict] = None,
*,
name: str = None,
retry: retries.Retry = gapic_v1.method.DEFAULT,
retry: OptionalRetry = gapic_v1.method.DEFAULT,
timeout: float = None,
metadata: Sequence[Tuple[str, str]] = (),
) -> dataset.Dataset:
r"""Gets a Dataset.

Args:
request (:class:`google.cloud.aiplatform_v1.types.GetDatasetRequest`):
request (Union[google.cloud.aiplatform_v1.types.GetDatasetRequest, dict]):
The request object. Request message for
[DatasetService.GetDataset][google.cloud.aiplatform.v1.DatasetService.GetDataset].
name (:class:`str`):
Expand Down Expand Up @@ -348,18 +350,18 @@ async def get_dataset(

async def update_dataset(
self,
request: dataset_service.UpdateDatasetRequest = None,
request: Union[dataset_service.UpdateDatasetRequest, dict] = None,
*,
dataset: gca_dataset.Dataset = None,
update_mask: field_mask_pb2.FieldMask = None,
retry: retries.Retry = gapic_v1.method.DEFAULT,
retry: OptionalRetry = gapic_v1.method.DEFAULT,
timeout: float = None,
metadata: Sequence[Tuple[str, str]] = (),
) -> gca_dataset.Dataset:
r"""Updates a Dataset.

Args:
request (:class:`google.cloud.aiplatform_v1.types.UpdateDatasetRequest`):
request (Union[google.cloud.aiplatform_v1.types.UpdateDatasetRequest, dict]):
The request object. Request message for
[DatasetService.UpdateDataset][google.cloud.aiplatform.v1.DatasetService.UpdateDataset].
dataset (:class:`google.cloud.aiplatform_v1.types.Dataset`):
Expand Down Expand Up @@ -437,17 +439,17 @@ async def update_dataset(

async def list_datasets(
self,
request: dataset_service.ListDatasetsRequest = None,
request: Union[dataset_service.ListDatasetsRequest, dict] = None,
*,
parent: str = None,
retry: retries.Retry = gapic_v1.method.DEFAULT,
retry: OptionalRetry = gapic_v1.method.DEFAULT,
timeout: float = None,
metadata: Sequence[Tuple[str, str]] = (),
) -> pagers.ListDatasetsAsyncPager:
r"""Lists Datasets in a Location.

Args:
request (:class:`google.cloud.aiplatform_v1.types.ListDatasetsRequest`):
request (Union[google.cloud.aiplatform_v1.types.ListDatasetsRequest, dict]):
The request object. Request message for
[DatasetService.ListDatasets][google.cloud.aiplatform.v1.DatasetService.ListDatasets].
parent (:class:`str`):
Expand Down Expand Up @@ -517,17 +519,17 @@ async def list_datasets(

async def delete_dataset(
self,
request: dataset_service.DeleteDatasetRequest = None,
request: Union[dataset_service.DeleteDatasetRequest, dict] = None,
*,
name: str = None,
retry: retries.Retry = gapic_v1.method.DEFAULT,
retry: OptionalRetry = gapic_v1.method.DEFAULT,
timeout: float = None,
metadata: Sequence[Tuple[str, str]] = (),
) -> operation_async.AsyncOperation:
r"""Deletes a Dataset.

Args:
request (:class:`google.cloud.aiplatform_v1.types.DeleteDatasetRequest`):
request (Union[google.cloud.aiplatform_v1.types.DeleteDatasetRequest, dict]):
The request object. Request message for
[DatasetService.DeleteDataset][google.cloud.aiplatform.v1.DatasetService.DeleteDataset].
name (:class:`str`):
Expand Down Expand Up @@ -610,18 +612,18 @@ async def delete_dataset(

async def import_data(
self,
request: dataset_service.ImportDataRequest = None,
request: Union[dataset_service.ImportDataRequest, dict] = None,
*,
name: str = None,
import_configs: Sequence[dataset.ImportDataConfig] = None,
retry: retries.Retry = gapic_v1.method.DEFAULT,
retry: OptionalRetry = gapic_v1.method.DEFAULT,
timeout: float = None,
metadata: Sequence[Tuple[str, str]] = (),
) -> operation_async.AsyncOperation:
r"""Imports data into a Dataset.

Args:
request (:class:`google.cloud.aiplatform_v1.types.ImportDataRequest`):
request (Union[google.cloud.aiplatform_v1.types.ImportDataRequest, dict]):
The request object. Request message for
[DatasetService.ImportData][google.cloud.aiplatform.v1.DatasetService.ImportData].
name (:class:`str`):
Expand Down Expand Up @@ -704,18 +706,18 @@ async def import_data(

async def export_data(
self,
request: dataset_service.ExportDataRequest = None,
request: Union[dataset_service.ExportDataRequest, dict] = None,
*,
name: str = None,
export_config: dataset.ExportDataConfig = None,
retry: retries.Retry = gapic_v1.method.DEFAULT,
retry: OptionalRetry = gapic_v1.method.DEFAULT,
timeout: float = None,
metadata: Sequence[Tuple[str, str]] = (),
) -> operation_async.AsyncOperation:
r"""Exports data from a Dataset.

Args:
request (:class:`google.cloud.aiplatform_v1.types.ExportDataRequest`):
request (Union[google.cloud.aiplatform_v1.types.ExportDataRequest, dict]):
The request object. Request message for
[DatasetService.ExportData][google.cloud.aiplatform.v1.DatasetService.ExportData].
name (:class:`str`):
Expand Down Expand Up @@ -797,17 +799,17 @@ async def export_data(

async def list_data_items(
self,
request: dataset_service.ListDataItemsRequest = None,
request: Union[dataset_service.ListDataItemsRequest, dict] = None,
*,
parent: str = None,
retry: retries.Retry = gapic_v1.method.DEFAULT,
retry: OptionalRetry = gapic_v1.method.DEFAULT,
timeout: float = None,
metadata: Sequence[Tuple[str, str]] = (),
) -> pagers.ListDataItemsAsyncPager:
r"""Lists DataItems in a Dataset.

Args:
request (:class:`google.cloud.aiplatform_v1.types.ListDataItemsRequest`):
request (Union[google.cloud.aiplatform_v1.types.ListDataItemsRequest, dict]):
The request object. Request message for
[DatasetService.ListDataItems][google.cloud.aiplatform.v1.DatasetService.ListDataItems].
parent (:class:`str`):
Expand Down Expand Up @@ -878,17 +880,17 @@ async def list_data_items(

async def get_annotation_spec(
self,
request: dataset_service.GetAnnotationSpecRequest = None,
request: Union[dataset_service.GetAnnotationSpecRequest, dict] = None,
*,
name: str = None,
retry: retries.Retry = gapic_v1.method.DEFAULT,
retry: OptionalRetry = gapic_v1.method.DEFAULT,
timeout: float = None,
metadata: Sequence[Tuple[str, str]] = (),
) -> annotation_spec.AnnotationSpec:
r"""Gets an AnnotationSpec.

Args:
request (:class:`google.cloud.aiplatform_v1.types.GetAnnotationSpecRequest`):
request (Union[google.cloud.aiplatform_v1.types.GetAnnotationSpecRequest, dict]):
The request object. Request message for
[DatasetService.GetAnnotationSpec][google.cloud.aiplatform.v1.DatasetService.GetAnnotationSpec].
name (:class:`str`):
Expand Down Expand Up @@ -950,17 +952,17 @@ async def get_annotation_spec(

async def list_annotations(
self,
request: dataset_service.ListAnnotationsRequest = None,
request: Union[dataset_service.ListAnnotationsRequest, dict] = None,
*,
parent: str = None,
retry: retries.Retry = gapic_v1.method.DEFAULT,
retry: OptionalRetry = gapic_v1.method.DEFAULT,
timeout: float = None,
metadata: Sequence[Tuple[str, str]] = (),
) -> pagers.ListAnnotationsAsyncPager:
r"""Lists Annotations belongs to a dataitem

Args:
request (:class:`google.cloud.aiplatform_v1.types.ListAnnotationsRequest`):
request (Union[google.cloud.aiplatform_v1.types.ListAnnotationsRequest, dict]):
The request object. Request message for
[DatasetService.ListAnnotations][google.cloud.aiplatform.v1.DatasetService.ListAnnotations].
parent (:class:`str`):
Expand Down