Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: enable reduction server #741

Merged
merged 3 commits into from Oct 20, 2021

Conversation

morgandu
Copy link
Contributor

Fixes #<b/197889114> 🦕

@product-auto-label product-auto-label bot added the api: aiplatform Issues related to the AI Platform API. label Sep 30, 2021
@google-cla google-cla bot added the cla: yes This human has signed the Contributor License Agreement. label Sep 30, 2021
@morgandu morgandu force-pushed the mor--reduction-server-integration branch from da33a28 to 99312e6 Compare September 30, 2021 18:51
reduction_server_machine_type=reduction_server_machine_type,
)

worker_pool_specs = worker_pool_specs.pool_specs
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This changes the type of the variable. Although allowable in Python, prefer not to do that for readability purposes.

google/cloud/aiplatform/utils/worker_spec_utils.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/utils/worker_spec_utils.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/utils/worker_spec_utils.py Outdated Show resolved Hide resolved
@@ -86,6 +91,10 @@ def spec_dict(self) -> Dict[str, Union[int, str, Dict[str, Union[int, str]]]]:
spec["machine_spec"]["accelerator_type"] = accelerator_type
spec["machine_spec"]["accelerator_count"] = self.accelerator_count

if self.container_uri == REDUCTION_SERVER_CONTAINER_URI:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For now, I think it may be more extendable to add container_spec whenever self.container_uri is populated.

google/cloud/aiplatform/utils/worker_spec_utils.py Outdated Show resolved Hide resolved
@morgandu morgandu force-pushed the mor--reduction-server-integration branch from 99312e6 to a51daae Compare October 14, 2021 19:48
google/cloud/aiplatform/jobs.py Outdated Show resolved Hide resolved
google/cloud/aiplatform/utils/worker_spec_utils.py Outdated Show resolved Hide resolved
@morgandu morgandu force-pushed the mor--reduction-server-integration branch from 7fe79b0 to d473d24 Compare October 18, 2021 17:44
@morgandu morgandu force-pushed the mor--reduction-server-integration branch from d473d24 to 9dac2a9 Compare October 18, 2021 17:45
@morgandu morgandu merged commit 8ef0ded into googleapis:main Oct 20, 2021
@morgandu morgandu deleted the mor--reduction-server-integration branch October 20, 2021 20:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: aiplatform Issues related to the AI Platform API. cla: yes This human has signed the Contributor License Agreement.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants