Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GCP Cloud Run Executor CPU and Memory Configuration #5004

Open
FaisalDoowii opened this issue Apr 29, 2024 · 0 comments
Open

GCP Cloud Run Executor CPU and Memory Configuration #5004

FaisalDoowii opened this issue Apr 29, 2024 · 0 comments
Assignees
Labels
enhancement Polish or UX improvements

Comments

@FaisalDoowii
Copy link

FaisalDoowii commented Apr 29, 2024

Is your feature request related to a problem? Please describe.
I saw ECS, k8s and Azure Container Instance have a configuration option to set memory and cpu. As I deploy Mage on GCP, I found an issue that the cloud run job memory is not enough to run my job. Right now, the Cloud Run Jobs CPU and memory configuration will copy the config of the Cloud Run service if mage is deployed on Cloud Run service. So to increase the resource allocation, we need to set the service resource allocation higher, while it might not be necessary. Also each block might need different resource allocation.

Describe the solution you'd like
Make the configuration option to set memory and cpu for cloud run executor

Describe alternatives you've considered
Another option is to set a generic config on cloud run as a mapping to be passed to cloud run API function. This way, if GCP add new feature on their API, we can just pass the keyword argument to the metadata.yaml and the executor will pass it to GCP function.

Additional context
https://docs.mage.ai/production/configuring-production-settings/compute-resource#azure-container-instance-executor

@wangxiaoyou1993 wangxiaoyou1993 added the enhancement Polish or UX improvements label Apr 29, 2024
@wangxiaoyou1993 wangxiaoyou1993 self-assigned this May 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Polish or UX improvements
Projects
None yet
Development

No branches or pull requests

2 participants