Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow Parallel dag deploys #1586

Open
kushalmalani opened this issue Mar 4, 2024 · 0 comments
Open

Allow Parallel dag deploys #1586

kushalmalani opened this issue Mar 4, 2024 · 0 comments
Assignees
@kushalmalani
Labels
team/cp-applications

Comments

@kushalmalani
Copy link
Contributor

Currently, if we perform parallel dag deploys, you get the following error

RuntimeError: + astro deploy --dags
Error: ===== RESPONSE ERROR (ErrorCode=InvalidBlockList) =====
Description=The specified block list is invalid.

This happens because we do not assign a unique block id for every dag deploy. We would to update our upload to blob storage flow to have unique blockIds on every push to allow uploading parallel to the same blob.

Slack Conversation - https://astronomer.slack.com/archives/CL44PA4DB/p1709191805125909
@kushalmalani kushalmalani self-assigned this Mar 4, 2024
@kushalmalani kushalmalani changed the title Allow Performing Parallel dag deploys Allow Parallel dag deploys Mar 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@kushalmalani kushalmalani

Labels
team/cp-applications
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@kushalmalani