Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DEV - Updating the default worker type to A5 in CeleryExecutor based deployment gives unrelated error message #1524

Open
1 task
shri-astro opened this issue Feb 2, 2024 · 2 comments
Assignees
Labels

Comments

@shri-astro
Copy link

The new deployment created has A5 as the worker type by default
When the deployment is updated with the worker type as A5 with the following command as part of negative case,

shrividyahegde@Hegde sample1 % astro deployment worker-queue update default -t A5 -d cls4ui6zt000101otbnf03t0v         

 #     WORKER QUEUE     ISDEFAULT     ID                            
 1     default          true          cls4ui75u000701otngm0r7og     

> 1
Error: worker queue option is invalid: worker concurrency must be between 1 and 15

The error message says the concurrency related error.

What CLI Version did you experience this bug?
2.0.0

This CLI bug is related to which Astronomer Platform?

  • Astro

What Operating System is the above CLI installed on?
Mac M1 Pro

@shri-astro
Copy link
Author

Inspite of giving the worker queue as default, the user is asked to choose a worker queue and anything other than default gives unrelated errors:

shrividyahegde@Hegde testlimits %  astro deployment worker-queue update default -t A5 -d cltcuxxua0dkb01jz4umnhro5

 #     WORKER QUEUE      ISDEFAULT     ID                            
 1     additionalwq      false         cltcuxxyo0dkh01jzvx26bl20     
 2     additionalwqq     false         cltcwtxsf0d6v01jls5bmz6be     
 3     default           true          cltcwt9qo0cvw01jxwhd9x1l4     

> 3

Are you sure you want to update the default worker queue? If there are any tasks in your DAGs assigned to this worker queue, the tasks might get stuck in a queued state and fail to execute (y/n) y
worker queue default for test in cls8pqheo00i301pcq8x7bi1z workspace updated
shrividyahegde@Hegde testlimits %  astro deployment worker-queue update default -t A5 -d cltcuxxua0dkb01jz4umnhro5

 #     WORKER QUEUE      ISDEFAULT     ID                            
 1     additionalwq      false         cltcuxxyo0dkh01jzvx26bl20     
 2     additionalwqq     false         cltcwt9qo0cvw01jxwhd9x1l4     
 3     default           true          cltcwtxsf0d6v01jls5bmz6be     

> 1

Are you sure you want to update the additionalwq worker queue? If there are any tasks in your DAGs assigned to this worker queue, the tasks might get stuck in a queued state and fail to execute (y/n) y
Error: Invalid request: worker concurrency cannot exceed 15, requested 23
shrividyahegde@Hegde testlimits % 

@shri-astro
Copy link
Author

@sunkickr any updates on this issue?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants