Question 18803 in Amazon Web Sevices Question posted in
The official Amazon Web Services documentation can be found here.

How to run some batch script on all MWAA Airflow worker nodes? – Amazon Web Sevices

Is there a way to run a specific batch script on every worker node that MWAA spins up?

Is there any feature in airflow that can do this?

Tags:

2

Answers


  1. 0

    There is no practical way to do this because it is not supported by MWAA. Set up of the individual nodes is managed by AWS, which means you don’t get to mess with it.

    Login or Signup to reply.
  2. 0

    With the latest version, you can run the scripts as a startup scripts on every worker. For this the scripts needs to be available in the S3 bucket and its absolute path is provided to MWAA environment "Startup script file "
    For more details – https://docs.aws.amazon.com/mwaa/latest/userguide/using-startup-script.html

    Login or Signup to reply.
Please signup or login to give your own answer.

Back To Top
Search