Using docker to test and develop an ETL data pipeline with Airflow and AWS glue. I'm currently using this blog post as a guide to launch the containers: https://towardsdatascience.com/develop-glue-jobs-locally-using-docker-containers-bffc9d95bd1 (Dockerfile github link: https://github.com/jnshubham/aws-glue-local-etl-docker/blob/master/Dockerfile). When I run docker build -t glue:latest…
I am learning how to use ARG and ENV in Dockerfiles. I have this simple Dockerfile: ARG my_arg ARG other_arg=other_default FROM centos:7 ENV MY_ENV $my_arg ENV OTHER_ENV $other_arg CMD echo "$MY_ENV $OTHER_ENV" When I build it: docker build --build-arg my_arg=my_value…
I am building an image with docker file,in my docker file i execute a script.In script,There are some commands like: systemctl start postgresql-9.6.service systemctl disable NetworkManager And when i execute docker build, it goes error: Failed to get D-Bus connection:…
so my Docker build is essentially done and I just have to chown and chmod a large directory recursively. The following is part of the output from docker build: Step 34/40 : RUN du -b -m -s / 2>/dev/null ||…