I have Airflow and Airbyte installed locally with Docker. I want to set a connection in Airflow to connect Airbyte. I read the Airbyte docs and did exactly what it says but I am getting error. I have configured Airflow's…
I'm trying to query postgres from an MWAA instance of airflow. I'm not sure if there is a conflict due to airflow itself having a different version of postgres for its metadata or what, but I get this error when…
I have 3 operators imported from airflow.providers.google.cloud.operators.dataproc DataprocCreateBatchOperator DataprocDeleteBatchOperator DataprocGetBatchOperator Need the same kind-of operators for Azure. Can please someone look into this or I have to create a new operator ?
I have a question I want to use Templates reference - {{ds}} When substituting in PostgresOperator, everything works out well (I guess so) And PostgresHook does not want to work def prc_mymys_update(procedure: str, type_agg: str): with PostgresHook(postgres_conn_id=CONNECTION_ID_GP).get_conn() as conn: with…
I have a MWAA environment and I have to create another one by Terraform. The environment creation is not an issue, but the 'metadata' of my old enviroment. I want to import all variables and connections, programatically, but I haven't…
I keep receiving an "Internal Server Error" redirect when I click the "Open Airflow UI" link in the Amazon MWAA console; it's just a blank white screen with "Internal Server Error" in big black text. I was being successfully redirected…
I need help regarding git inside my latest airflow, I am using this image https://hub.docker.com/layers/apache/airflow/latest/images/sha256-3e0ab13f9525974867cbb612ff632d332b838b05fac4e59bf83f700827744d7d?context=explore and running a container using that but when I am trying to execute this below task I am getting errors current snippets # Create a…
I have been trying to run a simple Airflow DAG to show what's in an s3 bucket but I keep getting this error: ModuleNotFoundError: No module named 'airflow.providers.amazon' I've tried several pip installs recommended in similar questions but still have…
I have created a DAG to upload a local file into a personal S3 Bucket. However, when accessing http://localhost:9099/home I get the following error: FileNotFoundError: [Errno 2] No such file or directory: 'C:UsersplataOneDriveΥπολογιστήςprojects backupsairflow-sqlserverdagspricedata.xlsx' Ariflow error - broken dag I…
I am trying to add a running instance of MinIO to Airflow connections, I thought it should be as easy as this setup in the GUI (never mind the exposed credentials, this is a blocked of environment and will be…