Azure – How to transform a column into an array using ADF
I need to read a column on a db on ADF and use all it´s values as parameters in a foreach. I tried reading the column using a dataflow and a cache sink to then in a pipeline use Set…
Azure – i can't connect to input container. but the container is acccessible and the file is there
I learning azure, specifically datafactory, so in a basic exercice. 1 - I should create a input container, and a output container (using azure sorage 2). 2 - After that, i created the datasets for input and output. 3 -…
Azure – While creating a Dataset for ADF sometimes we import Schema and sometimes we not. What is the reason behind it?
I am creating a dataset of Azure blob storage type. While watching youtube videos of ADF i saw sometimes we import schema and sometimes we not can you please guide me when we have to click on import schema
How to export Adf pipelines,dataflows,datasets into Azure Synapse
I have 100 dataflows ,50 pipelines and their related datasets variables etc. Now i want to use Synapse service and want my all pipelines amd stuff of ADF into Synapse. My Adf is git configured Can we export them in…
Azure Data Factory uploads data to database when pipeline run fails
I have a pipeline running in my ADF where I take fields from a json file and save them to multiple tables in my database. The pipeline starts running when a file is uploaded to a container in my storage…
Automated email when connection to source fails in Azure
sorry if the question is too basic. I am very new to Azure and I want to receive automated email if a connection to for example a SQL server is not established. In that regard, I was wondering if there…
Incremental load in Azure Data Factory
I am replicating my data from Azure SQl DB TO Azure SQL DB. I have some tables with date columns and some tables with just the ID columns which are assigning primary key. While performing incremental load in ADF, I…
Azure SQL database with MFA login to connect from Azure ADF
I have an Azure SQL server and database which have MFA login and I am the admin. But when I try to establish a connection via a new linked service from ADF to this database using System Managed Identity option,…
Azure Data Factory, how to pass parameters from trigger/pipeline in to data source
I need help. I've create a pipeline for data processing, which is importing csv and copy data to DB. I've also configure a Blob storage trigger, which is triggering pipeline with dataflow, when speciffic file will be uploaded in to…
Azure – Synapse Analytics RenameDataFactoryResourceError error when trying to publish a rename pipeline
I'm trying to publish a reanaming pipeline and I'm getting this error and don't know how to deal with Error code: OK Inner error code: RenameDataFactoryResourceError Message: {"code":"InternalError","message":"Internal error has occurred.","target":null,"details":null,"error":null} I've already tried to rename the pipeline again but…