I've setup a Cost Management export that is trigged weekly to a Storage Account. In that storage account the CSV is exported inside a container, a folder, another folder, and then inside a folder with FROM-TO dates: I would like…
I developed a CI/CD to deploy the content (pipelines, Global parameters, LinkedServices...) of a DEV Data Factory in a PROD Data Factory. I use 2 shirs for the DEV and PROD environments where each environment uses its own shir. When…
I am copying data from ADLS csv file to Azure SQL DB. File contains 9 columns and mapping is done according to that, but sometimes the source file is only having 6 or 7 columns. In that case the pipeline…
I have a problem. I got the data from oracle on premise by query in LOOKUP ACTIVITY now I want to get this data into the DATA FLOW source so I can append this data into the my master CSV…
Is it possible to create a Data Flow that gets data from the output of an activity in a Pipeline? Something like this: I want to create a pipeline that has an Azure function activity to process some data and…
I Have question about Azure Data Factory Expression for function IF in SQL we can create using CASE WHEN 'A' Then 1 when 'B' then 2 when 'C' then 3 else 100 is this correct expression to IF? @if(equals(variables('varInput'), 'a'),…
I am using odbc connector to connect to AS400 DB2 system. I am fetching metadata from copy activity and it is throwing the following error. Failure happened on 'Source' side. ErrorCode=UserErrorOdbcOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ERROR [HY000] [IBM][System i Access ODBC Driver][DB2 for i5/OS] -…
I have a JSON type SQL column in SQL table as below example. I want the below code to be converted into separate columns such as drugs as table name and other attribute as column name, how can I use…
The problem is after each row is inserted I need to store the identity and update again it in the source. How is it possible in ADF, in ssms we can use identity_insert? in first database, i have a table…
I have input col as 12/03/08 viz dd/MM/yy . So I beed it in the format of dd/MM/yyyy . SO I have use the below transformation as : toString(toDate(col,'dd/MM/yy'),'dd/MM/yyyy') This works fine. But at the end i need to conver…