I hope somebody can help me understand how I can solve this issue. In azure I have 3 separate environment: Development Staging Production Each of this environment I have a Datafactory. Due to the large datasets I have I decided…
I have a pipeline (PL_Main) containing a set of Execute pipeline activities in sequence, as the below image depicts: Now, I was trying to create an activity (executed after PL_Main completion) that allowed me to understand if any of the…
I have a azure batch account with only selected network option enabled. So how do i connect to this batch account from my azure data factory? Through private link? if so how do i do this because i am not…
I have three activities (A, B, C) that need to return a string = 'True' in order for the If block to run its True activities, otherwise False activities. Scenario 1 (All True): A = True B = True ->…
I am trying to create a DataFlow under Azure Data Factory and I need to check if my array contains values from another column. These are the information: enter image description here I have a table with 3 columns and…
Sorry for long post, I need to explain it properly for people to undertsand. I have a pipeline in datafctory that triggers a published AML endpoint: I am trying to parametrize this ADF pipeline so that I can deploy to…
I am loading in .gzip files as binary to my raw container, and I am now wondering how to proceed in azure synapse analytics. I would like to get the binary .gzip and move it to a different folder and…
I am trying to parameterize a mapping data flow in Azure DF UI. I am declaring a variable in the pipeline, which is taking the result from a lookup value - the current timestamp of a table. In the mapping…
I would like to delete the bottom two rows of an excel file in ADF, but I don't know how to do it. The flow I am thinking of is this. enter image description here *I intend to filter ->…
I've created an Azure Data Factory pipeline with one simple Stored Procedure Activity which is supposed to fetch data from a Stored Procedure residing in Azure SQL DB. The Stored Procedure accepts one input parameter. I've published these changes already.…