I have a requirement to generate a unique 'guid' for each row in the dataverse, and for that, I'm using an additional column in the copy activity as shown below. Since it generates the same guid for every row, I'm…
In Azure Synapse Analytics, I would like to use the pipeline function to set a variable of type array for the date from 12 months ago to current date. The date in the variable is the first day of each…
I'm trying to import dags from a blob storage to a managed airflow from Azure Data Factory. The ADF instance can access the blob storage through the System Managed Identity (I can browse the storage through ADF), but when i…
This is my trigger typeProperties, "type": "ScheduleTrigger", "typeProperties": { "recurrence": { "frequency": "Day", "interval": 1, "startTime": "2023-07-07T05:28:00", "timeZone": "W. Europe Standard Time", "schedule": { "minutes": [ 10 ], "hours": [ 16 ] } } } I want to change the…
I'm using a third party REST API, to which I pass a serial number of a device, and it returns a series of values. This API returns a JSON with a node that is named after the serial, so I…
Is it possible to configure a data-factory pipeline that performs data-transfer between an endpoint available on-premises ( such as a SFTP server ) and Azure blob storage, where the IR process runs exclusively in the Azure compute fabric ? So…
We are trying to create an Azure Data Factory Linked Service for an Azure Batch account using Terraform. However, there is no native resource available in Terraform documentation for creating an Azure Batch Linked Service directly. To work around this,…
Is it possible to mention only start of the cell in Range while using excel as source in copy acivity? It throws the error, asking me to provide with the end cell value. How can I fix it?
I'm currently trying to call an API to grab data in JSON format and bring it into an Azure Synapse Data Warehouse. Below is a sample piece of the incoming JSON. The issue I'm running into I believe to be…
As you can see Number 1 Source has to be Replaced with Number 2 Union Source .There is no option to connect the same line of transformations to new source .How can i achieve this