I want to combine two tables in a data flow of Azure Data Factory. So I tried to join the tables using the 'Date' column as join condition: I would suspect the output of this join only has 1 'Date'…
Hi I have used data flow source output format is as below: I want output as shown below: Json format:
The Copy Activity result doesn't show the source and sink location (file path or server etc.) Not from the ADF monitor or Log Analytics. It only shows the source and sink type. It is impossible to trace where the data…
I want to copy an Azure SQL DB table exactly from a source DB to a destination DB. I currently have a "Copy data" activity that works great for upserting the data. But I also want to delete any records…
I'm attempting to implement SCD2 within Azure Data Factory, but I'm encountering issues with the update mechanism. Instead of updating rows, my process seems to insert all rows from the source data into the destination, leading to duplicates. This example…
I have below code which is not working in ADF. Are there any alternative functions to get difference between two dates. Below is my code: DATEDIFF("DD",START_DATE,END_DATE)<=10 Can someone please check and advise me how to proceed with this.
Hello I have quite a few files that I want to combine using Azure Data Factory. I'm currently using Union activity in dataflow to combine a few files at once but I have about a thousand files and was wondering…
I am coping data from blob storage to SQL database. In source I have multiple files with different schema so when schema doesn't match to destination table it fails copy data for that file. I want pipeline to be succeeded…
I want to copy a table from one storage account to another with the Copy activity in ADF. I just need a simple copy of my table, preferably 100% identical to the source table. There is a field in the…
I need to send an email whenever my pipeline runs longer then 10mins. For sending mail I am using logic app but how to check if the time exceeds then 10mins? How can we check and do this in the…