I have these messy fields that I need to cleanup in Dataflow. EAN field can have any number of elements separated by ",". But the actual EAN is always the last one. However it seems that there is no way…
I want to combine two tables in a data flow of Azure Data Factory. So I tried to join the tables using the 'Date' column as join condition: I would suspect the output of this join only has 1 'Date'…
Hi I have used data flow source output format is as below: I want output as shown below: Json format:
The Copy Activity result doesn't show the source and sink location (file path or server etc.) Not from the ADF monitor or Log Analytics. It only shows the source and sink type. It is impossible to trace where the data…
I want to copy an Azure SQL DB table exactly from a source DB to a destination DB. I currently have a "Copy data" activity that works great for upserting the data. But I also want to delete any records…
I'm attempting to implement SCD2 within Azure Data Factory, but I'm encountering issues with the update mechanism. Instead of updating rows, my process seems to insert all rows from the source data into the destination, leading to duplicates. This example…
I have below code which is not working in ADF. Are there any alternative functions to get difference between two dates. Below is my code: DATEDIFF("DD",START_DATE,END_DATE)<=10 Can someone please check and advise me how to proceed with this.
Hello I have quite a few files that I want to combine using Azure Data Factory. I'm currently using Union activity in dataflow to combine a few files at once but I have about a thousand files and was wondering…
I am coping data from blob storage to SQL database. In source I have multiple files with different schema so when schema doesn't match to destination table it fails copy data for that file. I want pipeline to be succeeded…
I want to copy a table from one storage account to another with the Copy activity in ADF. I just need a simple copy of my table, preferably 100% identical to the source table. There is a field in the…