I have a use case: there are four files existing in different directories. I want to copy all four files only if they are all present. How do I validate the existence of all four files together? I have created…
set_list is of child pipeline and sam_k is from main pipeline in "@concat(variables('set_list'),variables('sam_k'))" but i am getting error as Expression of type: 'String' does not match the field: 'value'. Expected type is 'object'. sam_k output: { "name": "sam_k", "value": […
I have several tables the Dataflow reads from JSON-Files. Some of the String-Columns therein are actually Epoch Timestamps, but, since there quite a few tables and I don't want to make one dataflow per table, I can't manually tell the…
I have 2 different azure accounts. In one account I have a ADF and downloaded the Self Hosted IR. In the other account I have, I need to use IR, but unable to do use even using Linked IR as…
I have noticed that, currently HTTP as a data source is not available in Azure Data Factory. This was available as an option until a couple of days ago. I can't see any changes to the documentation to reflect this…
Hello i am using the azure maps Geocoding API to extract lat lon information from address from flat files loaded into a datalake - i have been getting a type mismatch error when i try to use the function ‘toDecimal(body.results1.position.lon)’…
I have an ADF pipeline to copy data from ADLS to Data Explorer(ADX). I am reading all the data and able to copy to ADX. Problem is that every time my pipeline runs and ingest data the ADX table gets…
i am currently mainly doing the practicing in ADF pipeline and I realised if i use getmetadata activity and select child items it won't go deep inside of the folder of the folder, which is not doing recursively, is anyway…
Hi I created an Azure data flow that transfer json from json file to cosmos db. The CosmosDbNoSql linked service connects successful. The Blob storage linked service for json file connects successful as well. The data flow is ok without…
My use case is as follows: Our data source is an On-prem SQL Server, and it serves as our production database. Currently, we are building reports in Power BI and utilizing Snowflake as our data warehouse. I aim to extract…