I have an ADF pipeline with a for each loop on files and performing some activity that should only run for the downtime hours. I am starting it using a trigger and want it to gracefully exit execution after 2…
How to check the status of pipeline A from Pipeline B. I have to pass the status of Pipeline A into If activity in pipeline B I have created a pipeline A which has 3 databricks notebook and on Pipeline…
I'm calling the Activity Runs Rest API from a parent pipeline to capture any errors in a child pipeline. However, no data, of any kind, is being returned in the Value array. Here are my settings. Web activity URL https://management.azure.com/subscriptions/@{pipeline().globalParameters.SubscriptionId}/resourceGroups/@{pipeline().globalParameters.ResourceGrpName}/providers/Microsoft.DataFactory/factories/@{pipeline().DataFactory}/pipelineruns/@{pipeline().RunId}/queryActivityRuns?api-version=2018-06-01…
There is set variable holding the below value and it is of type string. { "variableName": "test", "value": "<?xml version="1.0" encoding="utf-8"?> <fetch version="1.0" output-format="xml-platform" mapping="logical" aggregate="true" distinct="false"> <entity name="account"> <attribute name="ownerid" alias="account" aggregate="count" /> <filter type="and"> <condition attribute="ownerid" operator="not-null" />…
I have a pipeline to delete some folders from ADLS. My folder structure is as below. /raw/MainFolder/SubfolderA/20230430/File.parquet /raw/MainFolder/SubfolderA/20230415/File.parquet /raw/MainFolder/SubfolderA/20230410/File.parquet /raw/MainFolder/SubfolderB/20230430/File.parquet /raw/MainFolder/SubfolderB/20230420/File.parquet /raw/MainFolder/SubfolderB/20230405/File.parquet The pipeline is currently deleting the File.parquet under the date folder. But I need it to delete the…
Whenever I am trying to preview the data it's asking for value. I'm new to ADF. I have provided all the parameters correctly everywhere don't know what I'm missing. It's going till the folder path correctly but not able to…
I have this case where we have different queries we want to run in SQL Server then save it in an Excel file. I parameterized the Excel dataset I have then assigned it in the "Sheet name" property but I…
I have a logic app query to get the details of long running pipelines and I sending the email with the pipeline names. Now I want to cancel those pipelines which are running for long time how Can I implement…
I am deploying an adf with bicep similar to this https://learn.microsoft.com/en-us/azure/data-factory/solution-template-move-files template from microsoft. It worked nicely when I ran the pipeline by editing in the UI. I then exported the arm template from the datafactory and have converted it…
@string(equals(substring(pipeline().globalParameters.ENVIRONMENT_ROOT_FOLDER,0,2)),(substring(pipeline().parameters.TargetPath),1,3))) this throws error :: function 'equals' does not accept 1 argument(s) basically this code wants to check what is current environment and if the target path contains the current environment , this will go to false. For example if…