Question 185133 in Azure Question posted in
The official documentation to get you started can be found here.

Azure – How to stop an ADF pipeline after a particular number of hours?

I have an ADF pipeline with a for each loop on files and performing some activity that should only run for the downtime hours. I am starting it using a trigger and want it to gracefully exit execution after 2 hours, whether it is done looping through all files or not.

Is there a way to configure it in ADF?

Tags:

2

Answers


  1. 0

    One way is to have a separate pipeline which contains a wait activity(2hr) followed by a web activity.

    The web activity can call the data factory api to send a cancel run request.
    Refer :
    How-to-cancel-a-pipeline-run

    Creating the web activity by referring the web-activity and preferably using msi as the authentication.

    Another method is using logic app, it already builtin tasks to create a pipeline trigger, cancel it etc.

    Login or Signup to reply.
  2. 0

    One way to do this is checking the time difference in each iteration in an if activity and if it’s True, then call the web activity to cancel the pipeline using the REST API.

    Before the pipeline activities, create a set variable activity with @utcnow().

    enter image description here

    Inside the ForEach, after your activity use an if activity with the below condition.

    @equals(div(sub(ticks(utcnow()),ticks(variables('mytime'))),600000000),120)

    enter image description here

    The above conditon checks the time difference between current time and the mytime variable is 2 hours (120 minutes) or not.

    If it results True, add a web activity in the True activities to cancel the Pipeline run with REST API using current pipeline run id.

    You can go through this blog by @Andy Leonard to know about canceling the current pipeline using web activity inside the ForEach.

    Login or Signup to reply.
Please signup or login to give your own answer.

Back To Top
Search