Question 105864 in Azure Question posted in
The official documentation to get you started can be found here.

Azure – How do I export pipeline runtime duration to CSV

I want to export my runtime duration of the each pipeline to CSV. How can this be done or achieved?
The below is scheduled Pipeline which run to end, i can use the the Export CSV button to get duration of these pipelines but each execute pipeline got so many individual jobs(In this example will take P_Weekly_RV_Load_1) and how can I get those details of all those individual jobs run in p_weekly_RV_Load_! to csv

Triggered Pipeline jobs

P_Weekly_RV_Load_1 - All jobs in that

Tags:

2

Answers


  1. 0

    Navigate to the Monitoring view in ADF, click on "Pipeline runs" and then "Debug". On the top right you’ll see "Export to CSV".

    enter image description here

    Login or Signup to reply.
  2. 0

    When you say individual jobs I am assuming you mean the activity runs inside of a pipeline. Currently activity level detail is not exported to CSV, just the pipeline details.

    To capture activity level detail there are a couple of options:

    1. Use diagnostics settings and send the Activity Runs to storage, Log Analytics, or Event Hubs. See https://learn.microsoft.com/en-us/azure/data-factory/monitor-configure-diagnostics/ on how to set this up.
    2. Use the SDKs via REST, Powershell, etc. to query the activity run endpoints and export the data programmatically. See https://learn.microsoft.com/en-us/rest/api/datafactory/activity-runs/query-by-pipeline-run as an example.
    Login or Signup to reply.
Please signup or login to give your own answer.

Back To Top
Search