Question 108278 in Azure Question posted in
The official documentation to get you started can be found here.

Azure Data Factory Rest API Pagination Call all pages

I am new to ADF and I am trying to call a Rest API that is paginated. I have my base url in my dataset as https://mydomain.syncromsp.com/api/v1/tickets?api_key=key_value.

I am able to return the first page as seen in the image below. In the meta portion of the JSON it shows "total_pages: 51" and "page:1"

How do I return the rest of the of the pages? I am not sure what Pagination rules to use in my Source settings.

First Page Returned

Tags:

2

Answers


  1. 0

    Your API response should contain the property of the next page URL to use the pagination to return to the next page.

    You can follow this MS document for more information on supported patterns of pagination in Rest API with examples.

    Login or Signup to reply.
  2. 0

    you would need to pass the page item as a parameter in a loop and loop until the page = total pages.

    Login or Signup to reply.
Please signup or login to give your own answer.

Back To Top
Search