Azure Question posted in
The official documentation to get you started can be found here.

Incremental Copy using Power Automate Cloud Flow/Azure Logic App

I am currently trying to move data incrementally from SharePoint Online Folder to Azure BLOB storage. I have been able to set the configuration using Azure Logic App.

There is an event-based trigger when a file is created in a SharePoint folder which starts the entire flow and moves to the Blob storage. The works fine.

But for subsequent flows such as incremental if the files will be uploaded daily, I have tried configuring to get the metadata for the SharePoint folder for the LastModified date. But it doesn’t have that much functionality as ADF when performing incremental copy.

I will appreciate any guidence on how to acheive this without needing to use ADF as it will require a lot of configuration to use on SharePoint folder and doesn’t give me the necessary flexibility.

I have also attached an image of what have been done so far, which does a full copy all the time.

Thanks

enter image description here

I have tried configuring to get the metadata for the SharePoint folder for the LastModified date. But it doesn’t have as much functionality as ADF when performing incremental copy.

Tags:

2

Answers


  1. 0

    I do agree with @skin, but if you want to know if a blob exists or not and then create that blob you can use below design:

    You can use parallel action to copy all blobs at first:

    enter image description here

    then:

    enter image description here

    then:

    enter image description here

    then:

    enter image description here

    Output:

    enter image description here

    enter image description here

    Login or Signup to reply.
  2. 0

    Currently, you are using the When a file is created in a folder (deprecated) trigger. This trigger fires when a file is created in a SharePoint folder, but not when the file is updated.

    If I understood your question correctly, you want to copy data from SharePoint to a blob storage incrementally, that is if a file with the same name but a different content is uploaded to SharePoint daily, your workflow should notice it and copy the file to the blob storage.

    You can achieve this by using a different trigger – When a file is created or modified in a folder (deprecated).

    Your workflow would look as follows:

    1. Trigger When a file is created or modified in a folder (deprecated)
    2. Action Create blob (V2)

    There’s no need to use the For each loop. You might need to use a loop in another process to copy all SharePoint files to the blob storage initially, before this "incremental copy" workflow starts operating.

    Login or Signup to reply.
Please signup or login to give your own answer.

Back To Top
Search