Question 162208 in Azure Question posted in
The official documentation to get you started can be found here.

“How can I replicate a new column added in a source table to the target table in Azure?”

I have a source table/excel/csv data and done ETL to target SQL table.
Now if there is a new column introduced in the source data, how to replicate the data in target. Assume that there was already one load of data completed from source to target. What is the best way to deal this?

This is Azure Cloud specific question.

Tags:

2

Answers


  1. 0

    Assuming you used the copy data activity, and mapping fields between source and target is done automatically (they have the same name). If you create a column in your destination with the same name as the new column in the source, ADF will automatically map them and copy the data.

    Login or Signup to reply.
  2. 0

    There are multiple ways depending on the source data type: full or delta

    In case if the source data is always full ( you get the entire data always), then you can auto create the destination table :

    enter image description here

    https://learn.microsoft.com/en-us/answers/questions/35570/create-a-target-table-on-the-fly-in-data-factory

    but in case if the source has delta data and your target table contains historical data(which no longer comes from source), then you would have to manually add the new column at source and sink and do the necessary mappings

    Login or Signup to reply.
Please signup or login to give your own answer.

Back To Top
Search