In a data flow of a Azure Data Factory pipeline I want to preview a specific period of rows in the data preview tab. Whenever I refresh the data preview I see for example data of a year ago, while I want to see the data of the last few weeks. I know the data is in there. Is there a way you can select the data from only the last few weeks by for example using the Date column or something else?
If I data preview I see the following data:
It is weird because whenever in a different data flow I again connect to this data I see a complete different TimeStamp. I guess data preview just takes a random sample of the complete data. But can you somehow specify what period of data you want to preview?
2
Answers
You can try using filter transformation. Do Data Preview on your filter, once your done you can just remove it
You can change the debug settings in dataflow, so that data preview will happen only on the small dataset instead of the entire dataset.