I know basically zero about Azure Blob Storage, but I’m working on a PowerBI report that retrieves CSV files from Azure Blob storage and parses them into tables in the PowerBI model. This seems like an insanely resource intensive way to do this – why not parse the CSV files and write the results to properly indexed database tables, and then I can use aggregations (because it’s like 9 million records, and my matrix is slowwwwwww).
is that a viable solution?
2
Answers
use data flows in ADF to do it. Just like in the video. (https://www.youtube.com/watch?v=Pj5mrtTsR1M) Should work a champ. Then I can have all of my data in my datamart or whatever, and then I can create an aggregation table, and finally, include the data in my report without having to unpack it all every time.
I would suggest you look at Power BI Datamart over Dataflow.