I have a pipeline with multiple copy activities(23) from parquet to azure sql. I am experiencing low copy throughput (23kb/s) Is there a way to improve this? Integration runtime is azure and not a self hosted IR.
I am making a rest call using a copy activity to write data to a datalake storage. Source is a rest dataset and sink is a json. If I use a http binary dataset it works fine, but then I…
I´ve created an Azure Synapse Analytics Pipeline that must be triggered by the creation of a file within a Azure Gen2 storage account. Somehow the blob creation event (i.e. when I upload the file in the corresponding container and folder)…
I have an API response which contains rn. I am not able to replace it by using replace(string, 'rn', ''). It does not work for it. When I use replace(string, 'r', '') it replaced every word which contains r except…
I have a backup zipped file that has hundreds of files in it. Unzipping ALL the files takes over an hour to process. Is there a way to ONLY unzip the .csv files in Azure Data Factory?
I previously created a copy activity to copy all columns in sql table into ADLS in parquet format. I am new to Azure data factory. So my question is how would copy only a specific set of columns into Azure…
I have a Stored Procedure activity in my Azure Data Factory pipeline that recalls the following stored procedure on Azure Synapse: CREATE PROCEDURE schema.procedure_name @portafoglio INT [...] The activity in configured in order to use a variable (portafoglioElab), previously set…
I want to make a request to an RESTapi of the Norwegian statistics bureau. According to their api I need to make a POST request (thats not usual but that is ok) to get the tables that I need. In…
We'd like to give support personnel Read Only access to Azure Data Factories so they can troubleshoot issues. Following this guide I was able to create a custom role that mostly does the trick but on further review I can…
I am trying to extract data from SAP using SAP CDC Connector in ADF. The source data looks something like this. START_DT|PROD_NAME|END_DT 20201230165830.0|BBEESABX|20180710143703.0 When we perform a preview data on the source, we are getting data just like above. But…