How to increase the Until Activity timeout to more than 7 days in Azure Data factory?
How to increase the Until Activity time to more than 7 days in Azure Data factorystrong text
Azure DataFactory Linked Service FileSystem Errornr
Azure DataFactory File System Linked Service is not working with this error: Error details Error code 28051 Details c could not be resolved. I tried to connect file excel in onpremise machine using the self hosted integration runtimeg
Azure Data Factory: Delete an Empty Directory Issue
Within an Azure Data Factory Pipeline I am attempting to remove an empty directory. The files within the directory were removed by a previous pipelines' iterative operation thus leaving an empty directory to be removed. The directory is a sub-folder:…
Can we use different run-time in Copy Activity of Azure Data Factory?
I am using Copy Activity for migrating the Data from On-premises Database to the on-cloud Database. Here I am using Self-Hosted Integration Runtime for both on-premises and on-cloud databases. The Integration run-time is different for on-premises and on-cloud Databases. When…
Azure Data Factory Counting number of Files in Folder
I am attempting to determine if a folder is empty. My current method involves using a GetMeta shape and running the following to set a Boolean. @greater(length(activity('Is Staging Folder Empty').output.childItems), 0) This works great when files are present. When the…
Using contains function in Azure Data Factory Dataflow expression builder
I am using Azure Data Factory in which a data flow is used, I want to split my file in to two based on a condition. I am attaching an image with 2 lines, the first one is working but…
Even after setting up the connect via private endpoint, Azure Data Factory remains accessible over the Internet?
Even after setting up the connect via private endpoint, Azure Data Factory remains accessible over the Internet? Private Connections Private Zone Entries It is accessible over the Internet How to restrict the Data Factory access only within the VNET?
Selecting the last element after split in Azure Data Factory
I am trying to select the last string after splitting it in Azure Data Factory. My file name looks like this: s = "cloudboxacademy/covid19/main/ecdc_data/hospital_admissions.csv" With Python I would use s.split('/')[-1] to get the last element, according to Microsoft documentation I…
Azure – Data factory copy based off last high water mark value (Dynamic date)
I'm currently working on a project where I need the data factory pipeline to copy based off the last run date. The process breakdown.... Data is ingested into a storage account The data ingested is in the directory format topic/yyyy/mm/dd…
How do I increase copy activity throughput in Azure data factory
I have a pipeline with multiple copy activities(23) from parquet to azure sql. I am experiencing low copy throughput (23kb/s) Is there a way to improve this? Integration runtime is azure and not a self hosted IR.