I need to convert the YYYYMM to YYYY-MM-01 using azure data factory pipeline expression. I tried the below expression but it giving me error that date value should follow the ISO 8601 format. @formatDateTime(concat('202301','01'),'YYYY-MM-DD') It should return in this format…
I have data in one storage acc in dev subscription. I need to move the data to other storage acc in other subscription. Is there any way to do this by ADF by copy activity?
I need to Maintain Folder Structure to store files in yyyy/MM/DD format and I am getting date like this "2021-12-01T00:00:00Z" I need to Extract year from the date and to store in one variable and need to extract Month from…
I am using the below code to get some information in the Azure Databricks notebook, but runOutput isn't appearing even after the successful completion of the notebook activity. Code that I used. import json dbutils.notebook.exit(json.dumps({ "num_records" : dest_count, "source_table_name" :…
Validation Error I've got this weird issue where validation fails on 'additional columns' for my data sink to Azure SQL coming from a blob storage source in the Azure Data Factory GUI. No matter how many times we recreate the…
I'm writing a Data Flow in which I make an upsert to a Cosmos DB NoSQL database. My goal is to use a field called batch to keep track of the date of insertion of a particular document, that is,…
Wanted to pick your brains on something So, in Azure data factory, I am running a set of activities which at the end of the run produce a json segment {"name":"myName", "email":"[email protected]", .. <more elements> } This set of activities…
I have a successful connection from Azure data Factory to my Azure Sql db .And I have set the AAD Admin as myself and also the UserManagedIdentity from the portal. Now whoever use that UserManagedidentity in ADF can access the…
So how we can fetch the secrets or keys for Azure Data Factory , logic apps, Azure Synapse and Azure DataBricks if we disable the public access for keyvault. I found a solution for AppServices and FunctionApps by using outbound…
I have a Web activity that performs a GET operation to an endpoint. I have set it up to do something On Failure (which works just fine) and another set of action upon Success. But this last part gets skipped…