sorry if the question is too basic. I am very new to Azure and I want to receive automated email if a connection to for example a SQL server is not established. In that regard, I was wondering if there…
I am replicating my data from Azure SQl DB TO Azure SQL DB. I have some tables with date columns and some tables with just the ID columns which are assigning primary key. While performing incremental load in ADF, I…
I have an Azure SQL server and database which have MFA login and I am the admin. But when I try to establish a connection via a new linked service from ADF to this database using System Managed Identity option,…
I need help. I've create a pipeline for data processing, which is importing csv and copy data to DB. I've also configure a Blob storage trigger, which is triggering pipeline with dataflow, when speciffic file will be uploaded in to…
I'm trying to publish a reanaming pipeline and I'm getting this error and don't know how to deal with Error code: OK Inner error code: RenameDataFactoryResourceError Message: {"code":"InternalError","message":"Internal error has occurred.","target":null,"details":null,"error":null} I've already tried to rename the pipeline again but…
Me and my team are using Azure Synapse Analytics to ingest data from a REST API to a Azure Data Lake Storage Gen2, in order to create views automatically. The only way we could manage to do this in our…
I'm starting a Databricks notebook from ADF to do some preprocessing tasks. The cluster of this notebook is usually not running and should only run, when the ADF pipeline is running as well. But it takes several minutes for the…
I'm working with a dataset where I need to drop some columns which contain only NULL values. The issue is that the column names are not consistent or similar, and can change with time. I was wondering if there is…
I am working with Synpase Spark Pools in a controlled corporate environment. I have limited permission to query AAD but I can create UAMIs and assign them to Resources. When I access my Synpase workspace I can create a Spark…
I have a JSON file in the following format: { "first_name": "Jane", "last_name": "Doe", "userid": 12345, “profile”: { “annoying_field_name_10”: {“field_id”: 15, “field_name”: “Gender”, “value”: “Female”, “applicable”: 1 }, “annoying_field_name_11”: {“field_id”: 16, “field_name”: “Interests”, “value”: “Baking”, “applicable”: 1 } } }…