In DataFactory, I'm creating a ForEach activity and in Items I'm using this expression: @createArray(json('{ "daily": { "raw": [ { "entity_name": "ent1", "fetchXML_file": "raw/ent1.xml", "destination_path_base": "/master/raw/ent1" }, { "entity_name": "ent2", "fetchXML_file": "raw/ent2.xml", "destination_path_base": "/master/raw/ent2" }, { "entity_name": "ent3", "fetchXML_file": "raw/ent3.xml",…
In Azure Synapse Analytics, I would like to use the pipeline function to set a variable of type array for the date from 12 months ago to current date. The date in the variable is the first day of each…
For SQL Server based login in Synapse Serverless, as soon as I run these two things: use master GO Create Login JustTest WITH PASSWORD='Whatever' use somedatabase Create User JustTest from login JustTest Now, JustTest can run any OPENROWSET query on…
We have set up a pipeline to upload the libraries/packages to synpase workspace using Azure commands az synapse workspace-package upload --workspace-name testsw --package C:/python.whl I tried appending --overwrite just to overwrite the existing library but it threw error. Do we…
I'm currently trying to call an API to grab data in JSON format and bring it into an Azure Synapse Data Warehouse. Below is a sample piece of the incoming JSON. The issue I'm running into I believe to be…
I want to create an array type variable for use in a pipeline, but don't know how to do it. I want to store this month through December in an array type variable. For example, I want to create the…
I have an issue with loading a CSV to a dataframe add some rows and overwriting the csv from the source To make it simple I tried to load the CSV and then overwrite it, this will also not work,…
I want to truncate tables where the value of my column isTrun in the config table is True. The scripts need to run in the Sink pre-copy script of the copy activity. The dataflow is the following: The look-up activity…
I have a .csv file (in Azure Data Lake Storage), which looks approximately like this -> I want to create a notebook (PySpark (Python)), which could be implemented in the synapse analytics (integrate -> pipeline) in one of the pipelines.…
I have a problem. I got the data from oracle on premise by query in LOOKUP ACTIVITY now I want to get this data into the DATA FLOW source so I can append this data into the my master CSV…