I copy data from postgre db to azure sql with copy activity and auto-create table feature enabled. there is a column with type timestamptz in Source db. looks like 2023-07-03T07:00:47.707369+00:00 2023-07-03T07:00:52.375166+00:00 when I auto-create table in Azure SQL it always…
I'm new to Azure DevOps and I try to mimic some fancy behaviors of Github actions there. In my repository I use the following build.yaml to trigger a pipeline whenever a push is made to the main branch: trigger: branches:…
Good day I want to pass the value of $mm to this azcopy. However, since azcopy parameters are in double quotes, it does not want to process correctly. $mm=04 ; start=`echo "START DATE: $(date)"` ; azcopy cp "https://reco.blob.core.windows.net/raw-voi-2022/2022-$mm/*?sv=2020-0RgUNH8A%3D" "https://storage.blob.core.windows.net/bin-voi-2022/2022-$mm?sv=2021-0HGICxvaLULI%3D" Results:…
I like to stream large data files over REST directly to a Azure Blob Storage. Now i face the problem that when I send a filter with 250MB over REST to the Azure Blob Storage, but with 260MB it stuck…
I need to download very large file via REST and store it to an Azure Blobstorage. I am facing quite some Problems. For all examples, I use this call to get to the Data var flux = this.webClient .get() .uri(urlToAssert)…
Flask application --> Capturing the value entered via web form and passing it as a parameter to trigger a databricks job. Tried passing the parameters as follows : 1- payload = { > 'notebook_params': { > 'customer_name': customer_name > }…
I am an experienced Azure user when it comes to data infrastructure and pipelines. However, I am new to processing XML data and my particular case seems somewhat complex. After exhausting my resources I am turning to the community for…
I'm working on a data flow to ingest XML files and trying to pull a deeply nested node's value up into another part of the flow. E.g. <payload> <header> <customerID>1234</customerID> <createdDate>1/2/2023T15:33:22</createdDate> .... </header> <body> ... <compartments> <compartment> <compartmentNo>1</compartmentNo> <product>2</product> <quantity>5000</quantity>…
I want to add an authorization to Azure API Management using Terraform. I don't find the corresponding Terraform resource; the closest one is azurerm_api_management_authorization_server but it does support all the properties like "Grant type", "Resource URL" and "Authorization Name." resource…
I am trying to get data from a soap api. From most of the endpoints it is going without a hitch. I am working in azure portal and have set up a custom connector. The logic app I'm building uses…