I´ve created an Azure Synapse Analytics Pipeline that must be triggered by the creation of a file within a Azure Gen2 storage account. Somehow the blob creation event (i.e. when I upload the file in the corresponding container and folder)…
I am trying to ingest several tables incrementally in a pipeline on Azure Synapse using a ForEach Activity. I have defined a variable as an array of strings. Each string corresponds to the name of a table that I want…
In Azure SQL, I'm attempting to delete any text that is present between the < and > characters to my column in my table Sample text: The best part is that. < br >Note:< br >< u> reading :< /u> <…
I have a data frame and synapse sql table ,Need to merge the data frame into a synapse table with a delta location . I followed different documents but still not able to merge in synapse Could you help me…
Cannot see all database in Azure Synapse. I have two other spark pools but i cannot see them in the regular Databases tab.
I am trying to connect to Azure Serverless SQL using python but getting the following error External table 'dbo.my_table' is not accessible because location does not exist or it is used by another process. I have created the External table…
I have a Az Synapse (dedicated SQL pool) configured with managed VNet in tenant A and storage account in tenant B. The storage account is firewall protected and only certain VNets and IPs can access it. I want to created…
I have a storage account with firewall settings enabled (restricted access from only certain IPs and VNets). I need to access this storage account from Az Dedicated SQL Pool residing inside a SQL server. For this, I am using the…
I ran into this issue below, when trying to run a simple pyspark script in Azure: %%pyspark df = spark.read.load('abfss://[email protected]/userdata1.parquet', format='parquet') display(df.limit(10)) InvalidHttpRequestToLivy: Your Spark job requested 24 vcores. However, the workspace has a 12 core limit. Try reducing the…
I am loading in .gzip files as binary to my raw container, and I am now wondering how to proceed in azure synapse analytics. I would like to get the binary .gzip and move it to a different folder and…