I have a data frame in PySpark and would like to save the file as a CSV with the current timestamp as a file name. I am executing this in Azure Synapse Notebook and would like to run the notebook…
I'm creating a Data Factory configuration and a pipeline in Python. I successfully added Azure Blob Storage and Azure Key Vault to the linked services, but got stuck on adding (serverless)Azure Synapse Analytics, as simply I was not able to…
I tried to save a PySpark dataframe in a SQL database in Synapse: test = spark.createDataFrame([Row("Sarah", 28), Row("Anne", 5)], ["Name", "Age"]) test.write .format("jdbc") .option("url", "jdbc:sqlserver://XXXX.sql.azuresynapse.net:1433;database=azlsynddap001;encrypt=true;trustServerCertificate=false;hostNameInCertificate=*.sql.azuresynapse.net;loginTimeout=30;Authentication=ActiveDirectoryIntegrated") .option("forwardSparkAzureStorageCredentials", "true") .option("dbTable", "test_CP") .save() I got the following error: IllegalArgumentException: KrbException: Cannot locate default…
I am trying to create a pipeline for my stored procedure in dedicated SQL pool. I am getting error Cannot connect to SQL database "" Check the linked service config is correct, and make sure the SQL database firewall allows…
I have an Azure SQL Server residing in tenant A and I need to add a Virtual network rule for a subnet residing in tenant B. For this, I have created a service principal and given it multi-tenant access. I…