azure-blob-storage Questions

Writing to Azure Blob Storage from local spark environment

May 27, 2024
chrish
2 Answers

I've been going round in circles trying to write to a blob storage account in azure. Currently i'm creating a spark session with the following setup: spark = SparkSession.builder .appName("Azure Blob Storage Access") .config("spark.jars.packages", "org.apache.hadoop:hadoop-azure:3.3.1 ,com.microsoft.azure:azure-storage-blob:11.0.1 ,org.apache.hadoop:hadoop-azure:3.4.0 ,org.apache.hadoop:hadoop-azure:3.3.1 ,org.eclipse.jetty:jetty-util:11.0.7 ,org.apache.hadoop.thirdparty:hadoop-shaded-guava:1.1.1…

VIEW QUESTION

Function App: Azure.Storage.Blobs: Value cannot be null

May 10, 2024
codeNightmare
2 Answers

I have published a function from Visual Studio 22 but I get two errors. I go to the configuration in Function App to see the value of AzureWebJobsStorage. In this place I saw AzureWebJobsStorage 's value and It is same…

VIEW QUESTION

Azure – Creating a common API for accessing any blob in any storage account within a tenant

I'm working on developing an API that allows users to retrieve blobs from Azure Storage (RBAC) using Azure AD OAuth2 authentication. Here's the scenario: Users will authenticate using Azure AD OAuth2 (Authorization Code flow keeping scope as access-as-user) it generates…

VIEW QUESTION

Azure – Issue in function app and storage account connectivity

May 7, 2024
sjindal
2 Answers

I have written a script for function app and it's storage account creation using terraform. I was having shared access key enabled for storage account but on azure portal in security it shows that function app should access storage account…

VIEW QUESTION

Unable to send blob to Azure – missing HTTP header exception

April 23, 2024
Drees
2 Answers

I am trying to upload a parquet file to Azure, but it keeps giving me an error message saying that its missing a required HTTP header. In the example I am providing I just tried some basic data in a…

VIEW QUESTION

Azure Logic App – Read secrets information from Azure Key Vault to authenticate blob connector

April 17, 2024
Ajay
2 Answers

I have to create a workflow using standard Azure Logic App. I am trying to authenticate Azure BLOB connector using connection string. One of the easiest way is to add connection string directly but manual intervention is required whenever there…

VIEW QUESTION

Azure – BlobSasBuilder generated URI has invalid signature

I am trying to create a method which can return an Azure SAS URI for a specific container. The code runs fine and does produce what seems like a valid URI, but when you try to use it you get…

VIEW QUESTION

Deleting content of folder in azure storage account container via azure devops pipelines

April 2, 2024
Nopesound
2 Answers

I'm having trouble deleting data contained in a folder within a container of a storage account via Azure CLI. Having a tree of this kind: Documents 1.0.0 <Files> 2.0.0 <Files> 3.0.0 <Files> I would like to delete all the folders…

VIEW QUESTION

Azure Identity ClientSecretCredential is throwing Method not found error dotnet SDK version 1.10.4

March 21, 2024
Vijay aravind
2 Answers

I am using Azure Identity client SDK dotnet 1.10.4 and clientsecretcredential class to generate a token to read from my blob. I followed the list blob in container sample in this link https://learn.microsoft.com/en-us/azure/storage/blobs/storage-blobs-list I am getting the following error Azure.Identity.AuthenticationFailedException:…

VIEW QUESTION

How to use Copy Data to perform sql insets and updates to a MySQL database from an .sql delta file?

March 20, 2024
smeekaa
2 Answers

I have a database delta file (.sql) and it contains sql statements such as Insets, Delete, Update. The database is setup with the tables and data, I am simply trying to execute these updates I am trying to find a…

VIEW QUESTION