I wanted to create a subdirectory in a directory in one of my Azure blob storage containers. I know that it is not possible doing it via UI. So I created a databricks notebook and executed the following command: dbutils.fs.mkdir("mnt/<containername>/directory/subdirectory).…
I was able to blob test connection and it's successful, but when I attempt to look for the storage path it shows this error. screenshot Full error: Failed to load Blob operation failed for: Blob Storage on container '' and…
I am having folder structure like (Container)->(1)School->(2)Staffs ->(2.a)OfficeStaffs -> (2.a.i)Admin ->(Blobs) -> (2.a.ii)Clerk->(Blobs) ->(2.b)Teachers ->(2.b.i)SeniorStudents ->(Year)->AttendanceReport.xlx ->ExamReport.xlx ->(2.b.ii)JuniorStudents ->(Year)->AttendanceReport.xlx ->ExamReport.xlx School is my parent folder and all other folders are sub folders. Now I need to find blobs using folder…
I've seen many iterations of this question but cannot seem to understand/fix this behavior. I am on Azure Databricks working on DBR 10.4 LTS Spark 3.2.1 Scala 2.12 trying to write a single csv file to blob storage so that…
I have the .jpg pictures in the data lake in my blob storage. I am trying to load the pictures and display them for testing purposes but it seems like they can't be loaded properly. I tried a few solutions…
I am uploading a file to Azure Blob Storage. Everything seems to work fine since I'm getting this response: Status: 201, Value: Azure.Storage.Blobs.Models.BlobContentInfo I can see the file in Azure Portal for about 5 seconds, then it vanishes. Any idea…
I’m working on an Azure Function App that will grab a .pgp file off of Blob Storage, decrypt it, and then upload that decrypted file back to Blob Storage. I’ve done quite a bit of research and everything usually assumes…
I'm working with a subscription that has a few different deployed environments (dev, test, staging, etc.). Each environment has its own storage account, containing an associated Terraform state file. These environments get deployed via Azure DevOps Pipelines. It's easy enough…
I can't seem to activate Cache-Control max-age in an Azure storage blob in Python via the following code: contentSettings = ContentSettings(cache_control="max-age=86400") containerClient.upload_blob(blobname, theBytes, length=byteCount, overwrite=True, content_settings=contentSettings) In the web based Azure storage browser, it appears max-age is correctly set: However,…
Within an Azure Data Factory Pipeline I am attempting to remove an empty directory. The files within the directory were removed by a previous pipelines' iterative operation thus leaving an empty directory to be removed. The directory is a sub-folder:…