Issue Summary: Experiencing problems when transferring data from Oracle Cloud Infrastructure (OCI) to Databricks Delta Lake tables using Qlik Replicate. Source: Oracle Cloud Infrastructure (OCI) Destination: Databricks Delta Lake tables Problem Statement: Data duplicacy Missing data Details: Logs from Qlik…
I have a personal Azure pay-as-you-go subscription in which I have the 'Global Administrator' role. I am also the databricks account administrator. Until two weeks ago, I was able to access the databricks account console without any issues, but I…
I am reaching out to you for assistance with some issues I'm encountering in my Databricks environment. I'm hoping the community can provide some guidance to help me resolve these problems. 1. Error with df.display(): When I try to use…
I am attempting to connect to a SQL Server from an Azure Databricks notebook using the pyodbc Python library. When I run the query, I encounter the following error: Error: ('01000', "[01000] [unixODBC][Driver Manager]Can't open lib 'ODBC Driver 17 for…
I am trying to connect to sql server from databricks using pyodbc facing below issue import pyodbc sql_server_url='server_url' sqlDB='db-dev' SQL_DB_USER='user' SQL_DB_PASS='123' conn = pyodbc.connect('DRIVER={ODBC Driver 17 for SQL Server};SERVER=' + sql_server_url +';DATABASE=' + sqlDB + ';UID='+SQL_DB_USER+';PWD='+SQL_DB_PASS) Error: ('01000', "[01000] [unixODBC][Driver…
I am trying to access Azure Data Lake Storage Gen2 with a Service Principal via Unity Catalog. Managed Identity is added with Contributor Role assigned to the storage account Managed Identity is added as a Storage Credential the storage container…
Unity Catalog is the Azure Databricks data governance solution for the Lakehouse. Whereas, Microsoft Purview provides a unified data governance solution to help manage and govern your on-premises, multicloud, and software as a service (SaaS) data. Question: In our same…
I'm trying to set up the external location for the unity catalog. it was able to connect to storage while trying to test a connection in which storage access is limited to selected vnets and ips. but I'm getting a…