Docker – Testing Databricks notebook
I am building a data lake on Databricks. Basically, it consists of a pipeline of Databricks jobs, written in Python (and using PySpark for some). Now, I was wondering how could I test those notebooks. Integration test As I have…