Databricks Interview Questions Part 21

[@isenhiem]

Amazing content!!! Very well planned and detailed....I would like to list down some of the questions that I have faced recently. 1. Automated unit testing and integration testing for Databricks notebooks. What kind of scenarios can be tested. Can automated testing for databricks notebooks be an overhead sometimes. 2. Can databricks jobs/notebooks be deployed as packages/wheel files. 3. How is DBX unity catalog different from hive meta store 4. When do we prefer to use Spark SQL over pyspark