Azure Databricks - Accessing Data Lake - Using a Service Principal

[@prathibhamathews4053]

Excellent presentation Dinesh! Very simple and neat solution! I was struggling with Service principal access issues and thankfully I came upon this video and was able to solve it. Thank you!!

[@sjitghosh]

People like Dinesh makes our life easier. detailed and smart representation.

[@thomsondcruz5456]

Great video. Typically in projects we do the following 1. Mount ADLS Gen2 in Databricks using the same Service Principal Approach instead of writing the code in every notebook 2. Use a Databricks or Azure Key Vault to store secrets

[@DineshPriyankara]

You are correct Thomson. We do the same when the storage is required by multiple processes.

[@manjurao]

Dinesh Sir, excellent presentation, mind blowing for me to get understand on Azure data lake gen 2 and data bricks service usages. Thank you very much.

[@anoopv5790]

Very Clear Explanation. Excellent!

[@meetabhi200]

Nice one Dinesh !! Now concept is very much clear on ADSL access via app registration in databricks

[@fumini99]

REally awesome presentation - thanks a lot!!

[@zewdubelachew8768]

Excellent presentation Dinesh! I enjoyed watching it all the way through. I can't wait to view your future videos!

[@ashutoshkumarsrivastav]

Super helpful. Your explanation is really awesome and organized. Thank You :)

[@tarvinder91]

Great. I learned service principal concept, iam based permissions as well with this video. Very nice content

[@hi_vishy]

Superb explanation.

[@prashanthsagar6284]

Very clear explanation.

[@alexandredamiao1365]

Great video! Thank you!

[@pankajmahra3819]

Dinesh thanks for the Video, highly recommended!!! Ques:- if the data lake is in diff resource group and the databricks is in diff resource group then also the access policy works on the same way or the diff methodology is applied.

[@ecevinoth]

If the security principal used in the databricks has access(either RBAC or ACL permission) to storage account then no problem even databricks and storage account in different resource group. Hope i have answered your question. Note: Resource groups are used to manage the azure components efficiently.

[@ogabeksaidnazarov4022]

Thank you soooo much : )

[@pravinboppuri8189]

Dude really great. Sorted me out how to use SP (no RBAC)+ ACL . A quick question--> Is there a limitation on how many users can have access to the same service pricipal ?

[@DineshPriyankara]

Thanks Pravin, if I understand your question, what you need to know is, how many users can access the DLS using the SP. As far as I know, there is no limit.

[@vivekgarg185]

Thanks for this information Dinesh. Just wanted to know 2 things: 1. What is the use of Directory ID? 2. Is this the same process we should follow for ADLS Gen1? Please suggest.

[@DineshPriyankara]

Sorry for not replying immediately. I am sure that you have found the answer but writing this, it might helpful for others. Directory ID is the tenant id, or your Active Directory ID. You can get it from AD Azure blade. This video is based on Gen 2.

[@kohilavanimurthy1960]

Please do a vedio for accessing through Managed Identity

[@SAMSARAN2108]

Can I pass my SSO credentials that used to login into Power BI to make Databricks connectivity? Please confirm. Regards, Sam

[@guptaashok121]

I was struggling to apply ACL to my service principal, as none of the documentation talks about giving execute permission at container level. thanks.

[@douglasleal4382]

hi, tks for the video. I want table acl and permission with service principal acl. How i make this?

[@anshulbisht4130]

hey do u code in python also ?

[@DineshPriyankara]

Yes, I do :), generally only for data science experiments