Жыл бұрын
Жыл бұрын
2 жыл бұрын
2 жыл бұрын
4 жыл бұрын
4 жыл бұрын
5 жыл бұрын
5 жыл бұрын
6 жыл бұрын
6 жыл бұрын
6 жыл бұрын
6 жыл бұрын
Пікірлер
@datum1353 5 ай бұрын
Is there any way to enable SCC for already created ADB workspace?
@MarcValk 6 ай бұрын
Thank you Mohammed for explaining all of this. One question: In your video you created 2 separate VNETS, 1 specific for databricks and one for the Client VM’s. Would it also work to create one VNET consisting of the 2 Databricks subnets, 1 subnet for the private endpoints and some more subnets like the client workstations. So everything in one VNET, or is that not recommended?
@Est0qu3 7 ай бұрын
Super useful. But I have one question. You mention about one workspace just for browser_authentication. I do not see where you were creating it. Could you explain in more details please?
@azurelearner4055 8 ай бұрын
Really helpful!!
@azurelearner4055 8 ай бұрын
Hello Sir can you please create video for networking part of azure data factory privately connecting to azure sql ,storage and on prem resources
@raviy10 9 ай бұрын
Great Video, Nice explanation !!
@litan5006 9 ай бұрын
thank you. you did great on explaining the setup. the databricks should hire you to post conents.
@sudhirkaramchand 9 ай бұрын
I ran into an issue while creating IP access list. Added my only public IP to the access list and after reboot my IP changed and unable to access the workspace. Is there a way to fix this restriction ????
@thewaterboy2013 9 ай бұрын
TY for this. I needed to check myself on if I was missing something with route tables. I wasn't quite missing something, just not giving it enough time to propagate (and the vm I was trying to hit also had its own windows firewall in the way of what I was testing hahaha).
@sudhirkaramchand 9 ай бұрын
Where do I run the commands to check the IP access list enabled or not ?
@andriikhavro8366 10 ай бұрын
Is it possible to assign Synapse RBAC roles, such as Synapse Contributor, this way?
@JacoBrits24 Жыл бұрын
Excellent video. Question, I need to pull data from an internal Api that is not publicly accessible using a spark pool. Do you have any idea how to achieve this?
@ruffsense Жыл бұрын
What about DNS resolving?
@harryjain31 Жыл бұрын
wow, it is so much clear now.
@sruthireddy1979 Жыл бұрын
great
@tadzikspolsky2337 Жыл бұрын
AMAZING!!! This is what I was looking for! Great, great technical explanation with all details. THANK YOU!!!
@luisdavila1075 Жыл бұрын
is it possible to change a NSG after deploy databricks?
@Stateoftheheart Жыл бұрын
Great series, very helpful! Thanks a mil!
@Stateoftheheart Жыл бұрын
Really helpful! Thanks a million for breaking this down!
@prathaps2926 Жыл бұрын
Can you please make a video on how this configuration works on Private endpoint as well? I've created the same config through terraform and we have DNS proxy enabled on Hub Vnet and the Databricks is sitting on Spoke Vnet. I referred various documentation but seems like I'm unable to do configure this with Private endpoint part
@noorbashashaik2124 4 күн бұрын
Hey, at 11.26, the author says the public subnet will have the public ip addresses but the documentation says there are no no public ips and public subnets right? basically the word "public" is used just for abstraction purposes.
@Nopenuttn Жыл бұрын
Great video. Question, if the option to enable managed vnet is enabled on the Synapse Workspace during creation, do I have to used private endpoints on my data lake storage and to the Synapse workspace? Can I create these at a later time?
@adityapratapsingh4480 Жыл бұрын
Hi I have give access to entire organization for poc purpose and i am getting powerbientity not found exception
@JuliaShub Жыл бұрын
Great video, any chance you have a working terraform solution for this configuration?
@JuliaShub Жыл бұрын
Great video - it explains a lot - thank you! When we use this type of VNET Injection - does this mean both our control and Dataplane are in the same pre-given VNET? I would like to use an existing VNET and only to create new subnets for it
@prashantmait07 Жыл бұрын
awesome work brother
@N3ON_R3D Жыл бұрын
What's the use of granting access to managed identity credentials to data engineer security group. ? I am trying to create two security group, one for data engineer and another one for adv data engineer. I want to set permission to certain linked service accessible only by specific security ad group. Is that something possible?
@MohamedFaisal6 Жыл бұрын
@@rdpData BY default synapse is looking for MangedIdentity credential access for any user to debug and preview data(which is a common task done by data engineers). Creating separate credentials using user-managed identity and providing access to individual Security AD groups doesn't have any effect on access control. Managed identity credential access is taking precedence over other credentials.
@ankitdagadu510 Жыл бұрын
I really appreciate your work, the series is really helpful. Databricks platform/Networking related videos are rare on YT thanks for putting efforts and helping the community. If possible for you to create a video on External Metastore configure with SQL/Postgres, Trino/Presto on AKS/VM
@nikofeng8447 Жыл бұрын
Love it man, really appreciate your explanation, helps me a lot
@tamimthaher2405 Жыл бұрын
one of the best , Keep it up !
@tamimthaher2405 Жыл бұрын
keep it going, it amazing brother. Jazak allahh khair !
@tahmeedhossain2910 Жыл бұрын
Does it take less time to refresh if I am triggering a refresh of a power bi dataflow in Azure Datafactory ?
@coenvandekamp7556 Жыл бұрын
Excellently explained Mohamed! Almost everything works, only when I do a Create External Table (New SQL script) in Synapse, I get a failed to detect schema. Strangely enough, the preview works. Any idea what could be causing this? ps. I have added Storage Blob Data Contributor role to my user account.
@pesetskyps Жыл бұрын
Great job! Very detailed, but concise
@swarnadeep87 Жыл бұрын
Your explanation is so engaging because of the clarity it provides. I was in dire need of the information that you have given in this video, organized in this way. Also, saw your 3 year old video first, so this video was a very pleasant discovery! Thanks! Please make more videos. I think I will be a databricks expert if I learn from your videos!
@johnbonino6630 Жыл бұрын
Fantastic walkthrough and demos - very much appreciated!
@sunilgidwani6321 Жыл бұрын
Why do we need to create a private endpoint for data plane and control plane connectivity, if the connectivity between them happens through a relay using Azure Service Bus ?
@FarazAbbasi_html Жыл бұрын
Had a requirement to implement a VPN restriction for Databricks, and after a lot of trial and error finally landed on this solution. We chose to use IP Access List instead of the private endpoint solution because I didn’t want to have to rebuild the workspaces we had already stood up. Wish I saw this video 6 months ago, it would have saved me a lot of time!
@MAMIR_BLOG Жыл бұрын
Thanks for such detail information, one question, if the user machine is not a cloud VM (under MainDataVNET), but it is a laptop connecting from corporate network through VPN/P2P/Express Route, does the FrontEnd Privatelink scenario (between user and data plane) still needed?
@coding3438 Жыл бұрын
Thanks for the work you do brother
@sunilgidwani6321 Жыл бұрын
I would like to express my gratitude for sharing the recorded session here. The information provided during the session (Part 1 & 2) was incredibly valuable and will be a great resource as I move forward with the project, I are looking forward to the next session on Front-end private link.
@mohammedsafiahmed1639 Жыл бұрын
excellet video brother! At 21:50 you said if we only need access to sql pools then we dont need to secure data lake, but you need to specify that this only goes for dedicated sql pool as serverless sql pool and apache spark pools use data lake as storage layer. Cheers!
@habeebmohammad6951 Жыл бұрын
Good video, brother. This is exactly what I'm working on now. NPIP Databricks workspace creation.
@safkaify7875 Жыл бұрын
Very useful video. Thank you for sharing your knowledge. Before watching this video, I was not clear on how to user Azure Active Directory groups to connect to Azure SQL Server and run queries on it.
@ketanshah9082 2 жыл бұрын
Mohamed amazing video and the way you demonstrated the whole thing with white boarding and demo makes it super clear! Thank you so much for your efforts in helping the community learn!
@chittillavenkataviswanath1389 2 жыл бұрын
This is by far the best video on the Azure Databricks VNet Injection and it's basic architectural overview. You deserve the best recognition.
@chadical3151 2 жыл бұрын
I greatly appreciate the firewall and routing explanation. Azure documentation mentions the public IP addresses you mention but all of their docs are so scattered and do not present a clear working model for using a vnet with routing and a firewall.
@Fall90 2 жыл бұрын
Amazing !! You’re good at this
@oksanakorol262 2 жыл бұрын
Excellent! Must see for anyone setting up Synapse.
@naunihalsidhu 2 жыл бұрын
This was excellent one. Can you also include section on how to connect to Azure SQL DB and On-Premise SQL server all Locked to VNET
@naunihalsidhu 2 жыл бұрын
@@rdpData Without DEP
@raviv5109 2 жыл бұрын
Thank you soo much for making this video. Well explained and in details! Simply have no words to thank you. These things cannot be found in any documentations.