Manage Azure Databricks using API
6:02
Databricks Credential Pass through
13:08
15 - Unity Catalog - Column Masking
10:53
11- Unity Catalog Managed Tables
9:47
10 - Unity Catalog Admin Roles
10:11
01-Unity Catalog Introduction
6:04
02 Prerequisites for this course
8:13
01-Terraform Introduction
2:12
Жыл бұрын
What is Terraform ?
0:56
Жыл бұрын
Secondary vs Standby NameNode
6:01
3 жыл бұрын
YARN Queue Manager
8:40
3 жыл бұрын
008 HDFS File permission
7:37
3 жыл бұрын
Пікірлер
@ridhamsavaliya556
@ridhamsavaliya556 5 күн бұрын
Ha 😅😅😢
@derekmab7734
@derekmab7734 19 күн бұрын
Thank you very much, so if you had another prod/ directory with tf files you d call the source module in similar way as dev/ ?
@nomaunkhan9141
@nomaunkhan9141 22 күн бұрын
Thank you for simple but a very good explanation
@supriyasharma9517
@supriyasharma9517 27 күн бұрын
hi, thanks for the detailed explanation in the videos. I have seen other links where the trainer has created a SQL warehouse fr the Unity Catalog compute. Should a cluster is created or SQL Warehouse?
@SujitKumarPanda-i9x
@SujitKumarPanda-i9x Ай бұрын
Very good demo
@Gautam-lo5zy
@Gautam-lo5zy Ай бұрын
Can you a video how to enable unity catalog for tables already in ADLS Gen2?
@muruganooty44
@muruganooty44 Ай бұрын
hi, the configuration has been completed and i can log in as ad user on Linux systems.. now I want to know if I push any group policy will it happen? if possible related notes can you give..
@adityamasih9719
@adityamasih9719 Ай бұрын
I’m new to Apache Ranger. I’ve created an HDFS policy and configured it to store audit logs in Solr. When I create or delete directories in HDFS, the audit logs are generated and visible in the Ranger UI. However, when I perform operations as the superuser (hdfs), no audit logs are generated. Does Ranger not support audit logging for superuser actions? I have already checked all the configs and there are no exclusions to any user.
@agyaatkavi
@agyaatkavi Ай бұрын
Selected user account does not exist in tenant 'Microsoft Services' and cannot access the application '2ff814a6-3304-4ab8-85cb-cd0e6f879c1d' in that tenant. The account needs to be added as an external user in the tenant first. Please use a different account. AADSTS500200: User account is a personal Microsoft account. Personal Microsoft accounts are not supported for this application unless explicitly invited to an organization. Try signing out and signing back in with an organizational account
@princeogabi4397
@princeogabi4397 Ай бұрын
Thanks mann! This is easily the most comprehensive playlist on AWK. Plus you make it really easy to understand. God bless you man
@SatyabrataMuduli-c9w
@SatyabrataMuduli-c9w Ай бұрын
Is it possible to consume data using delta sharing in databricks without enabling unity catalog ?
@mainuser98
@mainuser98 Ай бұрын
Will deleting the managed table also deleted the files in the storage account?
@aminullahyousufi8142
@aminullahyousufi8142 Ай бұрын
THANKS for the explaination. can you please tell me how to upload file to hdfs from my windows?
@josemanuelgutierrez4095
@josemanuelgutierrez4095 2 ай бұрын
I have a question , why you decide to connect like that using tenant and creating an app registration ? what kind of advantage does that have ? can you explain pls , thx so much
@HadoopEngineering
@HadoopEngineering 2 ай бұрын
There are multiple ways to access ADLS container from Databricks. Using App registration is one one the method. Similarly we have credentials passthrough , connect storage using storage key and SAS key option also available. However databricks recommends to use unitycatalog external location for accessing ADLS
@calvinharris4771
@calvinharris4771 2 ай бұрын
thanks for the video💌
@mandardegvekar5260
@mandardegvekar5260 2 ай бұрын
Will this share give read only access ? Or will it be read write both?
@cthanus
@cthanus 2 ай бұрын
Thank you !
@MehtabMeghwar-kr
@MehtabMeghwar-kr 2 ай бұрын
amazing videos
@NehaGupta-lf1sr
@NehaGupta-lf1sr 3 ай бұрын
thanks for creating such informative videos
@Matt2010
@Matt2010 3 ай бұрын
To NextGen, the subtitles here are not correct for English, and since you speak English pretty well even I am hard of hearing too, be best to have google auto translate to English, i do generally need this cause i don't always hear everything correctly.
@HadoopEngineering
@HadoopEngineering 3 ай бұрын
Thanks Matt for your comments..actually these subtitles are auto generated.. I will try to add subtitles..sorry I am not a native english speaking person so lot of mistakes 😞 English is my third language only
@Matt2010
@Matt2010 3 ай бұрын
@@HadoopEngineering Yea I know from Hindi, however you are not speaking Hindi and that's the problem.
@Matt2010
@Matt2010 3 ай бұрын
It should just be "English - (Google auto-translated) to English but is specifically for those with hearing loss thats the intention you want to do. but this can apply to other languages but you must from source be correct about the language since you're not speaking Hindi. Wrong settings basically!
@rajarajan-o2t
@rajarajan-o2t 3 ай бұрын
Is it possible to create new azure subscription by using terraform
@diegoramos27
@diegoramos27 3 ай бұрын
is the keytab file used to authenticate against the KDC? Thanks
@quazimoinuddin5927
@quazimoinuddin5927 3 ай бұрын
Sir what is size of monitor screen you use . Just asking for reference 🙂. I am also looking to buy one monitor for ease of my work.
@HadoopEngineering
@HadoopEngineering 3 ай бұрын
I am using LG Monitor , Purchased in 2021 , still running without any issues. I paid 12K at that time now it is reached 9K INR. LG Electronics 60 cm/24 inches Full HD IPS 1920 x 1080 Pixels LCD Monitor, Inbuilt Speaker, HDMI x 2, VGA Port, 75 Hz Refresh Rate, AMD Freesync, 3 Side Borderless Slim Design - 24ML600S-W (White) .
@connect_vikas
@connect_vikas 3 ай бұрын
Need help, could you please add what permission required. I am getting error invalid stream on failed message
@MonuChoudhary-dm4ww
@MonuChoudhary-dm4ww 3 ай бұрын
nice explanation with demo
@luisherneymedinajimenez6314
@luisherneymedinajimenez6314 3 ай бұрын
You are awesome
@IlikGamingKZ
@IlikGamingKZ 4 ай бұрын
Good job
@NileshKharat-sp5kx
@NileshKharat-sp5kx 4 ай бұрын
Hello Sir, Which course should i do for databricks administrator
@HadoopEngineering
@HadoopEngineering 4 ай бұрын
Please email me..I am going to start a new training batch.
@somesh512
@somesh512 4 ай бұрын
What is credential passthrough?
@HadoopEngineering
@HadoopEngineering 4 ай бұрын
one of the ways to access storage container . I will be publishing the video on credential passthrough
@tomsilva8664
@tomsilva8664 4 ай бұрын
Thank you for this simple and helpful video. Just enough information to learn the basics and build up from here.
@DannyZhang
@DannyZhang 4 ай бұрын
Great video. Thanks. Noticed on your video, you published a message with name = "Jon", then next sent a message with name "Raj". however, on your query result, Row 1 is "Raj" whereas Row 2 is "Jon", i was expecting the first message sent to be Row 1, which would be "Jon". Any thoughts?
@RifqiArdian-uz7tx
@RifqiArdian-uz7tx 4 ай бұрын
audio please
@prem9543
@prem9543 4 ай бұрын
where did you learn it please, is it from a book or data bricks live demos
@TheDataArchitect
@TheDataArchitect 5 ай бұрын
I did all the same, but getting below error, when i test the connection its working fine, but when i run the pipeline it immidiately terminates with the below error: Input Payload is invalid, validation result - '["Connector or activity name: ADLS_GEN2_LINKEDSERVICE, connector or activity type: AzureBlobFS, error: Calling partner RP EvaluatePolicyAsync returned an invalid status code 'Conflict', ReasonPhrase Conflict","Connector or activity name: AzureSqlDatabaseScalez, connector or activity type: AzureSqlDatabase, error: Calling partner RP EvaluatePolicyAsync returned an invalid status code 'Conflict', ReasonPhrase Conflict"]'
@nileshtiwari9376
@nileshtiwari9376 5 ай бұрын
can someone explain to me how to access files stored in ADLS container of the storage account which Managed storage account by databricks, actually It has some files that that I want to fecth and load into the unityt catalog table
@sandeeprajwar3722
@sandeeprajwar3722 5 ай бұрын
Very informative!! Appreciate the work..
@petermuia9519
@petermuia9519 5 ай бұрын
Hi, just a quick query. When I run the "kadmin -p", I am getting the following error : kadmin: Cannot contact any KDC for realm, while initializing kadmin interface I have ensured I can telnet to port 88 & I do not have ip address issue nor the hostname. I have ensured my /etc/krb5.conf & kadm5.acl conf files are duly updated . Where else can I get.
@manasr3969
@manasr3969 5 ай бұрын
Amazing series. Extremely Helpful and wellput demos. Thank you my friend.
@MhmdGhdbn
@MhmdGhdbn 5 ай бұрын
Much appreciated!
@techscript403
@techscript403 6 ай бұрын
is it possible to use in production environment ?
@ghb323
@ghb323 6 ай бұрын
Umm, you forgot the required software in order to download docker images, like, what is this at 1:17?
@mahender551
@mahender551 6 ай бұрын
my job is failed to load, please suggest, asking for service account, network, subnetwork, asking to fill all the parameter details
@GauravJangid-b3p
@GauravJangid-b3p 6 ай бұрын
Great video, Thanks for sharing your knowledge !
@ottawabiju37
@ottawabiju37 6 ай бұрын
Thank you, but I am trying to export the SCC findings to BigQuery export, so created pub-sub topic/subscriptions, BigQuery dataset, and tables. PubSub does not push data to BigQuery (created table schema manually), and could not find the auto-detect schema from the configuration tool. Issue is pubsub data is not exporting to bigquery and could not figure it out.. any help would be greatly appreciated.
@tejagotru5261
@tejagotru5261 6 ай бұрын
Hi bro please make a video on creating a multinode confluent kafka cluster on rhel
@Rajdeep6452
@Rajdeep6452 6 ай бұрын
How to connect the api key to pubsub? Why you show half baked stuff?
@SPA-Tech
@SPA-Tech 6 ай бұрын
One of the best video!!
@dhanaraj5638
@dhanaraj5638 6 ай бұрын
I am very thankful to you for providing such a wonderful series of knowledge. Thank u very much
@LakshmiGattu-o3r
@LakshmiGattu-o3r 6 ай бұрын
Tq
@lakshminarayanag6601
@lakshminarayanag6601 7 ай бұрын
Thanks for sharing video's on UC . I have quick clarifications 1.Once I share UC with recipients', will the data processing happen at provider or recipient? 2.Let's say I have view, RLS being applied on one of the AAD Group and Delta shared. Will RLS applicable on shared view?