85. Databricks | Pyspark | Notebook Activity in Azure Data Factory with Input Parameter

  Рет қаралды 11,950

Raja's Data Engineering

Raja's Data Engineering

Күн бұрын

Пікірлер: 8
@chappasiva
@chappasiva 5 ай бұрын
Hi Raja, very crystal clear explanation. thanks you raja.
@rajasdataengineering7585
@rajasdataengineering7585 5 ай бұрын
You're most welcome! Keep watching
@education4all686
@education4all686 3 ай бұрын
Raja Bhai..Do you conduct any online classes?
@jobabroad-mw9oh
@jobabroad-mw9oh Жыл бұрын
Hi Raja, but you have passed only one table manually in the trigger parameter name called as table_name. lets say i have 10 tables in a database then how can i pass all 10 tables into that parameter dynamically and scheduled that trigger which run every day ?
@shreyanvinjamuri
@shreyanvinjamuri Жыл бұрын
Hello Raja Sir, So the input parameter name (table) created in the ADF and the widget text box(table) name created in the databricks workspace should match right ? So that exact value will be retrieved in the widget, as we may pass multiple parameters from ADF.
@rajasdataengineering7585
@rajasdataengineering7585 Жыл бұрын
Yes Shreyan, that's correct
@surenderraja1304
@surenderraja1304 Жыл бұрын
@rajasdataengineering7585 , What is the max length of string that can be passed to azure databricks notebook, it seems it can accept only 2048 characters
@krishnaginka-m5s
@krishnaginka-m5s 6 ай бұрын
yeah,if you have long string try creating multiple parameters and then concat inside the adb
Tuna 🍣 ​⁠@patrickzeinali ​⁠@ChefRush
00:48
albert_cancook
Рет қаралды 148 МЛН
Enceinte et en Bazard: Les Chroniques du Nettoyage ! 🚽✨
00:21
Two More French
Рет қаралды 42 МЛН
黑天使只对C罗有感觉#short #angel #clown
00:39
Super Beauty team
Рет қаралды 36 МЛН
UFC 310 : Рахмонов VS Мачадо Гэрри
05:00
Setanta Sports UFC
Рет қаралды 1,2 МЛН
How to Run Databricks Notebooks using AzureDataFactory
20:57
GeekCoders
Рет қаралды 10 М.
29. Lookup activity in azure data factory | Azure data factory
13:50
learn by doing it
Рет қаралды 4,2 М.
Azure Data Factory - Accessing a Databricks Notebook with Input and Output Parameters
24:56
Learn Azure Data Services with Dinesh Priyankara
Рет қаралды 13 М.
121. Databricks | Pyspark| AutoLoader: Incremental Data Load
34:56
Raja's Data Engineering
Рет қаралды 24 М.
How to Deploy Azure Data Factory (ADF) from Dev to QA using Devops
13:46
KnowledgeBank by obviEnce
Рет қаралды 42 М.
Tuna 🍣 ​⁠@patrickzeinali ​⁠@ChefRush
00:48
albert_cancook
Рет қаралды 148 МЛН