89. Databricks | Pyspark | Notebook Scheduling through Event Based Trigger using Azure Data Factory

[@aniketjadhav32]

Hi Raja, your content is very good and we can easily understand the concepts. Please continue the good work and make more videos on Databricks and azure adf

[@rajasdataengineering7585]

Thanks Aniket! Sure, will create more videos

[@sravankumar1767]

Superb explanation Raja 👌 👏 👍

[@rajasdataengineering7585]

Thank you Sravan👍🏻

[@AdityaTyagi-c1m]

While creating trigger 9:55 In blob path begins with you passed event/trigger But folder name is event_trigger How did it got invoked ?

[@shubhamsingh-j5q]

Hi, the trigger is not invoking the databricks notebook. What can be the reason.

[@rajasdataengineering7585]

Hi, seems like event didn't happen. So pls troubleshoot from event side

[@rawaaelghali4452]

what if i have sub directories like i have a container and under it i have to check if a file is created in one of the folders

[@rajasdataengineering7585]

You can specify top most folder under which you want to consider new files and sub folders

[@rajunaik8803]

Hi Raja, how this approach is different from databricks Autoloader. I agree Autoloader is more for streaming data. Any other difference?

[@alluchandrasekhar2992]

Can we do the same task without using databricks?

[@rajasekharamuru971]

Hello sir will you provide training on Databricks course Hope you could reply please.

[@nehalalex9497]

if more than one file is loaded at one point won't code break because you are giving lastfile[0]

[@rajasdataengineering7585]

This code is with assumption of one file at one point. If more files are loaded at one point, logic needs to be changed to handle that scenario

[@aradhanachaturvedi3352]

@@rajasdataengineering7585 hi Thanks for wonderful tutorial . May I know if you have any handy code to detect more than one file upload