End to End Realtime Streaming with Unstructured Data | Get Hired as an Experienced Data Engineer

[@CodeWithYu]

Please don't forget to Like, Share and Subscribe 🥹🙏

[@Wik-sw7pu]

Hi, I wish you reach a million followers and views for your videos. Please upload the source code for free rather than asking to buy a coffee. Students like me don't have enough money to buy a coffee. Please look into these and make the code available for free

[@syednayyar]

Done sir

[@subhasishsarkar5106]

Great work! Please keep these coming! Its a great way to learn following along with these videos.

[@CodeWithYu]

Thanks, will do!

[@adityakalwar267]

Hey Yusuf You are doing great job. Can we please mention the prerequisites for every project because it will save the time people will go learn the basic concepts which you are using in the particular project and it will make them better understanding please mention the prequiste Thank you

[@Sahil-ev5pm]

+1 This will be really helpful.

[@RafaVeraDataEng]

A master piece of teaching/learning after other. Since I follow you I've learnt a lot and improved my confidence face to an interview. Thanks Yusuf!

[@CodeWithYu]

You're welcome Rafael! I'm glad I was able to help. Cheers!

[@renvils]

Awesome Video !!! Thanks for sharing

[@abimbolaobadare6691]

Hi Yusuf, Thank you for all you do, I am really grateful, my question Why did you not use Apache airflow to monitor the changes in the folder and just preprocess when there is a change, or is it the wrong tool for this architecture

[@wiss1998]

Nice Nice Nice work !

[@shubhammahajan9117]

@CodeWithYu Thanks for the video. It would be great to have video on processing image and video data since it is more advanced than unstructured text files. Also there are not much information or live demo on the internet for that. It would be great help to learn them from you and see how you process image and videos data. Thank you.

[@boseashish]

this will help you with a broader idea kzbin.info/www/bejne/emi8Y2WFmZaCq7M

[@BluAngy]

What is the previous video you mentioned around 11:45?

[@jeffphan6330]

Thank you so much for your videos. Can you do video about project using databricks as well?

[@MohamedFazan-w2y]

Great video yusuf

[@thsstphok7937]

Hey If you were starting again with the goal to become a data engineering would you start as data analyst or software engineer? - Im thinking to start learning java to know well backend and migrate one day to DE. Is it a good strategy or is better go in analyst route? Thank you!

[@BeyondNoise9]

Which software are you using when you created new project ? Sorry I’m new to this ..

[@CodeWithYu]

PyCharm

[@ultrainstinct6715]

Hello Yusuf, I hope you're doing well. Concerning the AWS Crawler, it doesn't work for me. I spent the whole day looking for how to solve the error but in vain. Is it a regional issue? Thanks in advance.

[@CodeWithYu]

What error are you getting?

[@ultrainstinct6715]

@@CodeWithYu It's this error: One crawler failed to create The following crawler failed to create: "Ultra" Here is the most recent error message: Account 86#07#37#73# is denied access. Sorry I didn't see your reply.

[@vedanthbaliga7686]

@@ultrainstinct6715 your service account/role does not have access to the crawler. You can either run it via the root user or give permissions to this role

[@raghavendarsaikumar]

Hi Yusuf, Good Work. The last part networks is incomplete in the docker compose file and suddenly how the deployment is successful only for you. Just because we want to pay money for the source code, are you doing this wantedly or correct me if I'm wrong

[@CodeWithYu]

I’m not sure I understand what you’re talking about

[@krishnakumarkumar5710]

Thanks YU

[@adityanjsg99]

Spark structured screaming? Why not kafka?

[@Mehtre108]

Its great videos but How to use terminal commands in windows 10. Could you pls tell

[@CodeWithYu]

Download git bash for windows, you'll thank me later 😄

[@MohamedFazan-w2y]

Can you provide the data source links please?

[@hoduytruong615]

thak u bro, good video

[@Investigationdiscoveries]

Great Project for data engineers? Is there a way to get the data used for the project?

[@CodeWithYu]

It’s in the description

[@TheNextIndustry4.0]

Hi all, Has anyone able to replicate and get the project completed as show ?

[@BeyondNoise9]

Can I mention these projects in my resume ? ..

[@rascanjero8431]

Of course. As long you’re able to fully digest it and describe how and why you would use what you build in an interview.

[@nadiiar75]

🤗

[@Vilayat_Khan]

where is github link?

[@CodeWithYu]

In the description