Tutorial 2- End To End ML Project With Deployment-Project Structure, Logging And Exception Handling

[@krishnaik06]

Join this channel membership to get access to materials and connect with me: kzbin.info/door/NU_lfiiWBdtULKOw6X0Digjoin

[@fazankabir2029]

OMG OMG Your channel is gold mine. No words to thank your effort for explaining such skills while keeping the content so easy and simple. Please keep contributing (Liked, commented, subscribed & shared)

[@nakul469]

if i am finding this video a little difficult, does this mean i need to work more on my python basics? Building and performing EDA is easy for me.

[@MyyfitnessWorld]

Hi @krish sir, the error in why it wasn't getting logged into the file was because we didn't import the logger.py file as a module in the exception.py file.. Once I did that, it worked for me.. Thanks for the video. Helped a lot in understanding the Project Setup.

[@madi6901]

I did the same. Working now. Thanks

[@nakul469]

if i am finding this video a little difficult, does this mean i need to work more on my python basics? Building and performing EDA is easy for me.

[@G_Keepingitreal]

@@nakul469 I'm on the same boat. I'm wondering how to resolve this.

[@omkarkumbhar3222]

This is the best tutorial of github i ever learn i understood all commands, also about project and things related to project how to set environment and all things ... Amazing Krish bhaiya ...thank you very much 💪

[@kimerared]

Thank you for the series of videos showing the end-to-end code structure. It is awesome!!!

[@arnoldk5415]

Sir. Thank you so much for all the work you do. You are a national treasure!!!

[@esfantastic-shorts]

Sir.., First you have need to open .log file then we will logging successfully into .log file... Thank you sir ❤❤ to helping a lot..

[@bevansmith3210]

Gosh, its like watching a master guitarist play an amazing solo

[@sohelshaikh1171]

currently doing a DS internship, it was my first time training an model in the actual industry with real life messy data. if you looked at my task folder you'll probably catch a fever, I know I did (⊙ ⊙;). This video will help me in my future endeavors. Thanks! about the error not being logged, we haven't import our logger script

[@zzzmd11]

Thank you so much for the excellent set of video tutorials. Hats off for the great dedicated work..

[@nani543]

So helpful! Thank you so much you are such a good teacher!!!

[@nafeuhassanhelal1581]

Brother,i am from Bangladesh. i am watching your videos.. it's so helpful. keep up good works..

[@ayushimalaviya8416]

Really like the way you explain. Nice work sir!!

[@list10001]

Amazing tutorial. Appreciate your effort.

[@souvikbasak7094]

Enjoyed, learned as well as executed it!!! Thank you so much sir!!

[@radhekrashna2148]

Thank you so much for working hard to create such a quality content for us Really you are great work I am very thankful to you I will look forward to next video and series of same type

[@sujojohn2948]

Thank you so much for all the effort you took explaining this nicely

[@shikharawat8096]

This is so so so great. Thankyou for this Sir.

[@rupindersingh1312]

thanks for this lecture date - 9-7-2023

[@bivasbisht1244]

this is just beautiful , no words for krish

[@mahdiaspanani8004]

I don't have enough words to say thanks to you.

[@nakul469]

if i am finding this video a little difficult, does this mean i need to work more on my python basics? Building and performing EDA is easy for me.

[@photonplus2838]

Beautiful Explanation.

[@sandeeppvn0503]

Amazing video! Its a solid bridge to transition from academics to industry! Thank you Krish! Ther is one issue I encountered, def error_message_details(error, error_detail:sys): in this, the type casting to sys is showing up as an error on vscode: Module cannot be used as a type. Could you please help me out how to resolve this?

[@themuslimview]

I am facing the same issue. Any solutions?

[@GauthamRajS]

import sys

[@gnanadeepch5065]

DS GOD. He needs to be pushed to TED Talks. He can touch many more insecure Engineer lives.

[@robinchriqui2407]

Thanks Krish for your tutorial!

[@sagarthacker96]

Hello Krish, I enjoyed watching your video and getting to learn new stuff from it. I wanted to ask is there a reason why we created a logs directory structure as `logs/file_name.log/file_name.log`. In the middle there is a directory named same as the filename. Do we actually need the directory or is that a common practice in the industry? Thank you! Looking forward for more such videos!

[@rabeegheni1224]

i am wondeing same thing, did you find an answer?

[@sagarthacker96]

@@rabeegheni1224 Nope, I still couldn't find an answer for that.

[@mathsmoz5353]

Hi, I think it's it was an error he didn't notice. I ran it with the code snippet below and it work's well for me: LOG_FILE = f"{datetime.now().strftime('%y_%m_%d_%H_%M_%S')}.log" logs_path = os.path.join(os.getcwd(),"logs") os.makedirs(logs_path,exist_ok=True) LOG_FILE_PATH = os.path.join(logs_path, LOG_FILE) Hope it will help.

[@sagarthacker96]

@@mathsmoz5353 Got it. Thanks!

[@AmbarGharat]

Basically you didn't join LOG_FILE in logs_path variable. @@mathsmoz5353

[@javeedtech]

Waiting.. Is it an alternate day series..? Thanks

[@shehrozeshahzad4363]

Love you Sir Thank You so much!

[@suyashshrivastava8317]

Brilliant!!

[@SaurabhSingh-oi5ev]

Import logger into the exception file which will trigger the logger and your log file will be created..

[@sahilpatel2187]

outstanding

[@AI_Aficionado]

Dear Krish could you please suggest how do I add sales experience for Data Scientist role will this add any weightage for the resume or should I go completely as a fresher, I have experience in Auto, banking and telecom industry @Krish Naik

[@akj3344]

Hey I had some sales experience and switched my career to Software Developement. Your sales experience does not matter at all. Mention it on your resume but apply as fresher.

[@AI_Aficionado]

Thanks for the suggestion bro I did the same

[@sibaprasadnaikbehera3442]

just we have to import logger then log file will be created

[@subhashdixit5167]

Thanks once again

[@neilrohra7374]

If anyone is facing issues with Datetime or any library, reinstall the virtual environment.

[@sameertupe6094]

How to do it can you please explain

[@RaghavTigadi-de3xv]

am facing this error No module named 'datetime'

[@neilrohra7374]

Reinstall the virtual environment and it'll be done.

[@RaghavTigadi-de3xv]

@@neilrohra7374 if i re install need to all from beginning?

[@rajkachhadiya6192]

Hello @krishnaik06 I really appreciate your work, it is very helpful for me personally but I have one suggestion if possible then please explain each and every point or command properly so we don't have to take support from others. I can understand your time limit but still little a suggestion for me I hope you will work on it. Thank you

[@VishalSingh-wt9yj]

you are the best sir

[@G_Keepingitreal]

Can someone help me? I'm getting no error when I run the exception.py with the try/catch blocks. In the terminal, nothing is showing up. Similarly, my Log files does not have any logs printed.

[@shalakam1617]

Thank You

[@nagrajwellness9720]

Sir you are genious

[@koblanyamadi8816]

Thanks, Krish for the video it was very helpful. I'm having an error with "levelname" in line 13. error message says Unknown word

[@gajender6075]

from src.logger import logging ModuleNotFoundError: No module named 'src'PS C:\Users\asdf\Documents\D.S\END-TO-END-PROJECTS\Test> find this error that src in not found please anyone can fix it..

[@jerrinthomas1874]

me also same error, how to fix it

[@gajender6075]

@@jerrinthomas1874 no one reply even not krish sir I totally stuck here ..If you get the solution please ping me

[@ebrahimbehrouzian6930]

@@gajender6075 & @Jerrin Thomas , I have the same problem. Please let me know if you could find the solution. Thanks!

[@gajender6075]

@@ebrahimbehrouzian6930 I see the very solution but nothing is working in my case you should try by creting __init__() file in each directory or gave the path in sys of that perticular directory

[@adityagarg7816]

Make sure you have __init__.py in every folder.

[@enamulhaque7135]

Hi @krishnaik06 If I want to develop 10 different projects in 10 different github repositories, do i need to create this setup and environment every time from the beginning?

[@hmtbt4122]

thanks

[@yohnfhayersiregar8233]

hello there, have you finished this? gender_group = df.groupby('gender').mean() gender_group I have been trying, but still error would you share your? how to solve it? thanks

[@jamespaz4333]

We also need Sunny!!!

[@pandalanhukuk804]

First of all, thank you for all the videos and the playlist. I have just one piece of feedback: please avoid using "with respect" in every second sentence. It's often used incorrectly and doesn't add any benefit.

[@nakul469]

if i am finding this video a little difficult, does this mean i need to work more on my python basics? Building and performing EDA is easy for me.

[@ayushratan6452]

hey does anyone know why does'nt the logs file show under git status ?

[@ridj41]

Very complex to understand.. Most of the concepts were unclear

[@vishnukg2058]

Will you use docker, aws?

[@krishnaik06]

yes :)

[@RohiniN08]

Which is the interpreter used?venv is not activating after restarting vs…any help??

[@IsrakJahanSamir]

my logger is not printing the message. it is creating logs folder and file. But the message is not there in the file. If anyone face the problem and solved it or know the solution, pls reach out to me. Thankyou

[@harishs6315]

hi krish, why do we need custom exception handeling when we can handle almost all the execptions using the inbuilt python functionality? Are there any specific type of errors or issues in ml workflow where this is used(cases where the inbuilt execption handeling is not enough)?

[@suleymanerim2119]

I also wonder this

[@ritikaradh]

at 26:40, after running python src/logger.py the log folder and the logger file got created but the message "Logging has started" didn't get printed. Can somebody help me pleasee.

[@shiva-xt2mo]

i think you should recheck your code

[@IsrakJahanSamir]

did you solved it. I am having the same issue

[@G_Keepingitreal]

i'm also having the same issue. Was anyone able to solve this? Please help.

[@parthibanpalanisamy1434]

Please suggest me to resolve the issue which i am getting as below: File "src/exception.py", line 2, in from src.logger import logging ModuleNotFoundError: No module named 'src'

[@randomshortzz]

Same issue brother have you resolved it

[@hitarthshah8199]

Try doing "cd src" if you are running it in cmd, it will work@@randomshortzz

[@AmbarGharat]

from logger import logging use instead src.logger import logging Hope it helps!

[@vamsirenumala3153]

use, from logger import logging

[@nakul469]

if i am finding this video a little difficult, does this mean i need to work more on my python basics? Building and performing EDA is easy for me.

[@utkarshkanojia3193]

Can I do this coding in Google collab

[@preetisain1549]

Hlo sir instead of vs code I can make project on jupter or not??

[@xahidhasan6361]

Same question here. If you already know the answer please let me know

[@ansharora5698]

I am getting the no module named datetime error, while running python src/logger.py

[@pavankurapati6628]

import os import sys # Use a raw string for the file path sys.path.append(os.path.abspath(r'C:\Users\xxxx\mlproject\src')) from logger import logging try this :)

[@vKNemesis]

i have issue in enviroment even my file is not running and I did the same ways what u are doing still I have environments issues as u getting a new file in vs code after running m not able to get those depressed as hell

[@samarmohanty6109]

what's the issue .explain i will help you

[@harishs-dm8mm]

When the part 3 video gonna come

[@krishnaik06]

Today is holi enjoy :)...the video will come tomorrow

[@ShahbazKhan-ph3vd]

😂

[@PavanKumar-ut2lo]

Hi sir, do we need any paid version software for this project?

[@samarmohanty6109]

No

[@PavanKumar-ut2lo]

@@samarmohanty6109 even for deploying tools. Because heroku has no free trails.

[@abhijeetrokade2349]

What is the problem statement?

[@krishnaik06]

We will discuss in the next video currently we are discussing the project set up

[@abhijeetrokade2349]

@@krishnaik06 Thank you

[@barbarafirmino3586]

Krish, I have a simple question but why are you building a project from zero instead of using Kedro or Cookie Cutter pattern? It's just because you are being didactic or there's something else?

[@naraendrareddy273]

He wants us to understand the structure of projects I guess

[@ShahbazKhan-ph3vd]

No. Today Krish will upload 2 videos😅

[@01kumarr]

where is part 1

[@vivekvkini4506]

kzbin.info/www/bejne/iKeZhnl9g9KBkMk

[@rishiraj2548]

🙏💯💯

[@vagheeshmk3156]

#KingKrish

[@deepakgoyal1643]

sir kuch bhi samaj me nhi aaya

[@EvilCherry3]

16:04 You lost your accent here lol

[@tejas4054]

Tum ml sikha rhho ki dara rahe ho itna sara code likh k ,,, backend developer ka kuch kaam nhi hai ml me toh kyu backend developer ka code likh ke dara rhe ho,,, hum data science kare ya na kre phir

[@beAdevops]

Right, Really Need this all kind of stuff ?

[@tejas4054]

@@beAdevops ha na bhai main toh coding dekh k darr gya agar itna hoga toh main to analyst post pe javu

[@Maciek17PL]

for logs you created logs/date.log/date.log, did you mean to create this directory in the middle?

[@zub3rahmed76]

MAKSOOOD BHAI @krishnaik06 , Tum bhohot achha kaam krta hai . Apne ko tumko dil se thanks bolne ka hai . Jaadu ki Jhappi from Mumbai.🫂🫂

[@naveenkumarP-n9q]

Hi Sir i am constatntly getting this error no matter what i have even checked up with chatgpt LOG_FILE=f"{datetime.now().strftime('%m_%d_%Y_%H_%M_%S')}.log" ^ SyntaxError: invalid syntax

[@rajamsameer]

I'm not getting log files 🤌

[@AmbarGharat]

In .gitignore file comment this *.log This will only work if you are able to see log files in your file explorer folder but not in vs code. Hope this helps!

[@kaushalkumar3017]

Thanks

[@poojakallure5808]

Thank you.

[@nakul469]

if i am finding this video a little difficult, does this mean i need to work more on my python basics? Building and performing EDA is easy for me.

[@mdabdullahalhasib2920]

Thanks.