Power BI End to End Churn Analysis Portfolio Project | Power BI + SQL + Machine Learning | 2024

[@NIKHILSINGH-gb7pc]

Hi Sir, It's a really good video. I have a suggestion: instead of loading data into Excel and then using it in Jupyter Notebook, we can directly connect to the database and use that view for our ML algorithms.

[@pivotalstats]

Hi, Thanks for a great suggestion. I did consider this earlier and used the pyodbc library to fetch data from server. However this method sometimes gives errors due to accessibility or drivers. So I didn't want the new learners to get discouraged by this, hence decided to keep it simple. Let me know if you have used any other library which makes the process simpler. Will be really happy to learn & use it in my next project. Thank you so much for watching! :)

[@NIKHILSINGH-gb7pc]

@pivotalstats Sir, I have used 'from sqlalchemy import create_engine', but you are right; initially, during connection, it gives a really hard time due to drivers.

[@critiquessanscomplaisance8353]

You've outdone yourself again. Thanks so much for giving this for free. Please do more projects like this using different data sources and different data analysis tools and techniques. Stay blessed!

[@pivotalstats]

Thanks, will do! :)

[@prasannajeetojha432]

Please upload more project like this I want to do more like this(Power BI + SQL + Machine Learning) No other people are doing it. You're a GEM man! Love you

[@pivotalstats]

Will do! Thanks for the support :)

[@prasannajeetojha432]

@@pivotalstats waitinggggg!!!!

[@sachinsinghsoun8329]

It is a great end to end project, from getting a understanding about how data is converted from a raw data to visually appealing dashboard. Thanks alot.👍🏻

[@pivotalstats]

Welcome :)

[@MirjaShahidulIslam]

One of the best Power BI tutorials and teachers. Thank you very much from Bangladesh.

[@pivotalstats]

Thanks for the support :)

[@atienograce2520]

Just finished this project.I’m in awe of how well you took us through it!I’ve learnt so much and will definitely add it to my resume.I understood everything,you are incredible!! Keep up the good work👏🏽

[@pivotalstats]

Wonderful! Sure, will do :)

[@santhukontheti4950]

I got 77k customers suddenly instead of 6318 ..after completing the steps of churn by services..What can be the reason ?

[@mayoLJS]

This is a beautiful and complete project. Kudos! Replicating for my portfolio 😍😎

[@pivotalstats]

Glad you like it!

[@premkumar-on8ko]

One more nice project and concept of implement SQL + power bi as wel machine learning . thank you for nice video

[@pivotalstats]

You are welcome :)

[@divyanipathak1087]

It is really very good project implementation. End to End.

[@pivotalstats]

Glad it was helpful!

[@lavenya1999]

Hi sir , thank you i just completed this project and i am adding it to my portfolio. You are a great teacher . Looking forward to more videos from you .

[@pivotalstats]

Thanks :)

[@James_Tana]

Thank you very much, such a great lesson! Hope to see such a good project from you.

[@pivotalstats]

You are welcome! Sure 👍

[@muhammadahmad6570]

Great. It is really very interesting project. I really learnt a lot from this.. Keep doing good work. Good luck..

[@pivotalstats]

Thanks a lot :)

[@ghizlanechtouki]

it is very helpful with amzing explication

[@pivotalstats]

Thanks :)

[@anmolmahajan2868]

Really loved the video. Good way to bring everything under on roof. Looking forward to more such content.

[@pivotalstats]

Thanks a ton!

[@femiajewole6891]

This is a nice project. Well done.

[@pivotalstats]

Thank you very much!

[@kragondraken5352]

Wow... Just Wow Thank you soo much for this wonderful project.....this means a lot

[@pivotalstats]

Thanks for watching, cheers!

[@donanalytics]

This was great and very helpful, thank you!

[@pivotalstats]

So glad! :)

[@AnupGupta-z9x]

your channel is under rated sir you will achieve great success in future😊😊

[@pivotalstats]

Thank you so much 😀

[@chathurangimadubashini8767]

yes agree, such a helpful channel needs more subscribers.

[@MRMICKY-xy8zm]

Thank you so much SIR!!!

[@pivotalstats]

Most welcome!

[@charrynsasitube]

Thanks for the project, it's very interresting

[@pivotalstats]

Glad you like it!

[@goldylock]

Bro ure a legend!

[@pivotalstats]

Thanks for watching buddy 👍

[@bidhanpant8361]

Loved it like a adventure movie ❤

[@pivotalstats]

Thanks for watching :)

[@AmitYadav-ee7sz]

Hi Sir, Please make more such videos (SQL + Power BI + Python). It was really helpful. Thank you.

[@pivotalstats]

Sure I will. Thanks for watching!

[@GARDUITO]

This is awesome!

[@pivotalstats]

Thanks 🙂

[@monubhaiya9022]

Hello sir, how are you? We don't talk or chat, but we've learned a lot from your videos. We're very grateful for teaching us, sir. Hope you're doing well and staying healthy

[@pivotalstats]

Hello, I'm doing very well. Thanks for asking 🙂. Really glad that my videos are helping. Cheers!

[@ChainWaveInsights]

No option of Don't summarize from this in sum_of_monthy_sales in power Bi help me

[@nextgen-nk]

New to it great work 👍👍

[@pivotalstats]

Thanks !

[@xiamojq621]

Respect to the world of India

[@pivotalstats]

Cheers!

[@ElMatador-w7q]

Isn't removing duplicates from single column (as we did in mapping) will affect the analysis outcome since their corresponding values in other columns are there in the data?

[@pivotalstats]

Hi, no that will not impact because we are working on a separate table. When the relationship is created between mapping and main table, it will assign relevant age group to each row.

[@dontcaredaniel8079]

Thank you sir ❤❤❤

[@pivotalstats]

Most welcome 🙂

[@Sanj20101]

Thanks Bro. one question, why did we create new reference table for Age group instead of creating new column in existing table?

[@pivotalstats]

Hi, The main reason is to improve performance because in a reference table we can remove duplicates and reduce the row count. Also in future if I decide to add more mapping columns then its easier to manage in a separate table.

[@Sanj20101]

@@pivotalstats great, thanks for the explanation

[@nkechiizeji]

Sir, thank you for the video. However, I don’t understand the creation of that production table at all. Similarly, what is the downside of removing null values at the time of importing the table instead of the rigorous activity later?

[@pivotalstats]

Glad you liked the video! 1. Creating a prod table is considered as a best practice because it gives you the opportunity to revert back to the original data in case you make any errors without running the entire data load process again. 2. We can always do the data cleaning part in power bi, but the problem with that approach is that in case you are working with a team, and all of them are working on the same data. Then each of you would have to do the same cleaning process on each of your files. Also lets assume that after sometime you add a new cleaning step to your file then that steps will have to be implemented on all files again. Hope this helps!

[@nkechiizeji]

@pivotalstats Thank you so much for responding promptly. That's awesome. Pardon me if am being slow here, however, regarding the first question, how that production table was created was fast so I didn't get it even though I understand the reasons for the creation considering the fact that am more used to PowerBi than SQL. Regarding the 2nd part, I meant the initial time you were importing the file into SQL you didn't ignore the null values but you later tried to remove them during the query. Is there any special reason to it?

[@shankarmidatala2049]

Hi, Thanks for the wonderful learning video. I'm able to follow and re-create all the charts, I'm just encountering one error in the Churn Reason sheet is showing "The Total Churn" against each of the rows (1732) and also the total is showing as (1732). Please guide.

[@pivotalstats]

Hi, Check the table from which you are dragging the Churn Reason column into the visual. Most probably you are using the Prod_Services table. Instead fetch it from Prod_Churn, that will solve the issue. Hope this helps!

[@shankarmidatala2049]

Yes, that worked. Also when I changed the relationship between the tables to "both" it worked as well. Thanks for you quick response.

[@ShantanuShirkar]

What key points should i use to describe this project on my resume

[@pivotalstats]

Hi, Since this project covers almost all major aspects of Data Analytics, you can write SQL Database Management, Power BI Data Transformation & Visualization, Data Analysis & Random Forest Modelling.

[@patricketesam8611]

This is a perfect video and helpful thank you very much!!!! can i connect with you in linkedin sir ? thank you

[@pivotalstats]

Glad that it helped! Sure, I'm not very active on linkedin but I'm planning to post content there as well. You can follow my page below: www.linkedin.com/company/pivotalstats/

[@atulverma_]

Hi, Awesome Video...Really helpful. However, i am unable to understand where did the concept of VIEWS was handy while doing the churn analysis. Did i miss anything?

[@pivotalstats]

Hi, Glad you liked the content. Yes we have used those 2 views at the very end while creating our machine learning model.

[@atulverma_]

@pivotalstats that's why I missed it. I tried to practice only the churn analysis part. My bad. On a side note, I checked out a few videos of this channel, the content is pure gold. Kindly keep adding more.

[@pivotalstats]

@@atulverma_Thanks, will do :)

[@chathurangimadubashini8767]

Hi, thank you again for the great video. In my work, after creating the reference table ("Mapping age group"), in model view there is no connection between Via Age. Don't know why? I followed the exact path and rechecked. PS: I manually made a connection between them in model view, now I am getting correct results. This isn't incorrect, right?

[@pivotalstats]

Ideally it should have established relationship automatically but doing it manually is also fine.

[@chathurangimadubashini8767]

@@pivotalstats thank you, still working on the project. Now half way is done. ☺️ Thank you once again, and highly appreciate your great contribution. 👏

[@MrSingh-bj6dg]

16:52 i stucked here in sql workbench it shows error (1064) please help me to resolve it

[@pivotalstats]

Hi, it seems you might have made a spelling mistake somewhere in query. Can you copy the query from the link that i provided in description and try again.

[@MrSingh-bj6dg]

@@pivotalstats issue solved thank you .

[@bloggingbyasifali4984]

Hi sir can u please make video on end to end project with large data set using direct query in power bi??

[@pivotalstats]

Sure ill plan something for future 👍

[@mohammedyousufuddinyousuf1540]

I am not able to open the output of random forest algorithm into my excel file

[@pivotalstats]

Hi, Please check the file path that you have given. Also are you receiving any errors?

[@mohammedyousufuddinyousuf1540]

I am getting the correct output but when I am going to my prediction data.xlsx file to see my result it is telling me Excel cannot open the file predictiondata.xlsx because the file or format is not valid

[@ArihantAgrawal-w3z]

can we use mysql also? as ms sql is not there for mac

[@pivotalstats]

hi, check out below link. It should help! community.fabric.microsoft.com/t5/Power-Query/Trying-to-connect-to-MY-SQL-from-Power-BI/td-p/195060#:~:text=Before%20you%20can%20connect%20to,MySQL%20in%20Power%20BI%20Desktop.

[@adityagochhikar6272]

Please tell me how I can connect to the server

[@pivotalstats]

Hope you have installed sql server on your system and using that server name.

[@adityagochhikar6272]

Yes yes thank you for sharing how to fix SSMS server If possible can you share your LinkedIn ID I will love to connect there

[@bharatmeena3576]

Why random forest algorithm that you are used for prediction why not logistics regression?

[@pivotalstats]

You can use any of these ml algorithms but while I was researching on this topic, I found that random forest is the most preferred algorithm for churn analysis.

[@deeptijoshi4235]

can you create video on ssis?

[@pivotalstats]

Sure ill plan something for future videos

[@sambeetpanda6919]

when i am trying to Train Random Forest Model getting error-ValueError: Input y contains NaN. ,how do i resolve this

[@pivotalstats]

The error suggests that the Customer_Status column which is our Y variable (target variable), contains missing values. But in the original data there were no missing values in this column. Could you check if your vw_ChurnData contains null values? If it does then check the ETL process & Original Excel raw data file once more. Hope this helps!

[@KA-ep9ik]

kia baat ha sir g, you are amazing. thanks for this all. I believe you are the only one on KZbin who provides detailed lectures with full access to data and lecture notes. You did this very professionally. can't be better than this. Just waiting for more and more. Could you also please make a video on how to develop websites and how to upload all the projects onto it, as you did for yourself. thanks for this amazing work.

[@pivotalstats]

Thank you so much :) Reading such nice comments really motivates me to bring more quality content. I don't know if web development related content will be correct for this channel, but I will surely plan a video on creating your portfolio page on github. Cheers!

[@imranahmad4575]

where is the dataset?

[@pivotalstats]

Hi, its there in the description. Pasting the link here for your reference www.pivotalstats.com/post/end-end-churn-analysis-portfolio-project

[@ElMatador-w7q]

I installed the SSMS and after opening the server name is not showing. Its empty

[@pivotalstats]

Hi, just found this video. This should help kzbin.info/www/bejne/mJilY6ubd5t8g5osi=_odsU7sDW3KntUQo

[@bharatmeena3576]

HELLO SIR, I am not able to connect server in ssms what is the issue?

[@pivotalstats]

Hi, Check if you are entering the correct server name. I have noticed that many people entered the server name which is there on the video, but you should be entering your server name. Hope this helps!

[@ntsps9614]

Hi, thank you for sharing this awesome project! I am unable to load the data to Jupyter notebook at ML step. Got this PermissionError: PermissionError: [Errno 13] Permission denied:'C:\\Users\\Home\\iCloudDrive\\Documents\\coding_temple\\projects\\customer_churn' Do you know what's wrong with this?

[@pivotalstats]

Try using \\ in ur file path and also move the file to a different location. Hope this helps!

[@ММатьяр]

Hi , I can't connect to your server in Microsoft SQL Studio. Is it still possible to connect? I like this project and would to train on it also. why does this error appear?

[@pivotalstats]

Hi, you won't be able to connect to my server because that is my local server instance. You need to install sql server on your system and connect it locally. Hope this helps!

[@manthanshah1699]

you could have easily created age group column in Calculations table rather than creating refrence table

[@pivotalstats]

Hi, Yes you are absolutely correct, we can create a calculated table as well using DAX here. Thanks for the feedback!

[@SatyamGupta-n8r]

HII SIR , CAN I SHOW THIS PROJECT ON MY PORTFOLIO FOR DATA ANALYST PROFILE JOB?

[@pivotalstats]

Sure go ahead. Just make sure that you make few changes in the colors or visuals. Otherwise they might think you just copied someone else.

[@SatyamGupta-n8r]

@@pivotalstats okay and please create such 1-2 more project for data analysis

[@SatyamGupta-n8r]

@pivotalstats sir when i execute query to check the nbull values in the data set it show the 0 for all columns and I cross verify the data of table in excel and it show the null/blanck values in excel. How to replace null value in MySQL workbench ? Should I replace clean in excel Help in this

[@SSMB-dw2zr]

Sir , provide data file not working on SQL server , error coming. When 1 error is solved, then another error is coming. It is better for us if you provide all 4 data files link.

[@pivotalstats]

Hi, May be I did not understand the question, but the data link I provided contains only 1 data file (not 4) i.e. Customer_Data. If you are facing errors even after following all the import process I showed in the video. May I suggest you to import that data directly to Power BI and do the transformations like null removal in the Power Query editor, so that you dont have to waste time on SQL server troubleshooting. Hope this helps!

[@SSMB-dw2zr]

@@pivotalstats Sir, the data you provide ,i find multiple errors, 1. Data not loading in SQL server 2. I changed the data structure ,then it loaded same things happened.so i loaded it in my SQL. 3.But multiple things can't be done in my SQL, due data structure. So , sir if you provide Main data file , with working data file , 2 view files , then it will be good for me . Thank you for replying & Understanding the issue

[@pivotalstats]

@@SSMB-dw2zr Here you go, this link contains a excel file which has stg_Churn, prod_Churn, vw_Churn & vw_Join data. Cheers! e3da6ab4-ff6e-4f55-bfa1-a8fb6979d99b.usrfiles.com/archives/e3da6a_ab9ca4f21efb4e6a9c16a94583f064d9.zip

[@SSMB-dw2zr]

@@pivotalstats thankyou sir

[@AncientWonders-g5q]

Awesome sir but i don't know much about SQL

[@pivotalstats]

Thanks. I have kept it very light in this video but still since sql is an essential skill for anyone working with data, you can watch below sql bootcamp video kzbin.info/www/bejne/h3XdaZWbZbFlhrM

[@AmitYadav-vb5bs]

Sir that project is awesome mainly the machine learning portion could you boost yourself to make a more advanced project right now I am finding jobs and they want the best projects because I don't have any work experience. and also sir could you provide me your LinkedIn profile I will tag you with this project.

[@pivotalstats]

Hi, Sure I will definitely try to bring another project soon. And my linkedin profile is sajit-simon.

[@sivakumarrathinam-bm3yu]

Sir your project is very awesome