Forecasting Future Sales Using ARIMA and SARIMAX

Please join as a member in my channel to get additional benefits like materials in Data Science, live streaming for Members and many more
/ @krishnaik06
Code-Github
github.com/krishnaik06/ARIMA-...
Please do subscribe my other channel too
/ @krishnaikhindi
Connect with me here:
Twitter: / krishnaik06
Facebook: / krishnaik06
instagram: / krishnaik06

[@priyaarora4436]

Every body is using very easy to see "seasonal" dtaa to make youtube videos. If you wanna teach, teach with a highly random data!!!

[@ashishmishra7506]

Most most awaited video for me , Thanks a lot sir 🙏🙏🙏🙏

[@arjyabasu1311]

Pretty complex topic sir...need an intuition video of this !!

[@sid321axn]

really awesome. That is what I m looking for so many days. Good job thanks :)

[@thangasamyp6011]

Super explanation sir. I have thanks to you for my doubts clear from this lecture. Thank you sir.

[@ruvitkon]

Thank you very much. This really helped me on completing my final year project :)

[@abhisheksharma8798]

first differencing (of order=1) has been done to de-trend the data. Once it is de-trended, it should further be deseasonalised by differencing again (of order =12). Thus, we have original data-> order1 differencing -> order 12 differencing. The final data will now start from t=14, and it is then checked for stationarity by ADF. The values of PACF at lag=1, lag=12 (for the final transformed data, after two levels of differences) are comparatively higher than PACF values at other lags (as evident from figures). Thus p has been taken as 1, implying AR(1). actually it is written as 1,1,1,12. p is taken as 1, because it reflects the highest PACF value, means 1 lagged value is highly correlated with its subsequent value as compared to other lag values.

[@kanchanwelcomes]

Kindly make video sir....nd explain on stock market data..take 10 company and kindly make a video

[@alanpalacios7784]

I never understood this at college and now it is really clear with your example. Thanks a lot!

[@huxleyhudson2261]

i guess Im asking randomly but does anybody know a trick to log back into an instagram account..? I somehow lost the login password. I would appreciate any tricks you can give me.

[@johnathanedwin6696]

@Huxley Hudson instablaster ;)

[@eBuddha33]

I am studying on time series from last few days. Thanks for adding this video in correct time.

[@hamzamehmood1318]

Hi I need some research topic for My MScs thesis related to time series. have you any??

[@riyasmohammad9234]

I read an article about sarimax and was really confused. But this video helped me to understand easily. Subscribed

[@dramekandya4918]

Very good teacher, his explication is clear and efficient thank your very much

[@haydnmann7736]

Thank you for Krish-ening me with your knowledge

[@parakhchaudhary7479]

Great explanation man! Thank you for this

[@victoriaharant103]

Great video, very helpful! Thanks!

[@akadiryigit]

It was wonderful video. Thanks for sharing :)

[@theprashantprabhakarjaiswal]

Superb Exppanation Sir. Hats Off.

[@sibamarcel9428]

Great video. Thank you bro

[@nikhilvishnuvadlamudi7789]

at 10:05 - You mentioned that we will accept the null hypothesis. There is correction here - you never accept the null hypothesis, its just that there isn't enough evidence to reject it.

[@viveksivalingam9181]

Yeah you either reject H0 or fail to reject H0 due to lack of evidence

[@simha5top]

This was really very good session on time series .....if possible please upload as session on VAR model , Johansen Test and impulseb response function and forecasting.....with similar data.

[@someshkb]

Thank you for the explaining it so simply...

[@akhileshgandhe5934]

Great. This is very helpful 👍

[@VIVEKYADAV-gc1ti]

I read it same but in a very complecated manner but you make it is easy and orgnise way

[@kvafsu225]

Very nice presentation. Very clear

[@ssvipl64]

Hi Krish, Good coverage of the ARIMA workflow. If the screen is zoomed , it would have been more easy for the visibility of the code.

[@pankajverma29007]

Good explanation. Thanks !

[@sachinborgave8094]

Thanks, please upload Deep Learning further videos.

[@IAKhan-km4ph]

Superbly Done.

[@sounakmondal9094]

Great sir. Very Impressive

[@mohitpande2006]

great teacher, many thanks sir

[@AbhishekMishraiitkgp]

Thanks for wonderful video :)

[@aishwaryanarkar2954]

ua just FAB Thnak you very much for your guidance

[@bsrk2909]

Stupendous !!

[@DP-od4yr]

Thanks a ton Krish Sir, got a job in Flipkart in Analytics coz of ur helpful playlists! Please help supply chain guys like me with problems and tools in that sector also... Plz plz plz

[@shubhankarray2515]

hi can you tell me how did u apply etc?

[@yunistaghiyev8775]

Thank you very much!

[@bharatvadlamudi]

as usual great explanation krish. Can you please discus about some of the model metrics that are used in the industry

[@amirhoseinbodaghi9527]

God bless you

[@saurabhtripathi62]

Thanks it was really helpful

[@ravindarmadishetty736]

I hope we also need to remove the trend if it occurs. As airpassengers data contains both trend and seasonality. If we remove seasonality still we can see an increased trend in data

[@Praveenmanikanta32]

Amazing 👍

[@ambar2595]

You are great. Some feedback, write everything you say in the notebooks and slowly and steadily read them. Form the thought with clear explanation write it down and then make a video, your channel will explode after that.

[@harshvaland1438]

Thank you so much

[@marksathish2783]

thanks for the effort bruh

[@maheshkarigoudar117]

I think we don't accept null hypothesis but it's failed to reject null hypothesis so accepting status quo, it doesn't make difference in output but correct way of seeing it

[@AMANRAJ-jl5ub]

Very true, one should note that you cannot accept the null hypothesis, we can only reject the null or fail to reject it.

[@lakme4604]

thank you krish

[@Praveenmanikanta32]

Thank you ☺️

[@mks7846]

Please keep explaination with code of any real time deep learning project ?

[@adeltousian2769]

GREAT

[@mahesh.khatai93]

Hi Krish , Thanks for the video on ARIMA time series analysis . I have few doubts from the video 1> Regarding Hypothesis testing -- how many times do we need to test inorder to get idea about data being stationary . 2> if ARIMA does not support seasonal data , do we have to make the raw data stationary like in video using differencing . And directly do modelling . 3> What is start , Stop dynamic parameters used in predict functions . Thanks .

[@dikshitlenka]

Hi @Mahesh, Please find the below answers of your question . 1st question- If your data is not stationary by the help of differencing you can make them stationary. In most cases time series data becomes stationary with d=2. 2nd answer- No model supports seasonal data because most of the Time series data are made based on the assumption that time series data is stationary. So you have to make them stationary before using any algorithm. You can make them stationary by differencing. As I mentioned with d=2, most of the data becomes stationary. 3rd answer- start is from which index you want to start the prediction and end is till which index you want stop. It's like a range of index. I believe it make sense now. Let me know if you have any further question. You know how to reach out to me. :)

[@chillbro2432]

@@dikshitlenka I'm very much new to time series. I want to learn Time series. Could you please suggest me any place where i can get to know about time series in detail. Thanks

[@dikshitlenka]

@@chillbro2432 Hi Tammany, you can follow Krish’s videos as well as check out videos from other KZbin channels. There are good blogs on towards data science/medium. You can check out them also.

[@mahikhan5716]

@@dikshitlenka 1. could u please tell me why did he select differencing order for both arima and sarimax as (-,1,-) since he selected seasonal differencing where he shifted 12 times so according it should be d=12 , am i right if wrong what the logic here ? 2. i am clearly seeing this here acf plot and pacf plot sharply declined after starting and it is 1 so how actually define exponential decrease for acf plot in MA ? what is actually shuts off ? 3. on which basis the start and end are selected for forecasting? what's the rules here

[@viveksivalingam9181]

When you do differencing once ( so Integral of order one ), the series 'Seasonal First Difference' is stationary as per ADF test. Then when you make a estimation by using SARIMA model, you should use the transformed series and not the original non-stationary 'Sales' series. Correct me if am wrong Krish ! Cheers

[@aswinaravind2801]

actually no. There are two things which you can do. If you are specifying d= 1 or 2 or any number as per order of difference, then you should provide the actual series. Otherwise you can feed the transformed series and then keep d as 0. Because d will internally do the transformation.

[@viveksivalingam9181]

@@aswinaravind2801 Yes, you are right that can be done as well.

[@sharifalmahmud8071]

@@aswinaravind2801 but in this case he made the series stationary by differentiation 12 steps, doesn’t it make the d=12 ? I am confused

[@lanslans6409]

@@sharifalmahmud8071 i don't think so, d= 1 implies that the series is differenced once

[@abhisheksharma8798]

first differencing (of order=1) has been done to de-trend the data. Once it is de-trended, it should further be deseasonalised by differencing again (of order =12). Thus, we have original data-> order1 differencing -> order 12 differencing. The final data will now start from t=14, and it is then checked for stationarity by ADF. The values of PACF at lag=1, lag=12 (for the final transformed data, after two levels of differences) are comparatively higher than PACF values at other lags (as evident from figures). Thus p has been taken as 1, implying AR(1). actually it is written as 1,1,1,12. p is taken as 1, because it reflects the highest PACF value, means 1 lagged value is highly correlated with its subsequent value as compared to other lag values.

[@vaibhavpandey7398]

Ese teacher pehle mil jate to bht acha hota

[@trainsam22]

Feedback: This is great content, but you move the screen too much. Go slow while moving screen and mouse please.

[@mohithvarigonda9516]

thank you

[@deghanandreddy7168]

Can you please make video on multiple seasonalities in time series forecasting by day wise holiday wise weekend wise sales . Thanks in advance

[@user-uk9pr7nf3e]

this guy makes difference

[@sreenivasshrihaan1318]

super explanation...sir...could you provide ARIMAX with weather parameters...

[@naharaldamer2416]

thank you , I have one question , what is the purpose of converting data to stationary if you will going to use non-stationary data to fit the model and do the prediction?

[@vzinko]

says sarimax in the title, but at no point were exogenous variables discussed

[@paraskumar693]

I am getting good predictions on this dataset using ARIMA

[@txx8302]

Krish, there are so many overlaps of career in data science that I want to know does a demand planner in retail company considered a data scientist as well?... As they are also predicting sales.

[@maryamfarzad4123]

Is there any tutorial for Multivariate Time-Series Forecasting?

[@aryangupta4372]

hi im from 3 years later can you help me please?

[@HemanthKumar-lb4xt]

Good one 👌can u do for R also?

[@ravibengeri1507]

Hi Sir, What approach we should follow when the target variable is following sigmoid or logistic or S curve with respect to time. Shall we still apply Time Series? If we can which algorithm we should chose as it has multiple variables affecting target variable?

[@TechyScientists]

good content, just a clarification, non-stationarity is related to trend, not seasonality and same is true for the ADF, which can check for unit root and hence stationarity but has no linkage with seasonality, please confirm if this is correct.

[@kateeileen6840]

Fantastic, the explanations are very clear. Do you have a whatsup group?

[@technospider1917]

Hey! Krish can you suggest to me which model gives me better accuracy if I have only a 15min dataset (performing time-series dataset).. plz I am waiting for your answer.

[@yonathanwijaya2316]

Hi, I've been wondering.. isn't your plot looks pretty good because you included the forecasted date as training data? cmiiw and thanks!

[@asmareadane3647]

Hi, Krish Naik How to filter-out columns record value using python. For example the column name is HC71. It have 10873 records. the record values are -119,-443,-164,300,250,50,-200,200,...etc. I want to give value >=200 "over",-200 up to 199 "mild",

[@mgfg22]

When we run the ADF test for Sales First Difference, it still rejects the H0 condition. So p value < 0.05. This shows that only a shift makes the data frame stationary. (There is no need 12 shift )

[@roopchoudhuri7755]

Good content, but you should have explained the part where you decide the value of p, d, q in ARIMA with the help of differencing, ACF, and PACF analysis. Should we change only one, or all of it? Lets say in my data the differencing(shifting by) 1 is giving a good stationary graph, and shifting by 12 is not, so in model the d should be 1 right! Here you showed that shifting by 12 gives a good stationary data in you case, then why you chose d as 1. Please explain that part and add it.

[@ancydcunha8121]

I think that the d value is not the number of digits you have shifted rather it is the number of shifts . Since the differencing was done only once that's why its 1. Even the variable name for the first shift was 'Seasonal First Difference'. Hope this helps.

[@ganeshkharad]

its nice explaination but...you should also explain why we are doing what we are doing...like you didn't tell why we want data to be stationary??? what will happen if it is not stationary.... kind of stuff...

[@AhmedMohamed-kr8hf]

Krish, can you please give a session on time series theory .. thank you!

[@nishantjindal4394]

Hey Krish QQ for forecasting which is better Arima/Sarima or RNN is there any comparison?

[@sowmyatushar7487]

good one!! however id like to know how do we predict 3 months of sales for 50 different items at 10 different stores.

[@lns8940]

You need to run this model for specific store and specific item

[@nwabuezeprecious457]

@@lns8940 how do you predict 6 months of sales of different items

[@ShubhanshuAnand]

Hello Krish, Could you please explain mathematics behind adfuller test?

[@triptibhatt3296]

Sir can you please make some tutorial for weapon detection and face identification as one integrated model using transfer learning

[@ashishasashu]

Could you please explain how do you select P and Q value

[@Punkorealist]

Hello, I was wondering if there is a reason why I am getting NaNs when fitting the sarimax model? I have gotten my p =1 ,d= 1, and q =1, but I dont know why I am getting Nans after doing the fitting. any help would be vauable. Thanks!

[@ErSonuSinghh]

Need simple tutorial on multivariate time series forecasting

[@kaushal3731]

Hey krish, Had one query since we are checking for data as stationary or not, but while we passing the value in the arima model, you are putting the actual column which was non stationary

[@SP-db6sh]

Very useful. Please start a series or a paid course on Algo trading.

[@KARANKUMAR-pd6gl]

Oh, bro, I have got placed in the HFT domain in my campus placements at a decent package of 10+ LPA. Can you tell me how is the future scope of HFT/Algo Trading??

[@SP-db6sh]

@@KARANKUMAR-pd6glit's great job, but in this fast moving world one quant need to adapt itself with a latest tools & techs.

[@ArslanMehmood9002]

hey Krish, it would be great if you can explain how we can incorporate different factors in time-series and make prediction on the basis of that ? so that our prediction can have affect of all related factors

[@mohitkhanna8502]

To know the factors affecting the prediction, I think you have a build a regression model. Time series is to predict the future Y based on previous Y values, its univariate analysis based where independent and dependent variable are both same

[@potbot887]

you can try VAR models, even Prophet and Neural Prophet supports additional regressors but all of these require that the additional regressors are available for the future as well.

[@francoc7698]

Thank you Krish, I am using your method to build an ARIMA model to predict a product balance. But when I plot the pred=model.predict(start=90,end=103, typ=levels) line, my graph is showing a "predicted mean value"... meaning all the predicted values are the same and at the bottom of the predicted value, it indicates "Name: predicted_mean" dtype:float64"... so when i plot it it is a constant line.. Do you know why this is the okay? How can I avoid its predicting the means instead of actual values? Thanks!

[@arbaazali74]

same question... can anyone please answer?

[@prathmeshshinde5683]

Sir as you said that the hypothesis ' h0 ' is an assumption that we do . I have a doubt regarding that, what if we in the first case assume that our hypothesis 'h0' is stationary(reverse of what you have assumed) and go on with further discussion, are there in pre analysis done for assuming our hypothesis?

[@samratkorupolu]

I have the same doubt all the time, how do we assume H0, if we just assume viseversa, everything will change, I'm clueless

[@YogeshBiguvu2208]

Hi Krish, I have one doubt here @7:58 Mins. How did you take Null Hypothesis as "Not stationary"?. Cant we take Null Hypothesis as "Stationary" & alternate is "Not Stationary".?? What is the criteria for selecting null hypothesis? is Null Hypothesis always should have negative assumption like "Not stationary", "Not same", Not etc....

[@fasttimeboy]

We have to conduct residual test called Portmanteau to check the model adequacy ! That's missing in your video ! And Also there is no analysis on model reliability on future forecast in terms of confidence intervals !

[@rahulbagal6741]

if anyone at this point got the error just replace your code by for value,label in zip(results,labels): print(label+ ' : ' +str(value) ) in the video it is shown as value;label it will give you error is running as value;label

[@zollen123]

Is it possible to input multiple time series data (vector autoregression) to these ARIMAX and SARIMAX models?

[@aibits4351]

i have used caltrans dataset (5 min interval data for 6 month) for training and testing and this data have seasonality but it does not have trend, so i have used SARIMA model. but this model fails to forcast. any help would be appreciated.

[@Emotekofficial]

I would say "Failed to reject the Null hypothesis" rather than "Accept the Null Hypothesis".

[@sayypridsairam4414]

hey krish, really worth it .. small doubt bro.. how to check score or accuracy for arima or sarimax model

[@TheRohit9463]

for that you need to calculate the MAPE or MAE i.e. mean absolute percentage errors or Mean squared Error

[@ruhulhaque3407]

Hey @Krish Naik. Nice Explanation! I have one query - when to use dynamic=True or dynamic=False , while predicting using SARIMAX inside future_df['forecast'].

[@ruhulhaque3407]

@Tomislav Primorac thanks for replying.. I used both parameters dynamic=true and dynamic=false and my predictions were similar. Only I can find difference in graph. I have used both train set to predict test set for checking predictions. Also I have predicted for time period beyond test set for future. I asked similar query below in stack overflow but didn't get satisfactory answer stackoverflow.com/questions/68092670/approach-while-using-dynamic-true-and-dynamic-false-in-sarimax-forecasting

[@ruhulhaque3407]

@Tomislav Primorac Sure buddy .. I got your point but unfortunately my results were same for both dynamic and static prediction for next 24 months ..Please provide ur mail id , I will ping u.

[@polash1978banerjee]

How do I make SPSS accept triennial intervals (Like 1989, 1992, 1995) in the 'define date and time' options?

[@pushkarshukla9409]

great content. mouse movement is too much/fast and sometimes not necessary :)

[@yashmadhogaria7418]

Hey Krish , i couldn't understand the part on how to choose the value of p and q from graphs .Can you show some variations so we could get to learn the abrupt drop and exponential decay part in the ACF and PACF plots to choose the values of p and q.

[@viveksivalingam9181]

There is not much relation with past values, post 1 lag in acf and pacf plot. Thus you take p =1 and q = 1. The nature of ARMA is that these two will show exponential decay. For AR or MA, either one shuts off to zero.

[@devayanbasu2218]

Basically you understand the nature of the acf and pacf at each lags and check if it's declining sharply or exponentially. This is rather prone to error and time consuming. Normally in industry we use pyramid arima where we run a grid search to find the optimum value based on the akaike information (aic) or bic depending upon your selection parameters. To be sure aic penalizes models with higher complexity so your optimal model may not have the least aic.

[@duztv5370]

@@devayanbasu2218 please could you direct or drop a link that has a video on this method of you know of any. Please

[@ashwin_.0710]

Do you train the model on the original values and not the differenced ones?

[@stonesupermaster]

Hello Krish, thanks a lot for your video. I wanted to ask you if you've read how to apply forecasting models to time series with multiple SKU (like 500 - 2000) considering the efficiency while running it, thinking of using the forecast once every week. I would really appreciate if you can indicate me a study case or real case in which I can take a look at the approach within the code. Thanks in advance!!

[@harikrishnanrajesh3118]

Did you get any help with this for multiple SKUs??

[@swagatamandal7917]

did you get the solution to this problem

[@stonesupermaster]

Not yet! I've been trying on my own but the running time and calibration for each SKU is a huge problem to make it work and using it in the long run...

[@aditidalvi9105]

Hey! even I am working on similar project comprising of multiple SKUs. If you have any idea how to go about it kindly share !

[@galymzhankenesbekov2924]

I have faced the problem of scientific notation in y-axis, how can i convert it to normal one? i am using df.groupby ....sum().plot(), where can i use .format()? thanks

[@yashmadhogaria7418]

Which are the best forecasting techniques often used in Industries ?

[@hamzamehmood1318]

Hi I need some research topic for My MScs thesis related to time series. have you any??

[@nita02215]

Can you please provide reason for why did we use adf test and not kpss test? Also what to do if adf test and kpss test yield contrasting results?

[@afzaaljavaid7168]

Hi Hope you are doing well! We are doing sales forecasting in our FYP. Our project is web base. We have done all the things related to frontend and back end. We are running python scripts in back end. We have a problem about sales forecasting algorithm. We are using an algorithm that just split data into train and test and then forecast it based on test dataset but it not do any future forecasting. Kindly help us how to solve it. The algorithm should give us the future forecast of sales.