Use Artificial Intelligence (AI) to Predict the Stock Market with Python

[@leandrogoethals6599]

How the flow of a forwardtest such prediction is: Step 1: Download the csv till current date Step 2: Delete the last 20% of the timestamps of the csv so if it's like data of 2000 till 2023 then cut till 2019 and save this as training_SP500.csv Step 3: Do the opposite of step 2 wich u cut the first 80% off and save it as future_Sp500.csv Step 4: train only on the data of training_SP500.csv Step 5: u test the the prediction for the missing 20% of the current data Step 6: on same chart plot the original data of the current s&p500 data And Voila a chart wich u can clearly see is those prediction where in the right direction!! Nice vid, good education

[@ItsSardine]

So you’re just using 20% of available data to train? Seems like a whole lot of input is lost…

[@leandrogoethals6599]

@@ItsSardine Well 20% of what u find adaquite ofcourse

[@MyTopAnime]

@@ItsSardine If you know anything about AI, you generally use 20% as testing data and the rest as training data. Also sometimes too much data can cause overfitting. This means it can predict existing data with ease, but when it comes to new data, it will struggle to perform well.

[@SPONGE2008]

ima be so fr i dont know how to get the csv file its like 2am im so tired lol anyone can help? would be appreciated

[@leandrogoethals6599]

@@SPONGE2008 what u mean get "the" csv file u mean the one the video creator made(wath is his name again). I use my own csv wich is constructed by quering an api from a dataprovider, of course i don't wanna pay for data so i do this multiple times for diffrent time ranges and paste them togetther again

[@joao_paiva]

This type of algo is usefull just to predict the next time event. You have 70% accuracy but you are predicting just the next day price based in the last day price multiple times

[@rjsingh4255]

that is right mr future billionaire

[@joao_paiva]

​@@rjsingh4255 lmao, just to share information bro 😂

[@leonli891]

so what? fake thing?

[@Mr._Cousin]

should it be more reasonable to use the price the day before to predict the price next day in train and testing?

[@sleepy9305]

Smart idea but one days data might not be enough to make a good prediction

[@joao_paiva]

it's what he did, the N day open price is equal to the N-1 day close price

[@antonyhartley9586]

@@joao_paiva Totally incorrect closing_price != opening_price_next_day, google it!

[@sunnysidestoryss]

How do I get it to predict more

[@yourbestlifebrandi]

Where or how did you produce the input file for historical data? Where can it be obtained?

[@MeghanaHM]

Same question

[@吳嘎]

import pandas_datareader.data as web # Required steps to setup Yahoo Finance import yfinance as yfin yfin.pdr_override() aapl = web.get_data_yahoo('AAPL', start='2019-01-01', end='2020-01-01')@@MeghanaHM

[@crackedatcurry]

kaggle

[@pohu6296]

Use Your prediction and check the return %, the results is very very poor. The prediction is basically noise with baseline of open price. You can just plot open price vs close price, the are similar to your prediction.

[@AB_498]

that's true but i wonder why it still got an accuracy of 70% on test data

[@kenhan168]

@@AB_498 , because it feed in the current open price and the volume, which is not available in actual trading. You can only get Volume after the market close.

[@GoodManVlogs]

Are you sure that it is not learning from the high and low prices of the current day that has not yet closed? How to make sure?

[@kenhan168]

For the volume, you can only get it after the market close. So putting current day of volume while the market is open has no much use, as the volume is changing throughout the day.

[@RajVardhan-d8o]

What is that csv file and how do i get it

[@kaushikmetha3429]

This works only for one stock. Is there any way to design a neural network model that can be used to predict stock price of more than one stock?

[@Stopinvadingmyhardware]

No, there isn’t.

[@AI_Vania]

Yes, you can predict multidimensional stock returns with a nn by having one or more output nodes for each return series that you want to predict.

[@GamingwithPortals]

Just use threads and run the same program for many different stocks

[@Stopinvadingmyhardware]

@@AI_Vania No, there isn’t. You can’t predict, you’re only building a measurement based system that estimates risk and when to purchase and sell based on estimated risk.

[@AI_Vania]

@@Stopinvadingmyhardware What do you mean "you can't predict"? One can build a model to predict future prices or (maybe better) future price distributions. The NN doesn't necessarily make risk estimations or buy/sell decisions, those things may involve logic that is outside of the NN.

[@hamzazakaria2582]

i keep getting an error at the "model.score" it says model is not defined

[@luishernandezmatos2264]

you have to define the model ===> model = XGBRegressor() model.fit(train_data[features],train_data[TARGET]) y_pred = model.predict(test_data[features]) #Accuracy model.score(test_data[features], test_data[TARGET])

[@codeline9387]

actually thats almost useless prediction coz we know volume when only when close is known

[@JCCreatorStudio]

im new to ML, the final plot only show some orange line near the end, what does it mean and where are the rest?

[@GamingWithAJ175679]

the dataset had the entire data including the one at the end. However, he split the dataset into 2 parts. 1 big and 1 small (the one at the end). He fed the bigger chunk of data into the ml model and kept the smaller chunk aside. Once the thing was trained, he asked the model to predict the next prices which he then compared to the smaller chunk of data he did not allow the model to see.

[@Aether_46]

Hope you had tutorial for deployment of this and for real time price to predit.

[@taneti_sanjay]

Predicting real-time market prices presents significant challenges due to the need for up-to-date data. While it's theoretically possible to predict future prices, accessing real-time data is often limited by market closing times and costly data acquisition. APIs typically provide data once the market closes, hindering the ability to make real-time predictions. Moreover, obtaining live data usually incurs substantial expenses. Therefore, predicting prices for future points requires historical data for training models, making real-time prediction impractical in many cases. In addition to data accessibility challenges, there are inherent complexities in modeling financial markets that further complicate real-time predictions. Financial markets are influenced by a multitude of factors, including economic indicators, geopolitical events, investor sentiment, and market psychology. These factors can lead to sudden fluctuations and volatility, making it difficult to accurately forecast prices in real time. Furthermore, market dynamics are constantly evolving, with new information continuously being incorporated into prices. This makes it challenging for predictive models to adapt quickly enough to capture and react to these changes in real time. Moreover, the presence of noise and randomness in financial data adds another layer of complexity. Despite best efforts to develop sophisticated predictive models, there is always a degree of uncertainty inherent in predicting future prices accurately.

[@Talangenz]

How do I, predict more, like not only the test set for example 3 years forward

[@joao_paiva]

this type of code is usefull just to predict the next time event

[@ditoiuc]

in the last 3 years we had : covid, war on ukraine. no python script could take that into account

[@reynolrodriguez4982]

easy money 😂

[@2ncielkrommalzeme210]

way of Telling the program is brief . how can we get the csv files for example like yours SPY.csv

[@gaurirajput9856]

you can download it from google or you can get it from google search

[@shilpabaranwal5913]

Nice Video but not useful for real time prediction, volume information will not be available beforehand

[@IkaroSampaioDj]

Stopped this video when he included 99% of the data in the train_data. Makes no sense

[@sebastiangomez6593]

Why , explain me I'm new in python

[@mpregsonic5874]

Yeah it does. He is doing EXTRApolation where the future is being predicted. Predicting more than 1 times step into the future in this case compounds the margin of error greatly. This means you’ll want to train on all of the data up until the time period you are trying to predict. This is standard in time series. Even if you want to train on 70 percent to predict the remaining 30 percent you do it in what’s called a rolling forecast way which essentially retrains the model on all the data up to the point you’re trying to predict for every point within that original 30 percent. In machine learning where time series is not involved, an INTERpolation problem, training the model on 70 percent and testing on the remaining 30 is a lot more common and makes sense.

[@hyrumnielsen4390]

Only predicting the next day (or time interval) for day traders.

[@vladvol855]

Very interesting! But, how could it be used in algotrading?

[@jasonreviews]

you can't it's 30-60% accurate. You can't predict black swan events or news.

[@dansimon4056]

Hey, nice, can you do a tutorial for optimal execution on python using almgren kriss?

[@rverm1000]

typo? train_data= data.iloc[:int(.99 * len(data)), :] test_data= data.iloc[int(.99 * len(data)):,:]

[@OshpreetSinghJoshan]

where to get dataset for this

[@ComputerSciencecompsci112358]

Hi, You can get the data set for this at patreon.com/computerscience

[@harveychang6829]

yfinance

[@useradav]

I followed you step by step, but my historical chart is a downtrend for some reason.

[@businesstodayve]

check the indexes of your dataset

[@modichanel16]

great tutorials 👍👍👍👍👍

[@didierleprince6106]

Merci (:

[@ComputerSciencecompsci112358]

Glad you liked it!

[@wuyanchu]

Thx and god bless 😊

[@antonyhartley9586]

shame there's no code (just pitching for sign-up), I'll just type it in:)

[@ComputerSciencecompsci112358]

Hi antonyhartley9586, could you please elaborate on your statement?

[@robertobonani8571]

Can see you are a programmer but not a data scientist

[@guillermogomez9731]

Pregunta que le hago a todos, para que te sirve esto xD. Para nada, no te da ninguna info

[@vv9730]

etni jhak marane ke bad prediction acuuracy only 70 %....11:30..!!!

[@serg8483]

I'm surprised why this video is getting so many views and likes. You made a huge mistake in your logic. This is not the accuracy of your model. This is a coefficient of determination that does not play any useful role in building a trading strategy. The coefficient of determination shows how strongly you can describe the target variable using your features. If you take data from the previous day, and without a model. Your coefficient of determination will be 0.99 In short, it’s not accurate and it’s useless what you did

[@王阿翰-j9r]

Overfitting bruh

[@tristeub997]

It is totally useless wtf ??

[@tuanvulet.9776]

thanks bro