Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.
Stock market price forecast
Hello
I just joined the community
I am in the beginner's Rapidminer program
I have stock data for an index
I want to predict the final price for that indicator in the next few days
But I do not know how to use which operators?
Is there any need to normalize the data?
I ask you to help me
Yours sincerely
Nazi
I just joined the community
I am in the beginner's Rapidminer program
I have stock data for an index
I want to predict the final price for that indicator in the next few days
But I do not know how to use which operators?
Is there any need to normalize the data?
I ask you to help me
Yours sincerely
Nazi
Tagged:
0
Answers
Forecasting stock prices is a bit of a black art with a generally poor win rate. If you are starting out, I would use a data set that is much more regular. The problem is noise which is random.
Thank you so much
I did not notice this sentence and the formula mentioned "You should also consider detrending using a moving average using the formula close - ma (close). "
Can you explain more? Is there a typical process for normalizing and forecasting stock prices? thanks again
I think you should have a quick think about what it is that you are trying to predict. If it is direction then you can look at the problem from a classification perspective. If it is an actual value then it is a regression problem. A value may be an actual price or the percentage change. Take a simple one step ahead prediction.....what does that mean exactly? It could be a prediction from the next days open to the next days close or from the open to the following days's open or from todays close to tomorrows close, next week or next months close. This may sound subtle but it will have a dramatic effect on your prediction so choosing what to predict is fundamental.
You can generate attributes in Rapidminer. These are features that provide "information" to your learning operators. You can setup your process as a univariate or multivariate problem, multivariate is simply using several features to guide your prediction. Creating a moving average or adding a volatility measurement would be adding features to your process.
Lastly, you need to think about how much data to use. Does using daily data going back to 1990 help you to predict tomorrows price? Probably not. In finance, more data might not be better if the data is no longer relevant. Even more problematic is that even if you do find a way to achieve high accuracy, that does not always equal high profitability. It could be that your high accuracy is still random. There are many traps to fall into.
Thank you very much for your help
it was kind of you
Sorry, i will take your time again
My data is for a specific index. As for a specific index, I have data for the last 6 months.
And I want to predict it for the next week, as well as the next month, the price of opening or closing.
My problem is that I do not know which attribute should I work on and which operators I need to get help with. I know the classification and clustering in the Rapidminer program. But I do not know things like regression and time series.
And I do not know how to predict the price?
I have no experience in this field. And I am quite a beginner in this.
And I'm completely confused.
I also did not find an example in the Rapidminer program.
May I ask you to give me an example?(I also say that I have a great demand from the community. But there's really no one to help me out. Sorry again)
thanks again
best regards
nazi
Are you @student_compute? You write the same way and have similar problems. Here is a whole thread full of people trying to help you on this already.
https://community.rapidminer.com/discussion/comment/57150#Comment_57150
thanks again
Yes, Sure
I will do my best
And I'm trying to create a process. And share it with the community to fix its possible bugs
Thankful
best regards
nazi
I studied all yesterday on a series of times
I realized that. If I understand correctly:
The series has four types
Trend
Seasonality
Cycle
Irregular remainder
And that
The ARIMA model is used to predict time series.
And is ARIMA (p, d, q).
And
There are two BIC and AIC parameters for measuring the model that should be at least minimal.
also
The mean and the variance of the time series must be constant.
It is true?
Now my questions are:
In the RapidMiner program
For stock data
1. How should I identify the type of time series in the chart of a stock index?
2. How should I identify the appropriate parameter values in ARIMA (p, d, q)?
3. How to prove the mean values and variance of the time series?
I ask you to guide
Thankful
Back to ARIMA. You should study the example in the samples section of Rapdiminer, specifically "Example Analysis of Lake Huron" and look and see for yourself what adjustments p,q,d have on your forecast. You should also prepare a process with windowing. Look at the "Create Model for Gas Prices.". These two examples will cover the basics.
As for the other three questions.....that is your homework Nazanin. No short cuts.
Here is a tutorial for R that you might want to look at. It goes through the steps quite clearly. The steps are the same regardless of what software you use. https://www.quantinsti.com/blog/forecasting-stock-returns-using-arima-model.
Keep in mind that the real world is much more complex. As a learning exercise this is fine. Just don't expect to able to forecast with any kind of accuracy with this approach.
Thank you for your answer
I will do my best
But with this description
What is your recommendation for predicting stock prices?
What is your opinion? (Because you have the full information of all the algorithms available, I'll ask you which algorithm to search and study is more appropriate.)
Thankful
I think you should do the ARIMA example and also the windowing example and compare the prediction. With the windowing example you can see what Gradient Boosted Trees does and then try different learning operators. Try different methods of detrending. The best learner for the job is very data dependent so there is no best learner. You need to discover what works best for your data. It also depends on what you want to predict. You also need to think about your class balance which means simply...do you have more up days than down days. You need to think about serial correlation which means...do you have many up days or down days in a row or not.
Here is the primary problem with stock prices which have a low signal to noise ratio. If you are trying to predict the next days closing price it is very common that your learner will decide that the best forecast of tomorrows price is todays price. So if today was up then tomorrow will be up and visa versa. In the end you are not predicting anything. It becomes an exercise in over fitting. So you think....I am not going to over fit. What you end up with is a complicated way of doing something simple like a moving average.
More sophisticated models will try and extract the temporal/cyclical data in the time series and make a projection to determine the directional bias. You would also need to learn how to make multi day predictions which adds another layer of complication. Stock prices are a poor choice for beginners to use as a data set.
Try your best to duplicate the examples and look at the videos but don't be disappointed if your accuracy is near random. That would be the expected result. Use a default model as your baseline and compare your results.