An empirical study on the various stock market prediction methods
DOI:
https://doi.org/10.26594/register.v8i1.2533Keywords:
Clustering and Data Mining, CNN, Sentiment Analysis, Stock Market Prediction, Time Series AnalysisAbstract
Investment in the stock market is one of the much-admired investment actions. However, prediction of the stock market has remained a hard task because of the non-linearity exhibited. The non-linearity is due to multiple affecting factors such as global economy, political situations, sector performance, economic numbers, foreign institution investment, domestic institution investment, and so on. A proper set of such representative factors must be analyzed to make an efficient prediction model. Marginal improvement of prediction accuracy can be gainful for investors. This review provides a detailed analysis of research papers presenting stock market prediction techniques. These techniques are assessed in the time series analysis and sentiment analysis section. A detailed discussion on research gaps and issues is presented. The reviewed articles are analyzed based on the use of prediction techniques, optimization algorithms, feature selection methods, datasets, toolset, evaluation matrices, and input parameters. The techniques are further investigated to analyze relations of prediction methods with feature selection algorithm, datasets, feature selection methods, and input parameters. In addition, major problems raised in the present techniques are also discussed. This survey will provide researchers with deeper insight into various aspects of current stock market prediction methods.
References
[1] Y. Wang, H. Liu, Q. Guo, S. Xie and X. Zhang, "Stock Volatility Prediction by Hybrid Neural Network," IEEE Access, vol. 7, pp. 154524-154534, 2019.
[2] M. Ballings, D. V. d. Poel, N. Hespeels and R. Gryp, "Evaluating multiple classifiers for stock price direction prediction," Expert Systems with Applications, vol. 42, no. 20, pp. 7046-7056, 2015.
[3] G. Liu and X. Wang, "A Numerical-Based Attention Method for Stock Market Prediction With Dual Information," IEEE Access, vol. 7, pp. 7357-7367, 2018.
[4] K. N. Devi, V. M. Bhaskaran and G. P. Kumar, "Cuckoo optimized SVM for stock market prediction," in 2015 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS), Coimbatore, India, 2015.
[5] H.-C. Liu, Y.-H. Lee and M.-C. Lee, "Forecasting China Stock Markets Volatility via GARCH Models Under Skewed-GED Distribution," Journal of Money, Investment and Banking, vol. 7, 2009.
[6] G. E. P. Box, G. M. Jenkins, G. C. Reinsel and G. M. Ljung, Time Series Analysis: Forecasting and Control, New Jersey: Wiley, 2016.
[7] E. Chong, C. Han and F. C. Park, "Deep learning networks for stock market analysis and prediction: Methodology, data representations, and case studies," Expert Systems with Applications, vol. 83, pp. 187-205, 2017.
[8] S. H. Kim and S. H. Chun, "Graded forecasting using an array of bipolar predictions: application of probabilistic neural networks to a stock market index," International Journal of Forecasting, vol. 14, no. 3, pp. 323-337, 1998.
[9] M.-C. Wu, S.-Y. Lin and C.-H. Lin, "An effective application of decision tree to stock trading," Expert Systems with Applications, vol. 31, no. 2, pp. 270-274, 2006.
[10] A. Booth, E. Gerding and F. McGroarty, "Automated trading with performance weighted random forests and seasonality," Expert Systems with Applications, vol. 41, no. 8, pp. 3651-3661, 2014.
[11] D. Brownstone, "Using percentage accuracy to measure neural network predictions in Stock Market movements," Neurocomputing, vol. 10, no. 3, pp. 237-250, 1996.
[12] P. Ou and H. Wang, "Prediction of Stock Market Index Movement by Ten Data Mining Techniques," Modern Applied Science, vol. 3, no. 12, 2009.
[13] M. V. Subha and S. T. Nambi, "Classification of Stock Index movement using k-Nearest Neighbours (k-NN) algorithm," WSEAS Transactions on Information Science & Applications, vol. 9, no. 9, pp. 261-270, 2012.
[14] S.-D. Kim, "Data Mining Tool for Stock Investors’ Decision Support," The Journal of the Korea Contents Association, vol. 12, no. 2, pp. 472-482, 2012.
[15] M. T. Leung, H. Daouk and A.-S. Chen, "Forecasting stock indices: a comparison of classification and level estimation models," International Journal of Forecasting, vol. 16, no. 2, pp. 173-190, 2000.
[16] G. J. O. Osório, J. C. O. Matías and J. P. S. Catalão, "Hybrid evolutionary-adaptive approach to predict electricity prices and wind power in the short-term," in 2014 Power Systems Computation Conference, Wroclaw, Poland, 2014.
[17] M. M. Beno, V. I. R, S. S. M and B. R. Rajakumar, "Threshold prediction for segmenting tumour from brain MRI scans," International Journal of Imaging Systems and Technology, vol. 24, no. 2, pp. 129-137, 2014.
[18] X. Wei, Z. Xie, R. Cheng, D. Zhang and Q. Li, "An Intelligent Learning and Ensembling Framework for Predicting Option Prices," Emerging Markets Finance and Trade, vol. 57, no. 15, pp. 4237-4260, 2021.
[19] R. Gao, W. Wu, C. Lang and L. Lang, "Geometric Asian barrier option pricing formulas of uncertain stock model," Chaos, Solitons & Fractals, vol. 140, p. 110178, 2020.
[20] I. Zghal, S. B. Hamad, H. Eleuch and H. Nobanee, "The effect of market sentiment and information asymmetry on option pricing," The North American Journal of Economics and Finance, vol. 54, p. 101235, 2020.
[21] B. Chen and M. Kankanhalli, "Pricing Average Price Advertising Options When Underlying Spot Market Prices Are Discontinuous," IEEE Transactions on Knowledge and Data Engineering, vol. 31, no. 9, pp. 1765-1778, 2019.
[22] B. R. Rajakumar, "Impact of static and adaptive mutation techniques on the performance of Genetic Algorithm," International Journal of Hybrid Intelligent Systems, vol. 10, p. 11–22, 2013.
[23] S. R. Das, D. Mishra and M. Rout, "Stock market prediction using Firefly algorithm with evolutionary framework optimized feature reduction for OSELM method," Expert Systems with Applications: X, vol. 4, p. 100016, 2019.
[24] D. O. Oyewola, A. Ibrahim, J. A. Kwanamu and E. G. Dada, "A new auditory algorithm in stock market prediction on oil and gas sector in Nigerian stock exchange," Soft Computing Letters, vol. 3, p. 100013, 2021.
[25] S. Mukhopadhyay and S. Banerjee, "Global optimization of an optical chaotic system by Chaotic Multi Swarm Particle Swarm Optimization," Expert Systems with Applications, vol. 39, no. 1, pp. 917-924, 2012.
[26] M. R. Tanweer, S. Suresh and N. Sundararajan, "Self regulating particle swarm optimization algorithm," Information Sciences, vol. 294, pp. 182-202, 2015.
[27] B. R. Rajakumar, "Static and adaptive mutation techniques for genetic algorithm: a systematic comparative analysis," International Journal of Computational Science and Engineering, vol. 8, no. 2, pp. 180-193, 2013.
[28] D. Binu and B. S. Kariyappa, "RideNN: A New Rider Optimization Algorithm-Based Neural Network for Fault Diagnosis in Analog Circuits," IEEE Transactions on Instrumentation and Measurement, vol. 68, no. 1, pp. 2-26, 2019.
[29] G.-G. Wang, S. Deb and L. d. S. Coelho, "Elephant Herding Optimization," in 2015 3rd International Symposium on Computational and Business Intelligence (ISCBI), Bali, Indonesia, 2015.
[30] G.-G. Wang, "Moth search algorithm: a bio-inspired metaheuristic algorithm for global optimization problems," Memetic Computing, vol. 10, p. 151–164, 2018.
[31] Z. Hu, Y. Zhao and M. Khushi, "A Survey of Forex and Stock Price Prediction Using Deep Learning," Applied System Innovation, vol. 4, no. 1, p. 9, 2021.
[32] D. Shah, H. Isah and F. Zulkernine, "Stock Market Analysis: A Review and Taxonomy of Prediction Techniques," International Journal of Financial Studies, vol. 7, no. 2, p. 26, 2019.
[33] D. P. Gandhmal and K. Kumar, "Systematic analysis and review of stock market prediction techniques," Computer Science Review, vol. 34, p. 100190, 2019.
[34] A. Thakkar and K. Chaudhari, "A comprehensive survey on deep neural networks for stock market: The need, challenges, and future directions," Expert Systems with Applications, vol. 177, p. 114800, 2021.
[35] P. S. Rao, K. Srinivas and A. K. Mohan, "A Survey on Stock Market Prediction Using Machine Learning Techniques," in ICDSMLA 2019, Singapore, 2019.
[36] S. M. Idrees, M. A. Alam and P. Agarwal, "A Prediction Approach for Stock Market Volatility Based on Time Series Data," IEEE Access, vol. 7, pp. 17287-17298, 2019.
[37] M. S. Babu, N. Geethanjali and B. Satyanarayana, "Clustering Approach to Stock Market Prediction," International Journal of Advanced Networking and Applications, vol. 3, no. 4, pp. 1281-1291, 2012.
[38] A. Gupta and S. D. Sharma, "Clustering-Classification Based Prediction of Stock Market Future Prediction," International Journal of Computer Science and Information Technologies, vol. 5, no. 3, pp. 2806-2809, 2014.
[39] W. Wang, Y. Shi and R. Luo, "Sparse Representation Based Approach to Prediction for Economic Time Series," IEEE Access, vol. 7, pp. 20614-20618, 2019.
[40] Y. Chen and Y. Hao, "A feature weighted support vector machine and K-nearest neighbor algorithm for stock market indices prediction," Expert Systems with Applications, vol. 80, pp. 340-355, 2017.
[41] S. Barak and M. Modarres, "Developing an approach to evaluate stocks by forecasting effective features with data mining methods," Expert Systems with Applications, vol. 42, no. 3, pp. 1325-1339, 2015.
[42] M. Wen, P. Li, L. Zhang and Y. Chen, "Stock Market Trend Prediction Using High-Order Information of Time Series," IEEE Access, vol. 7, pp. 28299-28308, 2019.
[43] Y. Chen, W. Lin and J. Z. Wang, "A Dual-Attention-Based Stock Price Trend Prediction Model With Dual Features," IEEE Access, vol. 7, pp. 148047-148058, 2019.
[44] J. Long, Z. Chen, W. He, T. Wu and J. Ren, "An integrated framework of deep learning and knowledge graph for prediction of stock price trend: An application in Chinese stock exchange market," Applied Soft Computing, vol. 91, p. 106205, 2020.
[45] E. Hoseinzade and S. Haratizadeh, "CNNpred: CNN-based stock market prediction using a diverse set of variables," Expert Systems with Applications, vol. 129, pp. 273-285, 2019.
[46] Y. Baek and H. Y. Kim, "ModAugNet: A new forecasting framework for stock market index value with an overfitting prevention LSTM module and a prediction LSTM module," Expert Systems with Applications, vol. 113, pp. 457-480, 2018.
[47] M. Hiransha, E. A. Gopalakrishnan, V. K. Menon and K. P. Soman, "NSE Stock Market Prediction Using Deep-Learning Models," Procedia Computer Science, vol. 132, pp. 1351-1362, 2018.
[48] X. Zhou, Z. Pan, G. Hu, S. Tang and C. Zhao, "Stock Market Prediction on High-Frequency Data Using Generative Adversarial Nets," Mathematical Problems in Engineering, 2018.
[49] D. M. Q. Nelson, A. C. M. Pereira and R. A. d. Oliveira, "Stock market's price movement prediction with LSTM neural networks," in 2017 International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, USA, 2017.
[50] C.-F. Tsai and Y.-C. Hsiao, "Combining multiple feature selection methods for stock prediction: Union, intersection, and multi-intersection approaches," Decision Support Systems, vol. 50, no. 1, pp. 258-269, 2010.
[51] S. Asadi, E. Hadavandi, F. Mehmanpazir and M. M. Nakhostin, "Hybridization of evolutionary Levenberg–Marquardt neural networks and data pre-processing for stock market prediction," Knowledge-Based Systems, vol. 35, pp. 245-258, 2012.
[52] C. M. Anish and B. Majhi, "Hybrid nonlinear adaptive scheme for stock market prediction using feedback FLANN and factor analysis," Journal of the Korean Statistical Society, vol. 45, no. 64–76, 2016.
[53] R. d. A. Araújo, "Translation Invariant Morphological Time-lag Added Evolutionary Forecasting method for stock market prediction," Expert Systems with Applications, vol. 38, no. 3, pp. 2835-2848, 2011.
[54] S. Jabin, "Stock Market Prediction using Feed-forward Artificial Neural Network," International Journal of Computer Applications, vol. 99, no. 9, pp. 4-8, 2014.
[55] R. d. A. Araújo and T. A. E. Ferreira, "A Morphological-Rank-Linear evolutionary method for stock market prediction," Information Sciences, vol. 237, pp. 3-17, 2013.
[56] L. Xi, H. Muzhou, M. H. Lee, J. Li, D. Wei, H. Hai and Y. Wu, "A new constructive neural network method for noise processing and its application on stock market prediction," Applied Soft Computing, vol. 15, pp. 57-66, 2014.
[57] K. S. Kannan, P. S. Sekar, M. Sathik and P. Arumugam, "Financial stock market forecast using data mining techniques," in Proceedings of the International Multiconference of Engineers and computer scientists, 2010.
[58] P. K. Aithal, A. U. Dinesh and M. Geetha, "Identifying Significant Macroeconomic Indicators for Indian Stock Markets," IEEE Access, vol. 7, pp. 143829-143840, 2019.
[59] R. Verma, P. Choure and U. Singh, "Neural networks through stock market data prediction," in 2017 International conference of Electronics, Communication and Aerospace Technology (ICECA), Coimbatore, India, 2017.
[60] E. Guresen, G. Kayakutlu and T. U. Daim, "Using artificial neural network models in stock market index prediction," Expert Systems with Applications, vol. 38, no. 8, pp. 10389-10397, 2011.
[61] E. L. de Faria, M. P. Albuquerque, J. L. Gonzalez, J. T. P. Cavalcante and M. P. Albuquerque, "Predicting the Brazilian stock market through neural networks and adaptive exponential smoothing methods," Expert Systems with Applications, vol. 36, no. 10, pp. 12506-12509, 2009.
[62] A. H. Moghaddam, M. H. Moghaddam and M. Esfandyari, "Stock market index prediction using artificial neural network," Journal of Economics, Finance and Administrative Science, vol. 21, no. 41, pp. 89-93, 2016.
[63] J. Patel, S. Shah, P. Thakkar and K. Kotecha, "Predicting stock market index using fusion of machine learning techniques," Expert Systems with Applications, vol. 42, no. 4, pp. 2162-2172, 2015.
[64] X. Yuan, J. Yuan, T. Jiang and Q. U. Ain, "Integrated Long-Term Stock Selection Models Based on Feature Selection and Machine Learning Algorithms for China Stock Market," IEEE Access, vol. 8, pp. 22672-22685, 2020.
[65] L. Zhang, N. Liu and P. Yu, "A Novel Instantaneous Frequency Algorithm and Its Application in Stock Index Movement Prediction," IEEE Journal of Selected Topics in Signal Processing, vol. 6, no. 4, pp. 311-318, 2012.
[66] F. Yang, Z. Chen, J. Li and L. Tang, "A novel hybrid stock selection method with stock prediction," Applied Soft Computing, vol. 80, pp. 820-831, 2019.
[67] M. Karhunen, "Algorithmic sign prediction and covariate selection across eleven international stock markets," Expert Systems with Applications, vol. 115, pp. 256-263, 2019.
[68] F. Zhou, H.-m. Zhou, Z. Yang and L. Yang, "EMD2FNN: A strategy combining empirical mode decomposition and factorization machine based neural network for stock market trend prediction," Expert Systems with Applications, vol. 115, pp. 136-151, 2019.
[69] R. Ramezanian, A. Peymanfar and S. B. Ebrahimi, "An integrated framework of genetic network programming and multi-layer perceptron neural network for prediction of daily stock return: An application in Tehran stock exchange market," Applied Soft Computing, vol. 82, p. 105551, 2019.
[70] H. Wang, "Research on application of fractional calculus in signal real-time analysis and processing in stock financial market," Chaos, Solitons & Fractals, vol. 128, pp. 92-97, 2019.
[71] G. Liu, Y. Wang, X. Chen, Y. Zhang and Y. Shang, "Forecasting volatility of the Chinese stock markets using TVP HAR-type models," Physica A: Statistical Mechanics and its Applications, vol. 542, p. 123445, 2020.
[72] T. H. Nguyen, K. Shirai and J. Velcin, "Sentiment analysis on social media for stock movement prediction," Expert Systems with Applications, vol. 42, no. 24, pp. 9603-9611, 2015.
[73] H. Wang, S. Lu and J. Zhao, "Aggregating multiple types of complex data in stock market prediction: A model-independent framework," Knowledge-Based Systems, vol. 164, pp. 193-204, 2019.
[74] M. Dang and D. Duong, "Improvement methods for stock market prediction using financial news articles," in 2016 3rd National Foundation for Science and Technology Development Conference on Information and Computer Science (NICS), Danang, Vietnam, 2016.
[75] X. Ding, Y. Zhang, T. Liu and J. Duan, "Deep Learning for Event-Driven Stock Prediction," in Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence (IJCAI 2015), 2015.
[76] X. Zhang, S. Qu, J. Huang, B. Fang and P. Yu, "Stock Market Prediction via Multi-Source Multiple Instance Learning," IEEE Access, vol. 6, no. 50720 - 50728. 2018, pp. 50720-50728, 2018.
[77] C. Chen, W. Dongxing, H. Chunyan and Y. Xiaojie, "Exploiting Social Media for Stock Market Prediction with Factorization Machine," in 2014 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT), Warsaw, Poland, 2014.
[78] N. Oliveira, P. Cortez and N. Areal, "The impact of microblogging data for stock market prediction: Using Twitter to predict returns, volatility, trading volume and survey sentiment indices," Expert Systems with Applications, vol. 73, p. 125, 2017.
[79] X. Zhang, Y. Zhang, S. Wang, Y. Yao, B. Fang and P. S. Yu, "Improving stock market prediction via heterogeneous information fusion," Knowledge-Based Systems, vol. 143, pp. 236-247, 2018.
[80] N. P. N. Sreedharan, B. Ganesan, R. Raveendran, P. Sarala, B. Dennis and R. B. R, "Grey Wolf optimisation-based feature selection and classification for facial emotion recognition," IET Biometrics, vol. 7, no. 5, pp. 490-499, 2018.
[81] C. Hu and L. T. He, "An Application of Interval Methods to Stock Market Forecasting," Reliable Computing, vol. 13, p. 423–434, 2007.
[82] R. Chowdhury, M. R. C. Mahdy, T. N. Alam, G. D. A. Quaderi and M. A. Rahman, "Predicting the stock price of frontier markets using machine learning and modified Black–Scholes Option pricing model," Physica A: Statistical Mechanics and its Applications, vol. 555, p. 124444, 2020.
Downloads
Published
How to Cite
Issue
Section
License
Please find the rights and licenses in Register: Jurnal Ilmiah Teknologi Sistem Informasi. By submitting the article/manuscript of the article, the author(s) agree with this policy. No specific document sign-off is required.
1. License
The non-commercial use of the article will be governed by the Creative Commons Attribution license as currently displayed on Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
2. Author(s)' Warranties
The author warrants that the article is original, written by stated author(s), has not been published before, contains no unlawful statements, does not infringe the rights of others, is subject to copyright that is vested exclusively in the author and free of any third party rights, and that any necessary written permissions to quote from other sources have been obtained by the author(s).
3. User/Public Rights
Register's spirit is to disseminate articles published are as free as possible. Under the Creative Commons license, Register permits users to copy, distribute, display, and perform the work for non-commercial purposes only. Users will also need to attribute authors and Register on distributing works in the journal and other media of publications. Unless otherwise stated, the authors are public entities as soon as their articles got published.
4. Rights of Authors
Authors retain all their rights to the published works, such as (but not limited to) the following rights;
Copyright and other proprietary rights relating to the article, such as patent rights,
The right to use the substance of the article in own future works, including lectures and books,
The right to reproduce the article for own purposes,
The right to self-archive the article (please read out deposit policy),
The right to enter into separate, additional contractual arrangements for the non-exclusive distribution of the article's published version (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal (Register: Jurnal Ilmiah Teknologi Sistem Informasi).
5. Co-Authorship
If the article was jointly prepared by more than one author, any authors submitting the manuscript warrants that he/she has been authorized by all co-authors to be agreed on this copyright and license notice (agreement) on their behalf, and agrees to inform his/her co-authors of the terms of this policy. Register will not be held liable for anything that may arise due to the author(s) internal dispute. Register will only communicate with the corresponding author.
6. Royalties
Being an open accessed journal and disseminating articles for free under the Creative Commons license term mentioned, author(s) aware that Register entitles the author(s) to no royalties or other fees.
7. Miscellaneous
Register will publish the article (or have it published) in the journal if the article’s editorial process is successfully completed. Register's editors may modify the article to a style of punctuation, spelling, capitalization, referencing and usage that deems appropriate. The author acknowledges that the article may be published so that it will be publicly accessible and such access will be free of charge for the readers as mentioned in point 3.