Robustness Evaluation of LSTM-based Deep Learning Models for Bitcoin Price Prediction in the Presence of Random Disturbances
Article Sidebar
Main Article Content
Abstract
As Deep Learning (DL) continues to be widely adopted, the growing field of study on the robustness of DL approaches in finance is gaining steam. This paper investigates the robustness of a Recurrent Neural Network (RNN) with Long Short-Term Memory (LSTM) intended for daily closing price predictions of Bitcoin (BTC). The research entails reproducing and adjusting an LSTM design from previous research, with an emphasis on evaluating the robustness of the network. The network is trained using data that has been disturbed by Gaussian noise to assess robustness, and the effect on predictions made outside of the sample is examined. To examine the impact of adding Gaussian noise layers and noisy dense layers on training accuracy and out-of-sample predictions, further robustness tests are conducted. The results show that the LSTM network has remarkable robustness to random disturbances in the data. Nevertheless, the Root Mean Square Error (RMSE) of the prediction increases with the addition of Gaussian noise and noisy dense layers. When random noise is present in the training data, the Autoregressive Integrated Moving Average (ARIMA) model is more vulnerable to it than the LSTM, according to the robustness of the two models. These findings highlight how robustness DL techniques are overall when compared to more conventional linear methods. However, because these models are black-box, the study highlights the significance of comprehensive testing. Although the robustness of the LSTM is impressive, it is important to understand that each network may behave differently depending on the circumstances.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
How to Cite
References
D. Muchlinski, “Machine learning and deep learning,” in Elgar Encyclopedia of Technology and Politics, vol. 31, no. 3, Springer Science and Business Media Deutschland GmbH, 2022, pp. 114–118. doi: 10.4337/9781800374263.machine.learning.deep. https://doi.org/10.4337/9781800374263.machine.learning.deep
S. Mehtab, J. Sen, and A. Dutta, “Stock Price Prediction Using Machine Learning and LSTM-Based Deep Learning Models,” in Communications in Computer and Information Science, 2021, vol. 1366, pp. 88–106. doi: 10.1007/978-981-16-0419-5 8. https://doi.org/10.1007/978-981-16-0419-5
H. Habib, G. S. Kashyap, N. Tabassum, and T. Nafis, “Stock Price Prediction Using Artificial Intelligence Based on LSTM– Deep Learning Model,” in Artificial Intelligence & Blockchain in Cyber Physical Systems: Technologies & Applications, CRC Press, 2023, pp. 93–99. doi: 10.1201/9781003190301-6. https://doi.org/10.1201/9781003190301-6
S. Wazir, G. S. Kashyap, and P. Saxena, “MLOps: A Review,” Aug. 2023, Accessed: Sep. 16, 2023. [Online]. Available: https://arxiv.org/abs/2308.10908v1
M. Kanojia, P. Kamani, G. S. Kashyap, S. Naz, S. Wazir, and A. Chauhan, “Alternative Agriculture Land-Use Transformation Pathways by Partial-Equilibrium Agricultural Sector Model: A Mathematical Approach,” Aug. 2023, Accessed: Sep. 16, 2023. [Online]. Available: https://arxiv.org/abs/2308.11632v1
N. Marwah, V. K. Singh, G. S. Kashyap, and S. Wazir, “An analysis of the robustness of UAV agriculture field coverage using multi-agent reinforcement learning,” International Journal of Information Technology (Singapore), vol. 15, no. 4, pp. 2317–2327, May 2023, doi: 10.1007/s41870-023-01264-0.
G. S. Kashyap, K. Malik, S. Wazir, and R. Khan, “Using Machine Learning to Quantify the Multimedia Risk Due to Fuzzing,” Multimedia Tools and Applications, vol. 81, no. 25, pp. 36685–36698, Oct. 2022, doi: 10.1007/s11042-021-11558-9.
G. S. Kashyap, A. E. I. Brownlee, O. C. Phukan, K. Malik, and S. Wazir, “Roulette-Wheel Selection-Based PSO Algorithm for Solving the Vehicle Routing Problem with Time Windows,” Jun. 2023, Accessed: Jul. 04, 2023. [Online]. Available: https://arxiv.org/abs/2306.02308v1
G. S. Kashyap, D. Mahajan, O. C. Phukan, A. Kumar, A. E. I. Brownlee, and J. Gao, “From Simulations to Reality: Enhancing Multi-Robot Exploration for Urban Search and Rescue,” Nov. 2023, Accessed: Dec. 03, 2023. [Online]. Available: https://arxiv.org/abs/2311.16958v1
S. Wazir, G. S. Kashyap, K. Malik, and A. E. I. Brownlee, “Predicting the Infection Level of COVID-19 Virus Using Normal Distribution-Based Approximation Model and PSO,” Springer, Cham, 2023, pp. 75–91. doi: 10.1007/978-3-031-33183-1_5. https://doi.org/10.1007/978-3-031-33183-1_5
S. Khalid, T. Khalil, and S. Nasreen, “A survey of feature selection and feature extraction techniques in machine learning,” in Proceedings of 2014 Science and Information Conference, SAI 2014, Oct. 2014, pp. 372–378. doi: 10.1109/SAI.2014.6918213. https://doi.org/10.1109/SAI.2014.6918213
J. Radcliffe, J. Cox, and D. M. Bulanon, “Machine vision for orchard navigation,” Computers in Industry, vol. 98, pp. 165–171, Jun. 2018, doi: 10.1016/j.compind.2018.03.008. https://doi.org/10.1016/j.compind.2018.03.008
M. Rekha Sundari, G. Siva Rama Krishna, V. Sai Naveen, and G. Bharathi, “Crop Recommendation System Using K-Nearest Neighbors Algorithm,” in Lecture Notes in Networks and Systems, 2021, vol. 177 LNNS, pp. 581–589. doi: 10.1007/978-981-33-4501-0_54. https://doi.org/10.1007/978-981-33-4501-0_54
J. L. Araújo, C. Morais, and J. C. Paiva, “Poetry and alkali metals: Building bridges to the study of atomic radius and ionization energy,” Chemistry Education Research and Practice, vol. 16, no. 4, pp. 893–900, Oct. 2015, doi: 10.1039/c5rp00115c.
J. Wang, T. Sun, B. Liu, Y. Cao, and D. Wang, “Financial Markets Prediction with Deep Learning,” in Proceedings - 17th IEEE International Conference on Machine Learning and Applications, ICMLA 2018, Jan. 2019, pp. 97–104. doi: 10.1109/ICMLA.2018.00022. https://doi.org/10.1109/ICMLA.2018.00022
T. Kim and H. Y. Kim, “Forecasting stock prices with a feature fusion LSTM-CNN model using different representations of the same data,” PLoS ONE, vol. 14, no. 2, p. e0212320, Feb. 2019, doi: 10.1371/journal.pone.0212320. https://doi.org/10.1371/journal.pone.0212320
L. Espeholt et al., “IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures,” in 35th International Conference on Machine Learning, ICML 2018, Jul. 2018, vol. 4, pp. 2263–2284. Accessed: Dec. 03, 2023. [Online]. Available: https://proceedings.mlr.press/v80/espeholt18a.html
S. Agarwal and N. B. Muppalaneni, “Portfolio optimization in stocks using mean–variance optimization and the efficient frontier,” International Journal of Information Technology (Singapore), vol. 14, no. 6, pp. 2917–2926, Oct. 2022, doi: 10.1007/s41870-022-01052-2. https://doi.org/10.1007/s41870-022-01052-2
O. B. Sezer, M. U. Gudelek, and A. M. Ozbayoglu, “Financial time series forecasting with deep learning: A systematic literature review: 2005–2019,” Applied Soft Computing Journal, vol. 90, 2020, doi: 10.1016/j.asoc.2020.106181. https://doi.org/10.1016/j.asoc.2020.106181
C. Szegedy et al., “Intriguing properties of neural networks,” in 2nd International Conference on Learning Representations, ICLR 2014 - Conference Track Proceedings, Dec. 2014. Accessed: Jan. 18, 2024. [Online]. Available: https://arxiv.org/abs/1312.6199v4
M. Goldblum, A. Schwarzschild, A. Patel, and T. Goldstein, “Adversarial attacks on machine learning systems for high-frequency trading,” in ICAIF 2021 - 2nd ACM International Conference on AI in Finance, Nov. 2021. doi: 10.1145/3490354.3494367. https://doi.org/10.1145/3490354.3494367
H. I. Fawaz, G. Forestier, J. Weber, L. Idoumghar, and P. A. Muller, “Adversarial Attacks on Deep Neural Networks for Time Series Classification,” in Proceedings of the International Joint Conference on Neural Networks, Jul. 2019, vol. 2019-July. doi: 10.1109/IJCNN.2019.8851936. https://doi.org/10.1109/IJCNN.2019.8851936
M. Cheng, J. Yi, P. Y. Chen, H. Zhang, and C. J. Hsieh, “Seq2sick: Evaluating the robustness of sequence-to-sequence models with adversarial examples,” in AAAI 2020 - 34th AAAI Conference on Artificial Intelligence, Apr. 2020, vol. 34, no. 04, pp. 3601–3608. doi: 10.1609/aaai.v34i04.5767. https://doi.org/10.1609/aaai.v34i04.5767
G. Petneházi, “Recurrent Neural Networks for Time Series Forecasting,” Jan. 2019, Accessed: Jan. 18, 2024. [Online]. Available: https://arxiv.org/abs/1901.00069v1
Mukherjee, P., Palan, P., & Bonde, M. V. (2021). Using Machine Learning and Artificial Intelligence Principles to Implement a Wealth Management System. In International Journal of Soft Computing and Engineering (Vol. 10, Issue 5, pp. 26–31). https://doi.org/10.35940/ijsce.f3500.0510521
Stock Price Prediction. (2019). In International Journal of Innovative Technology and Exploring Engineering (Vol. 9, Issue 2S, pp. 425–429). https://doi.org/10.35940/ijitee.b1042.1292s19
Md. Rakib, M. K., Himu, H. D., Fahim, Md. O. F., Zaman, Ms. Z., & Palak, MD. J. U. R. (2023). Automatic Recognition of Medicinal Plants: Based on Multispectral and Texture Features using Hidden Deep Learning Model. In Indian Journal of Computer Graphics and Multimedia (Vol. 3, Issue 1, pp. 1–7). https://doi.org/10.54105/ijcgm.d4089.023123
Rajeev, H., & Chakkaravarty, Dr. M. (2023). Prediction of Cybercrime using the Avinashak Algorithm. In Indian Journal of Artificial Intelligence and Neural Networking (Vol. 4, Issue 1, pp. 5–10). https://doi.org/10.54105/ijainn.a1078.124123
Jindam, S., Mannem, J. K., Nenavath, M., & Munigala, V. (2023). Heritage Identification of Monuments using Deep Learning Techniques. In Indian Journal of Image Processing and Recognition (Vol. 3, Issue 4, pp. 1–7). https://doi.org/10.54105/ijipr.d1022.063423