Deep Learning-Based Sentiment Analysis Using Gated Recurrent Unit
DOI:
https://doi.org/10.25077/aijaset.v5i1.217Abstract
In today’s volatile financial markets, investor sentiment plays a crucial role in shaping market dynamics and influencing investment decisions. Traditional analytical methods often fail to capture the subtle emotional cues embedded in vast amounts of unstructured textual data derived from news articles, social media, and financial reports. This study addresses this challenge by employing a deep learning-based approach using Gated Recurrent Units (GRU) for sentiment analysis, thereby enhancing the accuracy of financial market predictions. The research employs a systematic methodology that begins with data collection from various financial sources. This is followed by rigorous preprocessing, including data cleaning, tokenization, and downsampling to balance sentiment classes. Sentiment labeling and feature engineering, utilizing word embeddings, convert textual data into a format suitable for deep learning. The Gated Recurrent Unit (GRU) model is then trained on these features, and its performance is evaluated using metrics such as accuracy, precision, recall, and F1-score. Results indicate that while the Gated Recurrent Unit (GRU) model effectively captures neutral sentiments, it struggles to accurately classify negative and positive sentiments, highlighting areas for improvement. These findings underscore the potential of GRU-based models in financial sentiment analysis while emphasizing the need for refined techniques to enhance classification accuracy. Future research should investigate hybrid architectures, integrate attention mechanisms, and leverage real-time data to enhance the robustness and comprehensiveness of market forecasting. These insights strongly advocate for ongoing advancements in deep learning strategies to refine sentiment classification and financial prediction models.
References
[1] N. O. Adelakun and A. A. Baale, "Sentiment analysis of financial news using the BERT model," ITEGAM-J. Eng. Technol. Ind. Appl., vol. 10, no. 48, pp. 21–27, 2024, doi: 10.5935/jetia.v10i48.1029.
[2] D. Aggarwal, "Defining and measuring market sentiments: A review of the literature," Qual. Res. Financ. Mark., vol. 14, no. 2, pp. 270–288, 2022, doi: 10.1108/QRFM-03-2018-0033.
[3] M. N. Ashtiani and B. Raahemi, "News-based intelligent prediction of financial markets using text mining and machine learning: A systematic literature review," Expert Syst. Appl., vol. 217, p. 119509, 2023, doi: 10.1016/j.eswa.2023.119509.
[4] F. Mai, S. Tian, C. Lee, and L. Ma, "Deep learning models for bankruptcy prediction using textual disclosures," Eur. J. Oper. Res., vol. 274, no. 2, pp. 743–758, 2019, doi: 10.1016/j.ejor.2018.10.024.
[5] A. M. Ozbayoglu, M. U. Gudelek, and O. B. Sezer, "Deep learning for financial applications: A survey," Appl. Soft Comput., vol. 93, p. 106384, 2020, doi: 10.1016/j.asoc.2020.106384.
[6] N. O. Adelakun, Deep Learning Methods for Sentiment Analysis Using BERT and GRU Models, Lambert Academic Publishing, London, U.K., 2024.
[7] N. Yadav, "Enhancing stock trend prediction using BERT-based sentiment analysis and machine learning techniques," Int. J. Quant. Res. Model., vol. 5, no. 1, pp. 1–11, 2024, doi: 10.46336/ijqrm.v5i1.567.
[8] S. Sohangir, D. Wang, A. Pomeranets, and T. M. Khoshgoftaar, "Big data: Deep learning for financial sentiment analysis," J. Big Data, vol. 5, no. 1, pp. 1–25, 2018, doi: 10.1186/s40537-017-0111-6.
[9] M. Tarsi, S. Douzi, and A. Marzak, "Forecasting financial market dynamics: An in-depth analysis of social media data for predicting price movements in the next day," Soc. Netw. Anal. Min., vol. 14, no. 1, p. 169, 2024, doi: 10.1007/s13278-024-01338-2.
[10] N. O. Adelakun, "Sentiment analysis with deep learning techniques," M.S. thesis, Faculty of Science, National Open University of Nigeria, Abuja, Nigeria, 2023.
[11] B. Saberi and S. Saad, "Sentiment analysis or opinion mining: A review," Int. J. Adv. Sci. Eng. Inf. Technol., vol. 7, no. 5, pp. 1660–1666, 2017.
[12] N. O. Adelakun and S. A. Omolola, "Predictive maintenance for energy systems in built environments using deep learning models," in Proc. 2nd Int. Facilities Eng. Manage. Conf., Exhib., AGM (IFEMCE 2024), Nigerian Institution of Facilities Engineering and Management, 2024, pp. 52–60, doi: 10.5281/zenodo.14850059.
[13] N. O. Adelakun, "Navigating challenges and future trends in sentiment analysis for investment decision making," Inf. Matters, vol. 3, no. 7, 2023. [Online]. Available: https://informationmatters.org/2023/07/navigating-challenges-and-future-trends-in-sentiment-analysis-for-investment-decision-making. doi: 10.2139/ssrn.4513208.
[14] J. Bollen, H. Mao, and X. Zeng, "Twitter mood predicts the stock market," J. Comput. Sci., vol. 2, no. 1, pp. 1–8, 2011, doi: 10.1016/j.jocs.2010.12.007.
[15] J. L. Seng and H. F. Yang, "The association between stock price volatility and financial news–a sentiment analysis approach," Kybernetes, vol. 46, no. 8, pp. 1341–1365, 2017, doi: 10.1108/K-11-2016-0307.
[16] K. Nyakurukwa and Y. Seetharam, "Sentimental showdown: News media vs. social media in stock markets," Heliyon, vol. 10, no. 9, 2024.
[17] N. Das, B. Sadhukhan, S. S. Bhakta, and S. Chakrabarti, "Integrating EEMD and ensemble CNN with X (Twitter) sentiment for enhanced stock price predictions," Soc. Netw. Anal. Min., vol. 14, no. 1, p. 29, 2024, doi: 10.1007/s13278-023-01190-w.
[18] P. Dey, E. Hossain, M. I. Hossain, M. A. Chowdhury, M. S. Alam, M. S. Hossain, and K. Andersson, "Comparative analysis of recurrent neural networks in stock price prediction for different frequency domains," Algorithms, vol. 14, no. 8, p. 251, 2021, doi: 10.3390/a14080251.
[19] K. N. Neeraj and V. Maurya, "A review on machine learning (feature selection, classification and clustering) approaches of big data mining in different area of research," J. Crit. Rev., vol. 7, no. 19, pp. 2610–2626, 2020.
[20] K. Kowsari et al., "Text classification algorithms: A survey," Information, vol. 10, no. 4, p. 150, 2019, doi: 10.3390/info10040150.
[21] E. Omara, M. Mousa, and N. Ismail, "Character gated recurrent neural networks for Arabic sentiment analysis," Sci. Rep., vol. 12, no. 1, p. 9779, 2022, doi: 10.1038/s41598-022-13153-w.
[22] P. Sunagar et al., "Hybrid RNN based text classification model for unstructured data," SN Comput. Sci., vol. 5, no. 6, p. 726, 2024, doi: 10.1007/s42979-024-03091-x.
[23] K. W. Trisna, J. I. Huang, H. E. Lei, and E. Muntina, "From context-independent embedding to transformer: Exploring sentiment classification in online reviews with deep learning approaches," J. Theor. Appl. Inf. Technol., vol. 102, pp. 6980–7003, 2024.
[24] A. Sghir and A. Iroshan, "Unleashing the power of LSTMs: Advancements and applications in sequential data processing," SSRN, 2024. [Online]. Available: https://dx.doi.org/10.2139/ssrn.5032045.
[25] H. Ye, Y. Zhang, H. Liu, X. Li, J. Chang, and H. Zheng, "Light recurrent unit: Towards an interpretable recurrent neural network for modeling long-range dependency," Electronics, vol. 13, no. 16, p. 3204, 2024, doi: 10.3390/electronics13163204.
[26] J. Chung, C. Gulcehre, K. Cho, and Y. Bengio, "Empirical evaluation of gated recurrent neural networks on sequence modeling," arXiv preprint arXiv:1412.3555, 2014.
[27] G. B. Zhou, J. Wu, C. L. Zhang, and Z. H. Zhou, "Minimal gated unit for recurrent neural networks," Int. J. Autom. Comput., vol. 13, no. 3, pp. 226–234, 2016, doi: 10.1007/s11633-016-1006-2.
[28] J. Zhang, S. Cui, Y. Xu, Q. Li, and T. Li, "A novel data-driven stock price trend prediction system," Expert Syst. Appl., vol. 97, pp. 60–69, 2018, doi: 10.1016/j.eswa.2017.12.026.
[29] M. Zulqarnain, R. Ghazali, M. Aamir, and Y. M. M. Hassim, "An efficient two-state GRU based on feature attention mechanism for sentiment analysis," Multimed. Tools Appl., vol. 83, no. 1, pp. 3085–3110, 2024, doi: 10.1007/s11042-022-13339-2.
[30] P. Malo, A. Sinha, P. Korhonen, J. Wallenius, and P. Takala, “Good debt or bad debt: Detecting semantic orientations in economic texts”. Journal of the Association for Information Science and Technology, vol. 83, no. 4, pp. 782-796, 2014, doi: 10.1002/asi.23062
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Najeem Olawale Adelakun

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.


