Time-Series Monitoring of Sentiment Dynamics in Reviews of Four Indonesian E-Wallet Applications Using a Hybrid TF-IDF and Bi-LSTM Framework
DOI:
https://doi.org/10.63158/journalisi.v8i2.1488Keywords:
app review mining, Bi-LSTM, Google Play Store reviews, Indonesian e-wallet, temporal sentiment, monitoring, TF-IDFAbstract
This study proposes a hybrid sentiment analysis framework to examine user perceptions of four Indonesian e-wallet applications using Google Play Store reviews. The framework combines TF-IDF features reduced through Truncated SVD with a Bidirectional Long Short-Term Memory (Bi-LSTM) model within a two-stage evaluation design consisting of holdout classification and external temporal inference. For supervised classification, 20,000 raw reviews were filtered and labeled using a rating-based strategy, resulting in 13,823 labeled reviews. Reviews with ratings of 4–5 stars were assigned to the positive class and 1–2 stars to the negative class; these labels should be interpreted as sentiment proxies rather than fully human-validated ground truth. A second dataset of 24,000 reviews was constructed for balanced cross-application temporal comparison across 2024–2026. On the holdout test set, the proposed model achieved an accuracy of 0.881, with macro-F1 and weighted-F1 scores of 0.881. Under the external temporal setting, DANA remained relatively stable, GoPay improved markedly in 2025 and remained high in 2026, ShopeePay showed a gradual decline, and OVO exhibited the strongest negative trend. These results indicate that the proposed framework is useful not only for supervised sentiment classification but also for structured temporal monitoring across e-wallet platforms.
Downloads
References
[1] Tikno, Y. S. Dharmawan, and Ngatini, “Investigating Consumer Acceptance of Mobile Payment Services in Indonesia,” Procedia Comput. Sci., vol. 234, pp. 1095–1102, 2024, doi: 10.1016/j.procs.2024.03.104.
[2] A. Yasin, R. Fatima, A. Nauman, and Z. Wei, “Python data odyssey: Mining user feedback from google play store,” Data Br., vol. 54, p. 110499, 2024, doi: 10.1016/j.dib.2024.110499.
[3] Y. Mao, Q. Liu, and Y. Zhang, “Sentiment analysis methods, applications, and challenges: A systematic literature review,” J. King Saud Univ. - Comput. Inf. Sci., vol. 36, no. 4, p. 102048, 2024, doi: 10.1016/j.jksuci.2024.102048.
[4] Y. Bau, T. E. Leong, and C. Goh, “Sentiment Analysis of E-Wallet Companies : Exploring Customer Ratings and Perceptions,” J. Logist. Informatics Serv. Sci., vol. 10, no. 4, pp. 189–205, 2023, doi: 10.33168/JLISS.2023.0413.
[5] S. Masturoh, R. L. Pratiwi, M. R. R. Saelan, and U. Radiyah, “Application Of The K-Nearest Neighbor ( Knn ) Algorithm In Sentiment Analysis of The Ovo E-Wallet Application,” JITK(JURNAL ILMU Pengetah. DAN Teknol. KOMPUTER), vol. 8, no. 2, pp. 8–13, 2023, doi: 10.33480/jitk.v8i2.3997.
[6] H. Juandri, Hasmawati, and Bunyamin, “Aspect-level sentiment analysis on GoPay app reviews using multilayer perceptron and word embeddings,” Kinet. Game Technol. Inf. Syst. Comput. Network, Comput. Electron. Control, vol. 9, no. 4, pp. 397–408, 2024, doi: 10.22219/kinetik.v9i4.2041.
[7] M. Rodríguez-Ibánez, A. Casánez-Ventura, F. Castejón-Mateos, and P.-M. Cuenca-Jiménez, “A review on sentiment analysis from social media platforms,” Expert Syst. Appl., vol. 223, p. 119862, 2023, doi: 10.1016/j.eswa.2023.119862.
[8] X. Wang, T. Zhang, Y. Tan, W. Shang, and Y. Li, “How to effectively mine app reviews concerning software ecosystem? A survey of review characteristics,” J. Syst. Softw., vol. 213, p. 112040, 2024, doi: https://doi.org/10.1016/j.jss.2024.112040.
[9] S. Maldonado, J. López, and A. Iturriaga, “Out-of-time cross-validation strategies for classification in the presence of dataset shift,” Appl. Intell., vol. 52, no. 5, pp. 5770–5783, 2022, doi: 10.1007/s10489-021-02735-2.
[10] H. Adiningtyas and A. S. Auliani, “Sentiment analysis for mobile banking service quality measurement,” Procedia Comput. Sci., vol. 234, pp. 40–50, 2024, doi: 10.1016/j.procs.2024.02.150.
[11] R. Alawaji and A. Aloraini, “Sentiment Analysis of Digital Banking Reviews Using Machine Learning and Large Language Models,” Electronics, vol. 14, no. 11, 2025, doi: 10.3390/electronics14112125.
[12] J. Dąbrowski, E. Letier, A. Perini, and A. Susi, “Analysing app reviews for software engineering: a systematic literature review,” Empir. Softw. Eng., vol. 27, no. 2, p. 43, 2022, doi: 10.1007/s10664-021-10065-7.
[13] D. I. Af’idah, P. D. Anggraeni, M. Rizki, A. B. Setiawan, and S. F. Handayani, “Aspect-Based Sentiment Analysis for Indonesian Tourist Attraction Reviews Using Bidirectional Long Short-Term Memory,” JUITA J. Inform., vol. 11, no. 1 SE-Articles, pp. 27–36, May 2023, doi: 10.30595/juita.v11i1.15341.
[14] W. M. Baihaqi and A. Munandar, “Sentiment Analysis of Student Comment on the College Performance Evaluation Questionnaire Using Naïve Bayes and IndoBERT,” JUITA J. Inform., vol. 11, no. 2, pp. 213–220, 2023.
[15] R. B. Adinata, S. Supriyono, and D. L. Fithri, “Sentiment Classification of MyTelkomsel Reviews Using SVM and Logistic Regression,” IJCCS (Indonesian J. Comput. Cybern. Syst., vol. 20, no. 1, 2026, doi: 10.22146/ijccs.110409.
[16] Y. N. Kunang and W. P. Mentari, “Analysis of the Impact of Vectorization Methods on Machine Learning-Based Sentiment Analysis of Tweets Regarding Readiness for Offline Learning,” JUITA J. Inform., vol. 11, no. 2, pp. 271–280, 2023.
[17] H. Mustakim and S. Priyanta, “Aspect-Based Sentiment Analysis of KAI Access Reviews Using NBC and SVM,” IJCCS (Indonesian J. Comput. Cybern. Syst., vol. 16, no. 2, pp. 113–124, 2022, doi: 10.22146/ijccs.68903.
[18] I. Gambo, R. Massenon, R. Oluwaseun, S. Agarwal, and W. Pak, “Identifying and resolving conflict in mobile application features through contradictory feedback analysis,” Heliyon, vol. 10, no. 17, p. e36729, 2024, doi: 10.1016/j.heliyon.2024.e36729.
[19] M. I. Alfarizi, L. Syafaah, and M. Lestandy, “Emotional Text Classification Using TF-IDF (Term Frequency-Inverse Document Frequency) And LSTM (Long Short-Term Memory),” JUITA J. Inform., vol. 10, no. 2 SE-Articles, pp. 225–232, Nov. 2022, doi: 10.30595/juita.v10i2.13262.
[20] G. Tamami, W. A. Triyanto, and S. Muzid, “Sentiment Analysis Mobile JKN Reviews Using SMOTE Based LSTM,” IJCCS (Indonesian J. Comput. Cybern. Syst., vol. 19, no. 1, pp. 13–24, 2025, doi: 10.22146/ijccs.101910.
[21] M. Parhusip, S. Sudianto, and T. G. Laksana, “Sentiment Analysis of the Public Towards the Kanjuruhan Tragedy with the Support Vector Machine Method,” JUITA J. Inform., vol. 11, no. 2, pp. 241–251, 2023.
[22] N. K. A, D. Lestari, and G. T. Pranoto, “Sentiment Analysis Review Threads Google Play Store with RoBERTa Model,” J. Nas. Tek. Elektro dan Teknol. Inf., vol. 14, no. 4, pp. 272–280, 2025, doi: 10.22146/jnteti.v14i4.22038.
[23] R. D. Kurniawan, A. Yohannis, and W. T. Atmojo, “Sentiment Analysis of Getcontact Application Reviews on Google Play Store Using Naive Bayes Algorithm,” J. Tek. Inform., vol. 6, no. 4, pp. 2848–2858, 2025, doi: 10.52436/1.jutif.2025.6.4.5248.
[24] N. Laili, I. Fuji, T. Vani, D. Naraya, and H. Niken, “NLP-Based Sentiment Analysis of Alfagift and Klik Indomaret Application Reviews : A Comparative Study,” J. Inf. Syst. Informatics, vol. 7, no. 3, pp. 2458–2475, 2025, doi: 10.51519/journalisi.v7i3.1178.
[25] H. Kelvin, Y. Desnelita, and D. Oktarina, “Sentiment Analysis of IKD Application Reviews on Play Store Using Random Forest,” J. Nas. Tek. Elektro dan Teknol., vol. 14, no. 3, pp. 171–180, 2025, doi: 10.22146/jnteti.v14i3.20473.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Journal of Information Systems and Informatics
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors Declaration
- The Authors certify that they have read, understood, and agreed to the Journal of Information Systems and Informatics (JournalISI) submission guidelines, policies, and submission declaration. The submission has been prepared using the provided template.
- The Authors certify that all authors have approved the publication of this manuscript and that there is no conflict of interest.
- The Authors confirm that the manuscript is their original work, has not received prior publication, is not under consideration for publication elsewhere, and has not been previously published.
- The Authors confirm that all authors listed on the title page have contributed significantly to the work, have read the manuscript, attest to the validity and legitimacy of the data and its interpretation, and agree to its submission.
- The Authors confirm that the manuscript is not copied from or plagiarized from any other published work.
- The Authors declare that the manuscript will not be submitted for publication in any other journal or magazine until a decision is made by the journal editors.
- If the manuscript is finally accepted for publication, the Authors confirm that they will either proceed with publication immediately or withdraw the manuscript in accordance with the journal’s withdrawal policies.
- The Authors agree that, upon publication of the manuscript in this journal, they transfer copyright or assign exclusive rights to the publisher, including commercial rights
