Main Article Content

Abstract

Emotion analysis in product reviews plays a crucial role in Indonesia’s e-commerce landscape, yet training advanced transformer models demands high computational resources, posing a significant constraint for small businesses. This research evaluates the Low-Rank Adaptation (LoRA) technique for optimizing emotion recognition in Indonesian product reviews, with a focus on resource efficiency. Indobert-large-p2, Indobert-base-uncased, and Indobertweet-base-uncased models were trained on the PRDECT-ID dataset, comparing the performance of full fine-tuning and LoRA. Results show LoRA provided competitive performance; on the Indobert-large-p2 model, the F1-score reached 67.81%, surpassing full fine-tuning’s 67.74%, despite training only about 1% of the total parameters. LoRA significantly reduced VRAM consumption by up to 17% and accelerated training duration by up to four minutes. Furthermore, the transformer models fine-tuned in this study, using both LoRA and full fine-tuning, consistently outperformed the results of previous research that employed complex architectures like CNN and BiLSTM, with the highest F1-score reaching 69.72% compared to the previous best of 66.13%. LoRA proves to be a practical and efficient solution for limited computational resources, enabling effective emotion analysis without expensive infrastructure.

Keywords

Emotion Recognition LoRA Transformer Product Reviews Bahasa Indonesia

Article Details

How to Cite
Suharjanto, D., & Mustakim, M. . (2026). Optimizing Emotion Recognition in Indonesian Product Reviews Using LoRA on Transformer. Jurnal Sains, Nalar, Dan Aplikasi Teknologi Informasi, 5(2), 118–127. https://doi.org/10.20885/snati.v5.i2.48248

References

  1. Y. M. Ginting, T. Chandra, I. Miran, and Y. Yusriadi, “Repurchase intention of e-commerce customers in Indonesia: An overview of the effect of e-service quality, e-word of mouth, customer trust, and customer satisfaction mediation,” International Journal of Data and Network Science, vol. 7, no. 1, pp. 329–340, 2023, doi: 10.5267/j.ijdns.2022.10.001. DOI: https://doi.org/10.5267/j.ijdns.2022.10.001
  2. S. Nida, A. Nurhakim, J. M. Noor Isiqamah, and Nuraini, “ANALISIS PERKEMBANGAN TOKO ONLINE (E-COMMERCE) DI INDONESIA,” Jurnal Bisnis Digital, vol. 2, no. 1, pp. 126–137, May 2024, doi: 10.52060/j-bisdig.v2i1.2180. DOI: https://doi.org/10.52060/j-bisdig.v2i1.2180
  3. Rachmiani, N. K. Oktadinna, and T. R. Fauzan, “The Impact of Online Reviews and Ratings on Consumer Purchasing Decisions on E commerce Platforms,” International Journal of Management Science and Information Technology, vol. 4, no. 2, pp. 504–515, Dec. 2024, doi: 10.35870/ijmsit.v4i2.3373. DOI: https://doi.org/10.35870/ijmsit.v4i2.3373
  4. Y. Sun, K. Sekiguchi, and Y. Ohsawa, “The Impact of Sentiment Scores Extracted from Product Descriptions on Customer Purchase Intention,” New Gener. Comput., vol. 42, no. 4, pp. 617–633, 2024, doi: 10.1007/s00354-024-00242-9. DOI: https://doi.org/10.1007/s00354-024-00242-9
  5. A. Ananda and A. Sudrajat, “Pengaruh Ulasan Produk dan Layanan Purna Jual terhadap Minat Beli Ulang Smartphone Xiaomi Redmi Note 11 (Survei pada Komunitas Pengguna Xiaomi Redmi Note 11),” Jurnal Ilmiah Wahana Pendidikan, vol. 8, no. 15, Sep. 2022, doi: 10.5281/zenodo.7040099.
  6. S. Sudaryanto, H. Anifatul, R. D. Ivana, K. Asila Dwi, and R. and Rusdiyanto, “The mediating effect of customer trust of E-WOM and online customer reviews impacting purchase decision of household electronic products at a marketplace: evidence from Indonesia,” Cogent Business & Management, vol. 12, no. 1, p. 2503093, Dec. 2025, doi: 10.1080/23311975.2025.2503093. DOI: https://doi.org/10.1080/23311975.2025.2503093
  7. A. B. M. Samiaji, D. A. Pramesti, and M. W. Ibrahim, “Pengaruh Kualitas Produk, Ulasan Konsumen, dan Citra Merek terhadap Kepuasan Pelanggan Melalui Keputusan Pembelian,” in Prosiding Business and Economics Conference in Utilizing of Modern Technology (BIS HSS 2024), in UMMagelang Conference Series. Universitas Muhammadiyah Magelang, Aug. 2024. doi: 10.31603/conference.12041. DOI: https://doi.org/10.31603/conference.12041
  8. L. Livina and H. K. Tunjungsari, “Pengaruh persepsi kegunaan dari ulasan online, kepercayaan konsumen, dan persepsi risiko pada intensi membeli produk busana secara online,” Jurnal Manajemen Bisnis dan Kewirausahaan, vol. 9, no. 2, pp. 352–364, Mar. 2025, doi: 10.24912/jmbk.v9i2.32361. DOI: https://doi.org/10.24912/jmbk.v9i2.32361
  9. M. Sun and J. Zhao, “Behavioral Patterns beyond Posting Negative Reviews Online: An Empirical View,” Journal of Theoretical and Applied Electronic Commerce Research, vol. 17, no. 3, pp. 949–983, 2022, doi: 10.3390/jtaer17030049. DOI: https://doi.org/10.3390/jtaer17030049
  10. M. F. A. Thariq, “Pengaruh E-WOM, Customer Relationship Management, dan Emotional Branding Terhadap Loyalty Konsumen,” Jurnal Manajemen Pemasaran Dan Perilaku Konsumen, vol. 2, no. 3, pp. 814–827, 2023, doi: 10.21776/jmppk.2022.02.3.23. DOI: https://doi.org/10.21776/jmppk.2022.02.3.23
  11. A. Rahmawati, D. Sugandini, and Y. Istanto, “Pengaruh Customer Experience terhadap Attitude Loyalty dan Behavioral Loyalty yang Dimediasi oleh Emotional Experience pada Pengguna Mobile Application Shopee (Studi Kasus di Yogyakarta),” JMBI UNSRAT (Jurnal Ilmiah Manajemen Bisnis dan Inovasi Universitas Sam Ratulangi), vol. 8, no. 3, Dec. 2021, doi: 10.35794/jmbi.v8i3.36740. DOI: https://doi.org/10.35794/jmbi.v8i3.36740
  12. S. Kundu and S. Chakraborti, “A Comparative Study of Online Consumer Reviews Among Mainstream and Niche Products: Analysis Across Emerging and Developed Markets,” International Journal of Business Analytics, vol. 11, no. 1, 2024, doi: 10.4018/IJBAN.353306. DOI: https://doi.org/10.4018/IJBAN.353306
  13. Y. K. Dwivedi et al., “Setting the future of digital and social media marketing research: Perspectives and research propositions,” Int. J. Inf. Manage., vol. 59, p. 102168, 2021, doi: https://doi.org/10.1016/j.ijinfomgt.2020.102168. DOI: https://doi.org/10.1016/j.ijinfomgt.2020.102168
  14. A. Zablocki, K. Makri, and M. J. Houston, “Emotions Within Online Reviews and their Influence on Product Attitudes in Austria, USA and Thailand,” Journal of Interactive Marketing, vol. 46, pp. 20–39, 2019, doi: https://doi.org/10.1016/j.intmar.2019.01.001. DOI: https://doi.org/10.1016/j.intmar.2019.01.001
  15. G. Kaur and A. Sharma, “A deep learning-based model using hybrid feature extraction approach for consumer sentiment analysis,” J. Big Data, vol. 10, no. 1, 2023, doi: 10.1186/s40537-022-00680-6. DOI: https://doi.org/10.1186/s40537-022-00680-6
  16. A. Devi Putri Ariyanto, F. K. Fikriah, and A. F. Setyawan, “Impact of Statistical and Semantic Features Extraction for Emotion Detection on Indonesian Short Text Sentences,” Commit Journal, vol. 19, no. 1, pp. 1–13, 2025, doi: 10.21512/commit.v19i1.11680. DOI: https://doi.org/10.21512/commit.v19i1.11680
  17. M. A. Riza and N. Charibaldi, “Emotion Detection in Twitter Social Media Using Long Short-Term Memory (LSTM) and Fast Text,” International Journal of Artificial Intelligence & Robotics (IJAIR), vol. 3, no. 1, pp. 15–26, 2021, doi: 10.25139/ijair.v3i1.3827. DOI: https://doi.org/10.25139/ijair.v3i1.3827
  18. T. Chutia and N. Baruah, “A review on emotion detection by using deep learning techniques,” Artif. Intell. Rev., vol. 57, no. 8, p. 203, 2024, doi: 10.1007/s10462-024-10831-1. DOI: https://doi.org/10.1007/s10462-024-10831-1
  19. M. S. Saputri, R. Mahendra, and M. Adriani, “Emotion Classification on Indonesian Twitter Dataset,” in 2018 International Conference on Asian Language Processing (IALP), 2018, pp. 90–95. doi: 10.1109/IALP.2018.8629262. DOI: https://doi.org/10.1109/IALP.2018.8629262
  20. D. Haryadi and G. P. Kusuma, “Emotion Detection in Text using Nested Long Short-Term Memory,” International Journal of Advanced Computer Science and Applications, vol. 10, no. 6, 2019, doi: 10.14569/IJACSA.2019.0100645. DOI: https://doi.org/10.14569/IJACSA.2019.0100645
  21. T. Liu, Y. Du, and Q. Zhou, “Text Emotion Recognition Using GRU Neural Network with Attention Mechanism and Emoticon Emotions,” in Proceedings of the 2020 2nd International Conference on Robotics, Intelligent Control and Artificial Intelligence, in RICAI ’20. New York, NY, USA: Association for Computing Machinery, 2020, pp. 278–282. doi: 10.1145/3438872.3439094. DOI: https://doi.org/10.1145/3438872.3439094
  22. A. Chowanda, R. Sutoyo, S. Achmad, E. W. Andangsari, S. M. Isa, and T.-K. Chen, “MODELING EMOTIONS RECOGNITION ON INDONESIAN PRODUCT REVIEW BY COMBINING BERT, CNN, AND LSTM ARCHITECTURE,” International Journal of Innovative Computing Information and Control, vol. 20, no. 3, pp. 929–944, 2024, doi: 10.24507/ijicic.20.03.929.
  23. R. Sutoyo, S. Achmad, A. Chowanda, E. W. Andangsari, and S. M. Isa, “PRDECT-ID: Indonesian product reviews dataset for emotions classification tasks,” Data Brief, vol. 44, 2022, doi: 10.1016/j.dib.2022.108554. DOI: https://doi.org/10.1016/j.dib.2022.108554
  24. Y. O. Sihombing, R. Fuad Rachmadi, S. Sumpeno, and Moh. J. Mubarok, “Optimizing IndoRoBERTa Model for Multi-Class Classification of Sentiment & Emotion on Indonesian Twitter,” in 2024 IEEE 10th Information Technology International Seminar (ITIS), 2024, pp. 12–17. doi: 10.1109/ITIS64716.2024.10845566. DOI: https://doi.org/10.1109/ITIS64716.2024.10845566
  25. H. Ahmadian, T. F. Abidin, H. Riza, and K. Muchtar, “Transformer-Based Indonesian Language Model for Emotion Classification and Sentiment Analysis,” in 2023 International Conference on Information Technology and Computing (ICITCOM), 2023, pp. 209–214. doi: 10.1109/ICITCOM60176.2023.10442970. DOI: https://doi.org/10.1109/ICITCOM60176.2023.10442970
  26. L. Wang et al., “Parameter-efficient fine-tuning in large language models: a survey of methodologies,” Artif. Intell. Rev., vol. 58, no. 8, p. 227, 2025, doi: 10.1007/s10462-025-11236-4. DOI: https://doi.org/10.1007/s10462-025-11236-4
  27. N. Houlsby et al., “Parameter-Efficient Transfer Learning for NLP,” CoRR, vol. abs/1902.00751, 2019, [Online]. Available: http://arxiv.org/abs/1902.00751
  28. X. L. Li and P. Liang, “Prefix-Tuning: Optimizing Continuous Prompts for Generation,” CoRR, vol. abs/2101.00190, 2021, [Online]. Available: https://arxiv.org/abs/2101.00190
  29. T. Dettmers, A. Pagnoni, A. Holtzman, and L. Zettlemoyer, “QLORA: efficient finetuning of quantized LLMs,” in Proceedings of the 37th International Conference on Neural Information Processing Systems, in NIPS ’23. Red Hook, NY, USA: Curran Associates Inc., 2023. DOI: https://doi.org/10.52202/075280-0441
  30. E. J. Hu et al., “LoRA: Low-Rank Adaptation of Large Language Models,” CoRR, vol. abs/2106.09685, 2021, [Online]. Available: https://arxiv.org/abs/2106.09685
  31. V. B. Parthasarathy, A. Zafar, A. Khan, and A. Shahid, “The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunities,” 2024. [Online]. Available: https://arxiv.org/abs/2408.13296
  32. F. Koto, A. Rahimi, J. H. Lau, and T. Baldwin, “IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP,” CoRR, vol. abs/2011.00677, 2020, [Online]. Available: https://arxiv.org/abs/2011.00677
  33. F. Koto, J. H. Lau, and T. Baldwin, “IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization,” in Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, M.-F. Moens, X. Huang, L. Specia, and S. W. Yih, Eds., Online and Punta Cana, Dominican Republic: Association for Computational Linguistics, Nov. 2021, pp. 10660–10668. doi: 10.18653/v1/2021.emnlp-main.833. DOI: https://doi.org/10.18653/v1/2021.emnlp-main.833
  34. S. Hayou, N. Ghosh, and B. Yu, “LoRA+: Efficient Low Rank Adaptation of Large Models,” 2024. [Online]. Available: https://arxiv.org/abs/2402.12354
  35. D. Biderman et al., “LoRA Learns Less and Forgets Less,” 2024. [Online]. Available: https://arxiv.org/abs/2405.09673
  36. S.-Y. Liu et al., “DoRA: weight-decomposed low-rank adaptation,” in Proceedings of the 41st International Conference on Machine Learning, in ICML’24. JMLR.org, 2024.
  37. Z. Wu et al., “ReFT: Representation Finetuning for Language Models,” 2024. [Online]. Available: https://arxiv.org/abs/2404.03592