Main Article Content
Abstract
Emotion analysis in product reviews plays a crucial role in Indonesia’s e-commerce landscape, yet training advanced transformer models demands high computational resources, posing a significant constraint for small businesses. This research evaluates the Low-Rank Adaptation (LoRA) technique for optimizing emotion recognition in Indonesian product reviews, with a focus on resource efficiency. Indobert-large-p2, Indobert-base-uncased, and Indobertweet-base-uncased models were trained on the PRDECT-ID dataset, comparing the performance of full fine-tuning and LoRA. Results show LoRA provided competitive performance; on the Indobert-large-p2 model, the F1-score reached 67.81%, surpassing full fine-tuning’s 67.74%, despite training only about 1% of the total parameters. LoRA significantly reduced VRAM consumption by up to 17% and accelerated training duration by up to four minutes. Furthermore, the transformer models fine-tuned in this study, using both LoRA and full fine-tuning, consistently outperformed the results of previous research that employed complex architectures like CNN and BiLSTM, with the highest F1-score reaching 69.72% compared to the previous best of 66.13%. LoRA proves to be a practical and efficient solution for limited computational resources, enabling effective emotion analysis without expensive infrastructure.
Keywords
Article Details
Copyright (c) 2026 David Suharjanto, Muhammad Mustakim

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
References
- Y. M. Ginting, T. Chandra, I. Miran, and Y. Yusriadi, “Repurchase intention of e-commerce customers in Indonesia: An overview of the effect of e-service quality, e-word of mouth, customer trust, and customer satisfaction mediation,” International Journal of Data and Network Science, vol. 7, no. 1, pp. 329–340, 2023, doi: 10.5267/j.ijdns.2022.10.001. DOI: https://doi.org/10.5267/j.ijdns.2022.10.001
- S. Nida, A. Nurhakim, J. M. Noor Isiqamah, and Nuraini, “ANALISIS PERKEMBANGAN TOKO ONLINE (E-COMMERCE) DI INDONESIA,” Jurnal Bisnis Digital, vol. 2, no. 1, pp. 126–137, May 2024, doi: 10.52060/j-bisdig.v2i1.2180. DOI: https://doi.org/10.52060/j-bisdig.v2i1.2180
- Rachmiani, N. K. Oktadinna, and T. R. Fauzan, “The Impact of Online Reviews and Ratings on Consumer Purchasing Decisions on E commerce Platforms,” International Journal of Management Science and Information Technology, vol. 4, no. 2, pp. 504–515, Dec. 2024, doi: 10.35870/ijmsit.v4i2.3373. DOI: https://doi.org/10.35870/ijmsit.v4i2.3373
- Y. Sun, K. Sekiguchi, and Y. Ohsawa, “The Impact of Sentiment Scores Extracted from Product Descriptions on Customer Purchase Intention,” New Gener. Comput., vol. 42, no. 4, pp. 617–633, 2024, doi: 10.1007/s00354-024-00242-9. DOI: https://doi.org/10.1007/s00354-024-00242-9
- A. Ananda and A. Sudrajat, “Pengaruh Ulasan Produk dan Layanan Purna Jual terhadap Minat Beli Ulang Smartphone Xiaomi Redmi Note 11 (Survei pada Komunitas Pengguna Xiaomi Redmi Note 11),” Jurnal Ilmiah Wahana Pendidikan, vol. 8, no. 15, Sep. 2022, doi: 10.5281/zenodo.7040099.
- S. Sudaryanto, H. Anifatul, R. D. Ivana, K. Asila Dwi, and R. and Rusdiyanto, “The mediating effect of customer trust of E-WOM and online customer reviews impacting purchase decision of household electronic products at a marketplace: evidence from Indonesia,” Cogent Business & Management, vol. 12, no. 1, p. 2503093, Dec. 2025, doi: 10.1080/23311975.2025.2503093. DOI: https://doi.org/10.1080/23311975.2025.2503093
- A. B. M. Samiaji, D. A. Pramesti, and M. W. Ibrahim, “Pengaruh Kualitas Produk, Ulasan Konsumen, dan Citra Merek terhadap Kepuasan Pelanggan Melalui Keputusan Pembelian,” in Prosiding Business and Economics Conference in Utilizing of Modern Technology (BIS HSS 2024), in UMMagelang Conference Series. Universitas Muhammadiyah Magelang, Aug. 2024. doi: 10.31603/conference.12041. DOI: https://doi.org/10.31603/conference.12041
- L. Livina and H. K. Tunjungsari, “Pengaruh persepsi kegunaan dari ulasan online, kepercayaan konsumen, dan persepsi risiko pada intensi membeli produk busana secara online,” Jurnal Manajemen Bisnis dan Kewirausahaan, vol. 9, no. 2, pp. 352–364, Mar. 2025, doi: 10.24912/jmbk.v9i2.32361. DOI: https://doi.org/10.24912/jmbk.v9i2.32361
- M. Sun and J. Zhao, “Behavioral Patterns beyond Posting Negative Reviews Online: An Empirical View,” Journal of Theoretical and Applied Electronic Commerce Research, vol. 17, no. 3, pp. 949–983, 2022, doi: 10.3390/jtaer17030049. DOI: https://doi.org/10.3390/jtaer17030049
- M. F. A. Thariq, “Pengaruh E-WOM, Customer Relationship Management, dan Emotional Branding Terhadap Loyalty Konsumen,” Jurnal Manajemen Pemasaran Dan Perilaku Konsumen, vol. 2, no. 3, pp. 814–827, 2023, doi: 10.21776/jmppk.2022.02.3.23. DOI: https://doi.org/10.21776/jmppk.2022.02.3.23
- A. Rahmawati, D. Sugandini, and Y. Istanto, “Pengaruh Customer Experience terhadap Attitude Loyalty dan Behavioral Loyalty yang Dimediasi oleh Emotional Experience pada Pengguna Mobile Application Shopee (Studi Kasus di Yogyakarta),” JMBI UNSRAT (Jurnal Ilmiah Manajemen Bisnis dan Inovasi Universitas Sam Ratulangi), vol. 8, no. 3, Dec. 2021, doi: 10.35794/jmbi.v8i3.36740. DOI: https://doi.org/10.35794/jmbi.v8i3.36740
- S. Kundu and S. Chakraborti, “A Comparative Study of Online Consumer Reviews Among Mainstream and Niche Products: Analysis Across Emerging and Developed Markets,” International Journal of Business Analytics, vol. 11, no. 1, 2024, doi: 10.4018/IJBAN.353306. DOI: https://doi.org/10.4018/IJBAN.353306
- Y. K. Dwivedi et al., “Setting the future of digital and social media marketing research: Perspectives and research propositions,” Int. J. Inf. Manage., vol. 59, p. 102168, 2021, doi: https://doi.org/10.1016/j.ijinfomgt.2020.102168. DOI: https://doi.org/10.1016/j.ijinfomgt.2020.102168
- A. Zablocki, K. Makri, and M. J. Houston, “Emotions Within Online Reviews and their Influence on Product Attitudes in Austria, USA and Thailand,” Journal of Interactive Marketing, vol. 46, pp. 20–39, 2019, doi: https://doi.org/10.1016/j.intmar.2019.01.001. DOI: https://doi.org/10.1016/j.intmar.2019.01.001
- G. Kaur and A. Sharma, “A deep learning-based model using hybrid feature extraction approach for consumer sentiment analysis,” J. Big Data, vol. 10, no. 1, 2023, doi: 10.1186/s40537-022-00680-6. DOI: https://doi.org/10.1186/s40537-022-00680-6
- A. Devi Putri Ariyanto, F. K. Fikriah, and A. F. Setyawan, “Impact of Statistical and Semantic Features Extraction for Emotion Detection on Indonesian Short Text Sentences,” Commit Journal, vol. 19, no. 1, pp. 1–13, 2025, doi: 10.21512/commit.v19i1.11680. DOI: https://doi.org/10.21512/commit.v19i1.11680
- M. A. Riza and N. Charibaldi, “Emotion Detection in Twitter Social Media Using Long Short-Term Memory (LSTM) and Fast Text,” International Journal of Artificial Intelligence & Robotics (IJAIR), vol. 3, no. 1, pp. 15–26, 2021, doi: 10.25139/ijair.v3i1.3827. DOI: https://doi.org/10.25139/ijair.v3i1.3827
- T. Chutia and N. Baruah, “A review on emotion detection by using deep learning techniques,” Artif. Intell. Rev., vol. 57, no. 8, p. 203, 2024, doi: 10.1007/s10462-024-10831-1. DOI: https://doi.org/10.1007/s10462-024-10831-1
- M. S. Saputri, R. Mahendra, and M. Adriani, “Emotion Classification on Indonesian Twitter Dataset,” in 2018 International Conference on Asian Language Processing (IALP), 2018, pp. 90–95. doi: 10.1109/IALP.2018.8629262. DOI: https://doi.org/10.1109/IALP.2018.8629262
- D. Haryadi and G. P. Kusuma, “Emotion Detection in Text using Nested Long Short-Term Memory,” International Journal of Advanced Computer Science and Applications, vol. 10, no. 6, 2019, doi: 10.14569/IJACSA.2019.0100645. DOI: https://doi.org/10.14569/IJACSA.2019.0100645
- T. Liu, Y. Du, and Q. Zhou, “Text Emotion Recognition Using GRU Neural Network with Attention Mechanism and Emoticon Emotions,” in Proceedings of the 2020 2nd International Conference on Robotics, Intelligent Control and Artificial Intelligence, in RICAI ’20. New York, NY, USA: Association for Computing Machinery, 2020, pp. 278–282. doi: 10.1145/3438872.3439094. DOI: https://doi.org/10.1145/3438872.3439094
- A. Chowanda, R. Sutoyo, S. Achmad, E. W. Andangsari, S. M. Isa, and T.-K. Chen, “MODELING EMOTIONS RECOGNITION ON INDONESIAN PRODUCT REVIEW BY COMBINING BERT, CNN, AND LSTM ARCHITECTURE,” International Journal of Innovative Computing Information and Control, vol. 20, no. 3, pp. 929–944, 2024, doi: 10.24507/ijicic.20.03.929.
- R. Sutoyo, S. Achmad, A. Chowanda, E. W. Andangsari, and S. M. Isa, “PRDECT-ID: Indonesian product reviews dataset for emotions classification tasks,” Data Brief, vol. 44, 2022, doi: 10.1016/j.dib.2022.108554. DOI: https://doi.org/10.1016/j.dib.2022.108554
- Y. O. Sihombing, R. Fuad Rachmadi, S. Sumpeno, and Moh. J. Mubarok, “Optimizing IndoRoBERTa Model for Multi-Class Classification of Sentiment & Emotion on Indonesian Twitter,” in 2024 IEEE 10th Information Technology International Seminar (ITIS), 2024, pp. 12–17. doi: 10.1109/ITIS64716.2024.10845566. DOI: https://doi.org/10.1109/ITIS64716.2024.10845566
- H. Ahmadian, T. F. Abidin, H. Riza, and K. Muchtar, “Transformer-Based Indonesian Language Model for Emotion Classification and Sentiment Analysis,” in 2023 International Conference on Information Technology and Computing (ICITCOM), 2023, pp. 209–214. doi: 10.1109/ICITCOM60176.2023.10442970. DOI: https://doi.org/10.1109/ICITCOM60176.2023.10442970
- L. Wang et al., “Parameter-efficient fine-tuning in large language models: a survey of methodologies,” Artif. Intell. Rev., vol. 58, no. 8, p. 227, 2025, doi: 10.1007/s10462-025-11236-4. DOI: https://doi.org/10.1007/s10462-025-11236-4
- N. Houlsby et al., “Parameter-Efficient Transfer Learning for NLP,” CoRR, vol. abs/1902.00751, 2019, [Online]. Available: http://arxiv.org/abs/1902.00751
- X. L. Li and P. Liang, “Prefix-Tuning: Optimizing Continuous Prompts for Generation,” CoRR, vol. abs/2101.00190, 2021, [Online]. Available: https://arxiv.org/abs/2101.00190
- T. Dettmers, A. Pagnoni, A. Holtzman, and L. Zettlemoyer, “QLORA: efficient finetuning of quantized LLMs,” in Proceedings of the 37th International Conference on Neural Information Processing Systems, in NIPS ’23. Red Hook, NY, USA: Curran Associates Inc., 2023. DOI: https://doi.org/10.52202/075280-0441
- E. J. Hu et al., “LoRA: Low-Rank Adaptation of Large Language Models,” CoRR, vol. abs/2106.09685, 2021, [Online]. Available: https://arxiv.org/abs/2106.09685
- V. B. Parthasarathy, A. Zafar, A. Khan, and A. Shahid, “The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunities,” 2024. [Online]. Available: https://arxiv.org/abs/2408.13296
- F. Koto, A. Rahimi, J. H. Lau, and T. Baldwin, “IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP,” CoRR, vol. abs/2011.00677, 2020, [Online]. Available: https://arxiv.org/abs/2011.00677
- F. Koto, J. H. Lau, and T. Baldwin, “IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization,” in Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, M.-F. Moens, X. Huang, L. Specia, and S. W. Yih, Eds., Online and Punta Cana, Dominican Republic: Association for Computational Linguistics, Nov. 2021, pp. 10660–10668. doi: 10.18653/v1/2021.emnlp-main.833. DOI: https://doi.org/10.18653/v1/2021.emnlp-main.833
- S. Hayou, N. Ghosh, and B. Yu, “LoRA+: Efficient Low Rank Adaptation of Large Models,” 2024. [Online]. Available: https://arxiv.org/abs/2402.12354
- D. Biderman et al., “LoRA Learns Less and Forgets Less,” 2024. [Online]. Available: https://arxiv.org/abs/2405.09673
- S.-Y. Liu et al., “DoRA: weight-decomposed low-rank adaptation,” in Proceedings of the 41st International Conference on Machine Learning, in ICML’24. JMLR.org, 2024.
- Z. Wu et al., “ReFT: Representation Finetuning for Language Models,” 2024. [Online]. Available: https://arxiv.org/abs/2404.03592
References
Y. M. Ginting, T. Chandra, I. Miran, and Y. Yusriadi, “Repurchase intention of e-commerce customers in Indonesia: An overview of the effect of e-service quality, e-word of mouth, customer trust, and customer satisfaction mediation,” International Journal of Data and Network Science, vol. 7, no. 1, pp. 329–340, 2023, doi: 10.5267/j.ijdns.2022.10.001. DOI: https://doi.org/10.5267/j.ijdns.2022.10.001
S. Nida, A. Nurhakim, J. M. Noor Isiqamah, and Nuraini, “ANALISIS PERKEMBANGAN TOKO ONLINE (E-COMMERCE) DI INDONESIA,” Jurnal Bisnis Digital, vol. 2, no. 1, pp. 126–137, May 2024, doi: 10.52060/j-bisdig.v2i1.2180. DOI: https://doi.org/10.52060/j-bisdig.v2i1.2180
Rachmiani, N. K. Oktadinna, and T. R. Fauzan, “The Impact of Online Reviews and Ratings on Consumer Purchasing Decisions on E commerce Platforms,” International Journal of Management Science and Information Technology, vol. 4, no. 2, pp. 504–515, Dec. 2024, doi: 10.35870/ijmsit.v4i2.3373. DOI: https://doi.org/10.35870/ijmsit.v4i2.3373
Y. Sun, K. Sekiguchi, and Y. Ohsawa, “The Impact of Sentiment Scores Extracted from Product Descriptions on Customer Purchase Intention,” New Gener. Comput., vol. 42, no. 4, pp. 617–633, 2024, doi: 10.1007/s00354-024-00242-9. DOI: https://doi.org/10.1007/s00354-024-00242-9
A. Ananda and A. Sudrajat, “Pengaruh Ulasan Produk dan Layanan Purna Jual terhadap Minat Beli Ulang Smartphone Xiaomi Redmi Note 11 (Survei pada Komunitas Pengguna Xiaomi Redmi Note 11),” Jurnal Ilmiah Wahana Pendidikan, vol. 8, no. 15, Sep. 2022, doi: 10.5281/zenodo.7040099.
S. Sudaryanto, H. Anifatul, R. D. Ivana, K. Asila Dwi, and R. and Rusdiyanto, “The mediating effect of customer trust of E-WOM and online customer reviews impacting purchase decision of household electronic products at a marketplace: evidence from Indonesia,” Cogent Business & Management, vol. 12, no. 1, p. 2503093, Dec. 2025, doi: 10.1080/23311975.2025.2503093. DOI: https://doi.org/10.1080/23311975.2025.2503093
A. B. M. Samiaji, D. A. Pramesti, and M. W. Ibrahim, “Pengaruh Kualitas Produk, Ulasan Konsumen, dan Citra Merek terhadap Kepuasan Pelanggan Melalui Keputusan Pembelian,” in Prosiding Business and Economics Conference in Utilizing of Modern Technology (BIS HSS 2024), in UMMagelang Conference Series. Universitas Muhammadiyah Magelang, Aug. 2024. doi: 10.31603/conference.12041. DOI: https://doi.org/10.31603/conference.12041
L. Livina and H. K. Tunjungsari, “Pengaruh persepsi kegunaan dari ulasan online, kepercayaan konsumen, dan persepsi risiko pada intensi membeli produk busana secara online,” Jurnal Manajemen Bisnis dan Kewirausahaan, vol. 9, no. 2, pp. 352–364, Mar. 2025, doi: 10.24912/jmbk.v9i2.32361. DOI: https://doi.org/10.24912/jmbk.v9i2.32361
M. Sun and J. Zhao, “Behavioral Patterns beyond Posting Negative Reviews Online: An Empirical View,” Journal of Theoretical and Applied Electronic Commerce Research, vol. 17, no. 3, pp. 949–983, 2022, doi: 10.3390/jtaer17030049. DOI: https://doi.org/10.3390/jtaer17030049
M. F. A. Thariq, “Pengaruh E-WOM, Customer Relationship Management, dan Emotional Branding Terhadap Loyalty Konsumen,” Jurnal Manajemen Pemasaran Dan Perilaku Konsumen, vol. 2, no. 3, pp. 814–827, 2023, doi: 10.21776/jmppk.2022.02.3.23. DOI: https://doi.org/10.21776/jmppk.2022.02.3.23
A. Rahmawati, D. Sugandini, and Y. Istanto, “Pengaruh Customer Experience terhadap Attitude Loyalty dan Behavioral Loyalty yang Dimediasi oleh Emotional Experience pada Pengguna Mobile Application Shopee (Studi Kasus di Yogyakarta),” JMBI UNSRAT (Jurnal Ilmiah Manajemen Bisnis dan Inovasi Universitas Sam Ratulangi), vol. 8, no. 3, Dec. 2021, doi: 10.35794/jmbi.v8i3.36740. DOI: https://doi.org/10.35794/jmbi.v8i3.36740
S. Kundu and S. Chakraborti, “A Comparative Study of Online Consumer Reviews Among Mainstream and Niche Products: Analysis Across Emerging and Developed Markets,” International Journal of Business Analytics, vol. 11, no. 1, 2024, doi: 10.4018/IJBAN.353306. DOI: https://doi.org/10.4018/IJBAN.353306
Y. K. Dwivedi et al., “Setting the future of digital and social media marketing research: Perspectives and research propositions,” Int. J. Inf. Manage., vol. 59, p. 102168, 2021, doi: https://doi.org/10.1016/j.ijinfomgt.2020.102168. DOI: https://doi.org/10.1016/j.ijinfomgt.2020.102168
A. Zablocki, K. Makri, and M. J. Houston, “Emotions Within Online Reviews and their Influence on Product Attitudes in Austria, USA and Thailand,” Journal of Interactive Marketing, vol. 46, pp. 20–39, 2019, doi: https://doi.org/10.1016/j.intmar.2019.01.001. DOI: https://doi.org/10.1016/j.intmar.2019.01.001
G. Kaur and A. Sharma, “A deep learning-based model using hybrid feature extraction approach for consumer sentiment analysis,” J. Big Data, vol. 10, no. 1, 2023, doi: 10.1186/s40537-022-00680-6. DOI: https://doi.org/10.1186/s40537-022-00680-6
A. Devi Putri Ariyanto, F. K. Fikriah, and A. F. Setyawan, “Impact of Statistical and Semantic Features Extraction for Emotion Detection on Indonesian Short Text Sentences,” Commit Journal, vol. 19, no. 1, pp. 1–13, 2025, doi: 10.21512/commit.v19i1.11680. DOI: https://doi.org/10.21512/commit.v19i1.11680
M. A. Riza and N. Charibaldi, “Emotion Detection in Twitter Social Media Using Long Short-Term Memory (LSTM) and Fast Text,” International Journal of Artificial Intelligence & Robotics (IJAIR), vol. 3, no. 1, pp. 15–26, 2021, doi: 10.25139/ijair.v3i1.3827. DOI: https://doi.org/10.25139/ijair.v3i1.3827
T. Chutia and N. Baruah, “A review on emotion detection by using deep learning techniques,” Artif. Intell. Rev., vol. 57, no. 8, p. 203, 2024, doi: 10.1007/s10462-024-10831-1. DOI: https://doi.org/10.1007/s10462-024-10831-1
M. S. Saputri, R. Mahendra, and M. Adriani, “Emotion Classification on Indonesian Twitter Dataset,” in 2018 International Conference on Asian Language Processing (IALP), 2018, pp. 90–95. doi: 10.1109/IALP.2018.8629262. DOI: https://doi.org/10.1109/IALP.2018.8629262
D. Haryadi and G. P. Kusuma, “Emotion Detection in Text using Nested Long Short-Term Memory,” International Journal of Advanced Computer Science and Applications, vol. 10, no. 6, 2019, doi: 10.14569/IJACSA.2019.0100645. DOI: https://doi.org/10.14569/IJACSA.2019.0100645
T. Liu, Y. Du, and Q. Zhou, “Text Emotion Recognition Using GRU Neural Network with Attention Mechanism and Emoticon Emotions,” in Proceedings of the 2020 2nd International Conference on Robotics, Intelligent Control and Artificial Intelligence, in RICAI ’20. New York, NY, USA: Association for Computing Machinery, 2020, pp. 278–282. doi: 10.1145/3438872.3439094. DOI: https://doi.org/10.1145/3438872.3439094
A. Chowanda, R. Sutoyo, S. Achmad, E. W. Andangsari, S. M. Isa, and T.-K. Chen, “MODELING EMOTIONS RECOGNITION ON INDONESIAN PRODUCT REVIEW BY COMBINING BERT, CNN, AND LSTM ARCHITECTURE,” International Journal of Innovative Computing Information and Control, vol. 20, no. 3, pp. 929–944, 2024, doi: 10.24507/ijicic.20.03.929.
R. Sutoyo, S. Achmad, A. Chowanda, E. W. Andangsari, and S. M. Isa, “PRDECT-ID: Indonesian product reviews dataset for emotions classification tasks,” Data Brief, vol. 44, 2022, doi: 10.1016/j.dib.2022.108554. DOI: https://doi.org/10.1016/j.dib.2022.108554
Y. O. Sihombing, R. Fuad Rachmadi, S. Sumpeno, and Moh. J. Mubarok, “Optimizing IndoRoBERTa Model for Multi-Class Classification of Sentiment & Emotion on Indonesian Twitter,” in 2024 IEEE 10th Information Technology International Seminar (ITIS), 2024, pp. 12–17. doi: 10.1109/ITIS64716.2024.10845566. DOI: https://doi.org/10.1109/ITIS64716.2024.10845566
H. Ahmadian, T. F. Abidin, H. Riza, and K. Muchtar, “Transformer-Based Indonesian Language Model for Emotion Classification and Sentiment Analysis,” in 2023 International Conference on Information Technology and Computing (ICITCOM), 2023, pp. 209–214. doi: 10.1109/ICITCOM60176.2023.10442970. DOI: https://doi.org/10.1109/ICITCOM60176.2023.10442970
L. Wang et al., “Parameter-efficient fine-tuning in large language models: a survey of methodologies,” Artif. Intell. Rev., vol. 58, no. 8, p. 227, 2025, doi: 10.1007/s10462-025-11236-4. DOI: https://doi.org/10.1007/s10462-025-11236-4
N. Houlsby et al., “Parameter-Efficient Transfer Learning for NLP,” CoRR, vol. abs/1902.00751, 2019, [Online]. Available: http://arxiv.org/abs/1902.00751
X. L. Li and P. Liang, “Prefix-Tuning: Optimizing Continuous Prompts for Generation,” CoRR, vol. abs/2101.00190, 2021, [Online]. Available: https://arxiv.org/abs/2101.00190
T. Dettmers, A. Pagnoni, A. Holtzman, and L. Zettlemoyer, “QLORA: efficient finetuning of quantized LLMs,” in Proceedings of the 37th International Conference on Neural Information Processing Systems, in NIPS ’23. Red Hook, NY, USA: Curran Associates Inc., 2023. DOI: https://doi.org/10.52202/075280-0441
E. J. Hu et al., “LoRA: Low-Rank Adaptation of Large Language Models,” CoRR, vol. abs/2106.09685, 2021, [Online]. Available: https://arxiv.org/abs/2106.09685
V. B. Parthasarathy, A. Zafar, A. Khan, and A. Shahid, “The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunities,” 2024. [Online]. Available: https://arxiv.org/abs/2408.13296
F. Koto, A. Rahimi, J. H. Lau, and T. Baldwin, “IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP,” CoRR, vol. abs/2011.00677, 2020, [Online]. Available: https://arxiv.org/abs/2011.00677
F. Koto, J. H. Lau, and T. Baldwin, “IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization,” in Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, M.-F. Moens, X. Huang, L. Specia, and S. W. Yih, Eds., Online and Punta Cana, Dominican Republic: Association for Computational Linguistics, Nov. 2021, pp. 10660–10668. doi: 10.18653/v1/2021.emnlp-main.833. DOI: https://doi.org/10.18653/v1/2021.emnlp-main.833
S. Hayou, N. Ghosh, and B. Yu, “LoRA+: Efficient Low Rank Adaptation of Large Models,” 2024. [Online]. Available: https://arxiv.org/abs/2402.12354
D. Biderman et al., “LoRA Learns Less and Forgets Less,” 2024. [Online]. Available: https://arxiv.org/abs/2405.09673
S.-Y. Liu et al., “DoRA: weight-decomposed low-rank adaptation,” in Proceedings of the 41st International Conference on Machine Learning, in ICML’24. JMLR.org, 2024.
Z. Wu et al., “ReFT: Representation Finetuning for Language Models,” 2024. [Online]. Available: https://arxiv.org/abs/2404.03592