Tourist Satisfaction Analysis of East Aceh Coastal Ecotourism Using Stacking Machine Learning and GUI Integration

Imam Gunanjar; Ryanda Saputra; Shary Armonitha Lusiana; Martahadi Mardhani; M. Khairul Anam

doi:10.59395/ijadis.v7i2.1614

Authors

Imam Gunanjar Department of Management, Universitas Samudra, Indonesia https://orcid.org/0009-0004-6714-4452
Ryanda Saputra Department of Accounting, Universitas Samudra, Indonesia
Shary Armonitha Lusiana Department of Informatics Engineering, Universitas Putra Indonesia YPTK Padang, Indonesia
Martahadi Mardhani Department of Developmet Economics, Universitas Samudra, Indonesia https://orcid.org/0000-0003-2942-2648
M. Khairul Anam Department of Informatics, Universitas Samudra, Indonesia https://orcid.org/0000-0003-4295-450X

DOI:

https://doi.org/10.59395/ijadis.v7i2.1614

Keywords:

Tourist Satisfaction, Coastal Ecotourism, Stacking, Machine Learning, GUI

Abstract

Tourist satisfaction is a key indicator for evaluating service quality and improving destination management in coastal ecotourism. East Aceh has several coastal tourism destinations with strong ecotourism potential, but tourist opinions are not always systematically analyzed for service improvement. This study analyzes tourist satisfaction in East Aceh coastal ecotourism using a stacking machine learning approach and integrates the best-performing model into a Graphical User Interface (GUI). The dataset consists of 1,679 tourist opinions collected from several coastal tourism objects in East Aceh and labeled into three classes: Satisfied, Neutral, and Dissatisfied. To prevent data leakage, the dataset was first divided into training and testing sets using a 60:40 split; TF-IDF fitting and SMOTE resampling were then applied only to the training data, while the testing set was kept unchanged. The evaluated base models include Naive Bayes, Random Forest, Support Vector Machine, and XGBoost, with Logistic Regression used as the stacking meta-model. The results show that the stacking model with SMOTE achieved the best performance with 87.05% accuracy, 87% precision, 87% recall, and 87% F1-score, outperforming the individual models in this experimental setting. However, the improvement over stacking without SMOTE was modest and was not statistically tested. The best-performing model was implemented in a GUI-based prototype that demonstrates how tourist opinions can be uploaded and classified into satisfaction categories. The prototype provides a preliminary interface for presenting classification results and has not yet been validated as an operational decision-support system.

386 162

Downloads

Download data is not yet available.

References

[1] R. Santoso, Tourism-Led Economic Growth in Coastal Areas: A Qualitative Study of Marine Economies, Jurnal Ilmu Ekonomi Terapan, vol. 10, no. 2, pp. 238251, Dec. 2025, doi: 10.20473/jiet.v10i2.76620. DOI: https://doi.org/10.20473/jiet.v10i2.76620

[2] K. Hasan et al., Communication Empowerment Of Aceh East Coastal Communities In Maintaining Manggrove Ecosystems (Study Of Meunasah Asan Village, Madat District, East Aceh Regency), in Proceedings of International Conference on Social Science, Political Science, and Humanities (ICoSPOLHUM), LPPM Universitas Malikussaleh, Dec. 2022, p. 00005. doi: 10.29103/icospolhum.v3i.64. DOI: https://doi.org/10.29103/icospolhum.v3i.64

[3] I. Irmawati and H. Hasnawati, Community-based Ecotourism Strategy for Local Economic Empowerment, Journal of Education, Humaniora and Social Sciences (JEHSS), vol. 7, no. 2, pp. 395404, Nov. 2024, doi: 10.34007/jehss.v7i2.2359. DOI: https://doi.org/10.34007/jehss.v7i2.2359

[4] R. Samal and M. Dash, Ecotourism, biodiversity conservation and livelihoods: Understanding the convergence and divergence, International Journal of Geoheritage and Parks, vol. 11, no. 1, pp. 120, Mar. 2023, doi: 10.1016/j.ijgeop.2022.11.001. DOI: https://doi.org/10.1016/j.ijgeop.2022.11.001

[5] N. P. Thang, Understanding Eco-tourism Satisfaction: A Structural Equation Modeling Examination of Critical Determinants, Sage Open, vol. 15, no. 3, pp. 119, Sep. 2025, doi: 10.1177/21582440251378061. DOI: https://doi.org/10.1177/21582440251378061

[6] Z. A. Torabi, A. A. Shalbafian, Z. Allam, Z. Ghaderi, B. Murgante, and A. R. Khavarian-Garmsir, Enhancing Memorable Experiences, Tourist Satisfaction, and Revisit Intention through Smart Tourism Technologies, Sustainability (Switzerland), vol. 14, no. 5, pp. 118, Mar. 2022, doi: 10.3390/su14052721. DOI: https://doi.org/10.3390/su14052721

[7] M. L. Jin, Y. Choi, C. K. Lee, and M. S. Ahmad, Effects of place attachment and image on revisit intention in an ecotourism destination: Using an extended model of goal-directed behavior, Sustainability (Switzerland), vol. 12, no. 18, pp. 116, Sep. 2020, doi: 10.3390/SU12187831. DOI: https://doi.org/10.3390/su12187831

[8] L. L. Diniz, P. M. Machado, L. L. Costa, N. B. Cgo, J. F. Madureira, and I. R. Zalmon, Visitors perception, coastal scenery quality and tourism profitability on sandy beaches - Southeastern Brazil, Mar. Policy, vol. 187, pp. 112, May 2026, doi: 10.1016/j.marpol.2026.107065. DOI: https://doi.org/10.1016/j.marpol.2026.107065

[9] P. Thakur and A. Kumar, Service Quality and Tourist Satisfaction: A Critical Analysis of Service Delivery in Tourism Destinations, Int. J. Innov. Sci. Res. Technol., vol. 11, no. 3, pp. 10091016, Mar. 2026, doi: 10.38124/ijisrt/26mar609. DOI: https://doi.org/10.38124/ijisrt/26mar609

[10] M. K. Anam, S. Defit, and R. Sovia, Evaluating Word2Vec and FastText Embeddings in CNN-LSTM for Hotel Customer Satisfaction: Impact on Accuracy and Model Stability, in International Conference on Data Science and Its Applications (ICoDSA), Jakarta: IEEE, 2025, pp. 540545. doi: 10.1109/ICoDSA67155.2025.11157433. DOI: https://doi.org/10.1109/ICoDSA67155.2025.11157433

[11] U. I. Arsyah, M. Pratiwi, H. Fryonanda, M. K. Anam, and Munawir, ACLM Model: A CNN-LSTM and Machine Learning Approach for Analyzing Tourist Satisfaction to Improve Priority Tourism Services, Journal of Applied Data Sciences, vol. 6, no. 4, pp. 28912906, Sep. 2025, doi: 10.47738/jads.v6i4.974. DOI: https://doi.org/10.47738/jads.v6i4.974

[12] J. Ipmawati, S. Saifulloh, and K. Kusnawi, Analisis Sentimen Tempat Wisata Berdasarkan Ulasan pada Google Maps Menggunakan Algoritma Support Vector Machine, MALCOM: Indonesian Journal of Machine Learning and Computer Science, vol. 4, no. 1, pp. 247256, Jan. 2024, doi: 10.57152/malcom.v4i1.1066. DOI: https://doi.org/10.57152/malcom.v4i1.1066

[13] M. S. Hadi, J. Akbar, and M. F. Zulkarnain, Analisis Sentimen Wisata Air Terjun Di Kabupaten Lombok Tengah Menggunakan Metode Support Vector Machine (SVM), SKANIKA: Sistem Komputer dan Teknik Informatika, vol. 8, no. 2, pp. 318329, 2025, doi: 10.36080/skanika.v8i2.3578. DOI: https://doi.org/10.36080/skanika.v8i2.3578

[14] A. Khaidar, S. Muliana, and P. Studi Magister Teknologi Informasi, Sentiment Analysis of Instagram Comments on the BPS Province X Account Using the Naive Bayes Algorithm Based on Machine Learning, Journal of Artificial Intelligence and Software Engineering, vol. 5, no. 3, pp. 12311237, 2025, doi: 10.30811/jaise.v5i3.7815.

[15] J. Friadi and D. E. Kurniawan, Analisis Sentimen Ulasan Wisatawan Terhadap Alun-Alun Kota Batam: Perbandingan Kinerja Metode Naive Bayes dan Support Vector Machine, Jurnal Sistem Informasi Bisnis, vol. 14, no. 4, pp. 403407, Oct. 2024, doi: 10.21456/vol14iss4pp403-407. DOI: https://doi.org/10.21456/vol14iss4pp403-407

[16] D. I. Afidah, D. Dairoh, S. F. Handayani, R. W. Pratiwi, and S. I. Sari, Sentimen Ulasan Destinasi Wisata Pulau Bali Menggunakan Bidirectional Long Short Term Memory, MATRIK: Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer, vol. 21, no. 3, pp. 607618, Jul. 2022, doi: 10.30812/matrik.v21i3.1402. DOI: https://doi.org/10.30812/matrik.v21i3.1402

[17] M. K. Anam, T. P. Lestari, L. Efrizoni, N. S. Handayani, and I. Andhika, Sentiment Analysis Optimization Using Ensemble of Multiple SVM Kernel Functions, Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 9, no. 4, pp. 905914, Aug. 2025, doi: 10.29207/resti.v9i4.6708. DOI: https://doi.org/10.29207/resti.v9i4.6708

[18] M. K. Anam et al., Enhancing the Performance of Machine Learning Algorithm for Intent Sentiment Analysis on Village Fund Topic, Journal of Applied Data Sciences, vol. 6, no. 2, pp. 11021115, 2025, doi: 10.47738/jads.v6i2.637. DOI: https://doi.org/10.47738/jads.v6i2.637

[19] I. Setiawan et al., Utilizing Random Forest Algorithm for Sentiment Prediction Based on Twitter Data, in Proceedings of the First Mandalika International Multi-Conference on Science and Engineering 2022, MIMSE 2022 (Informatics and Computer Science), Atlantis Press International BV, 2022, pp. 446456. doi: 10.2991/978-94-6463-084-8_37. DOI: https://doi.org/10.2991/978-94-6463-084-8_37

[20] R. Rahmaddeni, M. K. Anam, Y. Irawan, S. Susanti, and M. Jamaris, Comparison of Support Vector Machine and XGBSVM in Analyzing Public Opinion on Covid-19 Vaccination, ILKOM Jurnal Ilmiah, vol. 14, no. 1, pp. 3238, Apr. 2022, doi: 10.33096/ilkom.v14i1.1090.32-38. DOI: https://doi.org/10.33096/ilkom.v14i1.1090.32-38

[21] Agusviyanda, Hamdani, M. K. Anam, Agustin, and M. I. Wibowo, Stacking Ensemble Machine Learning Model for Early Detection of Chronic Kidney Disease in Indonesia, Rabit: Jurnal Teknologi dan Sistem Informasi Univrab, vol. 10, no. 2, pp. 12441252, Jul. 2025, doi: 10.36341/rabit.v10i2.6501. DOI: https://doi.org/10.36341/rabit.v10i2.6501

[22] M. A. Latief, L. R. Nabila, W. Miftakhurrahman, S. Marufatullah, and H. Tantyoko, Handling Imbalance Data using Hybrid Sampling SMOTE-ENN in Lung Cancer Classification, International Journal of Engineering and Computer Science Applications (IJECSA), vol. 3, no. 1, pp. 1118, Feb. 2024, doi: 10.30812/ijecsa.v3i1.3758. DOI: https://doi.org/10.30812/ijecsa.v3i1.3758

[23] G. Husain et al., SMOTE vs. SMOTEENN: A Study on the Performance of Resampling Algorithms for Addressing Class Imbalance in Regression Models, Algorithms, vol. 18, no. 1, pp. 116, Jan. 2025, doi: 10.3390/a18010037. DOI: https://doi.org/10.3390/a18010037

[24] S. G. Begum and P. K. Sree, Drug Recommendation Using a Reviews and Sentiment Analysis By a Recurrent Neural Network, Indonesian Journal of Multidisciplinary Science, vol. 2, no. 9, pp. 30853094, Jun. 2023, doi: 10.55324/ijoms.v2i9.530. DOI: https://doi.org/10.55324/ijoms.v2i9.530

[25] L. K. Ramasamy, S. Kadry, Y. Nam, and M. N. Meqdad, Performance analysis of sentiments in Twitter dataset using SVM models, International Journal of Electrical and Computer Engineering, vol. 11, no. 3, pp. 22752284, Jun. 2021, doi: 10.11591/ijece.v11i3.pp2275-2284. DOI: https://doi.org/10.11591/ijece.v11i3.pp2275-2284

[26] V. H. Pranatawijaya, N. N. K. Sari, R. A. Rahman, E. Christian, and S. Geges, Unveiling User Sentiment: Aspect-Based Analysis and Topic Modeling of Ride-Hailing and Google Play App Reviews, Journal of Information Systems Engineering and Business Intelligence, vol. 10, no. 3, pp. 328339, Oct. 2024, doi: 10.20473/jisebi.10.3.328-339. DOI: https://doi.org/10.20473/jisebi.10.3.328-339

[27] S. R. Aisy and B. Prasetiyo, Sentiment Analysist of the TPKS Law on Twitter Using InSet Lexicon with Multinomial Nave Bayes and Support Vector Machine Based on Soft Voting, Recursive Journal of Informatics, vol. 1, no. 2, pp. 93101, Sep. 2023, doi: 10.15294/rji.v1i2.68324. DOI: https://doi.org/10.15294/rji.v1i2.68324

[28] P. H. Prastyo, I. Ardiyanto, and R. Hidayat, Indonesian Sentiment Analysis: An Experimental Study of Four Kernel Functions on SVM Algorithm with TF-IDF, in International Conference on Data Analytics for Business and Industry: Way Towards a Sustainable Economy (ICDABI), Institute of Electrical and Electronics Engineers Inc., Oct. 2020, pp. 16. doi: 10.1109/ICDABI51230.2020.9325685. DOI: https://doi.org/10.1109/ICDABI51230.2020.9325685

[29] F. Alzami, E. D. Udayanti, D. P. Prabowo, and R. A. Megantara, Document Preprocessing with TF-IDF to Improve the Polarity Classification Performance of Unstructured Sentiment Analysis, Kinetik: Game Technology, Information System, Computer Network, Computing, Electronics, and Control, pp. 235242, Aug. 2020, doi: 10.22219/kinetik.v5i3.1066. DOI: https://doi.org/10.22219/kinetik.v5i3.1066

[30] B. P. Zen, I. Susanto, and D. Finaliamartha, TF-IDF Method and Vector Space Model Regarding the Covid-19 Vaccine on Online News, SinkrOn, vol. 6, no. 1, pp. 6979, Oct. 2021, doi: 10.33395/sinkron.v6i1.11179. DOI: https://doi.org/10.33395/sinkron.v6i1.11179

[31] Z. Jiang, B. Gao, Y. He, Y. Han, P. Doyle, and Q. Zhu, Text Classification Using Novel Term Weighting Scheme-Based Improved TF-IDF for Internet Media Reports, Math. Probl. Eng., vol. 2021, 2021, doi: 10.1155/2021/6619088. DOI: https://doi.org/10.1155/2021/6619088

[32] Herianto, B. Kurniawan, Z. H. Hartomi, Y. Irawan, and M. K. Anam, Machine Learning Algorithm Optimization using Stacking Technique for Graduation Prediction, Journal of Applied Data Sciences, vol. 5, no. 3, pp. 12721285, Sep. 2024, doi: 10.47738/jads.v5i3.316. DOI: https://doi.org/10.47738/jads.v5i3.316

[33] M. K. Anam, T. Nasution, H. Yenni, M. Pratiwi, U. I. Arsyah, and I. Syahputra, Improving the Performance of Nave Bayes Using Stacking Technique for Detecting Stress in Students in Indonesia, in 2025 2nd International Conference on Information System and Information Technology (ICISIT), IEEE, Nov. 2025, pp. 16. doi: 10.1109/ICISIT66233.2025.11402979. DOI: https://doi.org/10.1109/ICISIT66233.2025.11402979