Development and Implementation of the Primakara Virtual Assistant Based on Generative Artificial Intelligence

Made Adi Paramartha Putra; I Putu Buda  Suyasa; I Made  Artana; Nengah Widya  Utami

doi:10.59395/ijadis.v6i3.1407

Authors

Made Adi Paramartha Putra Primakara University
I Putu Buda Suyasa Primakara University
I Made Artana Primakara University
Nengah Widya Utami Primakara University

DOI:

https://doi.org/10.59395/ijadis.v6i3.1407

Keywords:

Generative AI, Virtual Assistance, Natural Language Processing, Educational Technology

Abstract

The growing need for efficient, accessible, and context-aware academic support systems has led to the exploration of Generative AI (GenAI) technologies in educational settings. However, existing virtual assistants often lack contextual relevance, adaptability, and user-friendly interaction, limiting their effectiveness in higher education environments. This study proposes a GenAI-based Virtual Assistant (VA) tailored for university-related applications, combining voice recognition, natural language understanding, and text-to-speech technologies to create an interactive and intelligent support system. The proposed work was evaluated through four key testing stages: black-box functionality testing, response similarity analysis, inference time measurement, and user acceptance testing. Black-box testing validated the system’s ability to process speech input, generate accurate audio responses, and provide responsive UI/UX feedback. A TF-IDF cosine similarity analysis across 11 academic departments yielded an average similarity score of 81.86%, demonstrating semantic alignment with institutional content. The system also maintained an average response time of 3.88 seconds. User feedback from 25 participants revealed high satisfaction levels, with scores exceeding 4.0 across all indicators and large T-statistic value. These results confirm the system’s potential as an effective, real-time academic assistant.

1042 717

Downloads

Download data is not yet available.

References

[1] M. Belkina et al., “Implementing generative AI (GenAI) in higher education: A systematic review of case studies,” Comput. Educ. Artif. Intell., vol. 8, p. 100407, 2025, doi: https://doi.org/10.1016/j.caeai.2025.100407. DOI: https://doi.org/10.1016/j.caeai.2025.100407

[2] M. Matsiola, G. Lappas, and A. Yannacopoulou, “Generative AI in Education: Assessing Usability, Ethical Implications, and Communication Effectiveness,” 2024. doi: 10.3390/soc14120267. DOI: https://doi.org/10.3390/soc14120267

[3] H.-P. (Hank) Lee et al., “The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers,” in Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, in CHI ’25. New York, NY, USA: Association for Computing Machinery, 2025. doi: 10.1145/3706598.3713778. DOI: https://doi.org/10.1145/3706598.3713778

[4] U. Mittal, S. Sai, V. Chamola, and D. Sangwan, “A Comprehensive Review on Generative AI for Education,” IEEE Access, vol. 12, pp. 142733–142759, 2024, doi: 10.1109/ACCESS.2024.3468368. DOI: https://doi.org/10.1109/ACCESS.2024.3468368

[5] R. Abdelghani et al., “GPT-3-driven pedagogical agents to train children’s curious question-asking skills,” Int. J. Artif. Intell. Educ., vol. 34, no. 2, pp. 483–518, 2024. DOI: https://doi.org/10.1007/s40593-023-00340-7

[6] M. Rawal, “National Education Policy 2019: For The Transferable Job Parents Which Affect Their Children’ Education,” vol. 2, no. 3, pp. 1–7, 2020.

[7] H. Yu and Y. Guo, “Generative artificial intelligence empowers educational reform: current status, issues, and prospects,” Front. Educ., vol. Volume 8-2023, 2023, [Online]. Available: https://www.frontiersin.org/journals/education/articles/10.3389/feduc.2023.1183162 DOI: https://doi.org/10.3389/feduc.2023.1183162

[8] T. Adiguzel, H. Kaya, and F. Cansu, “Revolutionizing education with AI: Exploring the transformative potential of ChatGPT,” Contemp. Educ. Technol., vol. 15, p. ep429, Apr. 2023, doi: 10.30935/cedtech/13152. DOI: https://doi.org/10.30935/cedtech/13152

[9] L. Kohnke, B. L. Moorhouse, and D. Zou, “Exploring generative artificial intelligence preparedness among university language instructors: A case study,” Comput. Educ. Artif. Intell., vol. 5, p. 100156, 2023, doi: https://doi.org/10.1016/j.caeai.2023.100156. DOI: https://doi.org/10.1016/j.caeai.2023.100156

[10] A. R. Doshi and O. P. Hauser, “Generative artificial intelligence enhances creativity but reduces the diversity of novel content,” arXiv Prepr. arXiv2312.00506, 2023.

[11] I. Jurenka et al., “Towards responsible development of generative AI for education: An evaluation-driven approach,” arXiv Prepr. arXiv2407.12687, 2024.

[12] D. Baidoo-Anu and L. Ansah, “Education in the Era of Generative Artificial Intelligence (AI): Understanding the Potential Benefits of ChatGPT in Promoting Teaching and Learning,” J. AI, vol. 7, Mar. 2023, doi: 10.61969/jai.1337500. DOI: https://doi.org/10.2139/ssrn.4337484

[13] Y. Ge et al., “Making llama see and draw with seed tokenizer,” arXiv Prepr. arXiv2310.01218, 2023.

[14] H. Touvron et al., “Llama: Open and efficient foundation language models,” arXiv Prepr. arXiv2302.13971, 2023.

[15] P. Lewis et al., “Retrieval-augmented generation for knowledge-intensive nlp tasks,” Adv. Neural Inf. Process. Syst., vol. 33, pp. 9459–9474, 2020.

[16] M. Hanisch, C. M. Goldsby, N. E. Fabian, and J. Oehmichen, “Digital governance: A conceptual framework and research agenda,” J. Bus. Res., vol. 162, p. 113777, 2023, doi: https://doi.org/10.1016/j.jbusres.2023.113777. DOI: https://doi.org/10.1016/j.jbusres.2023.113777

[17] A. F. Anwar, R. Kusumawati, M. A. Yaqin, I. B. Santoso, and A. A. Zuhri, “Enhancing Student Collaboration in Academic Projects Through a Content-Based Filtering Recommender System,” 2025. doi: 10.59395/ijadis.v6i2.1329. DOI: https://doi.org/10.59395/ijadis.v6i2.1329

[18] R. Prabhavalkar, T. Hori, T. N. Sainath, R. Schlüter, and S. Watanabe, “End-to-end speech recognition: A survey,” IEEE/ACM Trans. Audio, Speech, Lang. Process., vol. 32, pp. 325–351, 2023. DOI: https://doi.org/10.1109/TASLP.2023.3328283

[19] M. T. Abdillah, I. Kurniastuti, F. A. Susanto, and F. Yudianto, “Implementasi Black Box Testing dan Usability Testing pada Website Sekolah MI Miftahul Ulum Warugunung Surabaya,” J. Comput. Sci. Vis. Commun. Des., vol. 8, no. 1, pp. 234–242, 2023, doi: 10.55732/jikdiskomvis.v8i1.897. DOI: https://doi.org/10.55732/jikdiskomvis.v8i1.897

[20] Ylber Januzaj and Artan Luma, “Cosine Similarity – A Computing Approach to Match Similarity Between Higher Education Programs and Job Market Demands Based on Maximum Number of Common Words,” Int. J. Emerg. Technol. Learn., vol. 17, no. 12 SE-Short Papers, pp. 258–268, Jun. 2022, doi: 10.3991/ijet.v17i12.30375. DOI: https://doi.org/10.3991/ijet.v17i12.30375