A Heterogeaneous Dataset–Driven Ensemble Learning Framework for Malicious URL Detection

Parman Sukarno; Syahrulanuar Ngah

doi:10.59395/ijadis.v7i1.1541

Authors

Parman Sukarno Telkom University, Indonesia
Syahrulanuar Ngah University Malaysia Pahang, Malaysia

DOI:

https://doi.org/10.59395/ijadis.v7i1.1541

Keywords:

Decision Tree, Ensemble Learning, Gradient Boosting, Malicious URL, Random Forest

Abstract

Modern cyberattacks are increasingly associated with phishing campaign, malware distribution, and website defacement, which are often delivered through malicious Uniform Resource Locator (URL) originating from diverse source. This paper examine malicious URL detection using an ensemble learning framework evaluated on large scale heterogeneous dataset composed of URL aggregated from multiple public threat intelligence source. The dataset include benign, phishing, malware, and defacement URL, thereby reflecting real world variability in attack pattern and data distribution. Three ensemble based classifier, namely Decision Tree (DT), Random Forest (RF), and Gradient Boosting (GB), are evaluated with respect to detection accuracy and computational efficiency. In addition to classification performance, this study present a detailed analysis of training and detection time in order to identify most suitable model for practical deployment. Experimental results indicate that the DT model achieves a training time of 4.14 seconds with macro and weighted accuracies of 94.11% and 91.71%, respectively, and a per category detection time of 0.2162 seconds. The RF model attains macro and weighted accuracies of 93.64% and 90.94%, with training and detection times of 9.73 seconds and 0.2420 seconds, respectively. Although the GB model exhibits the longest training time of 45.38 seconds, it achieves the fastest per category detection time of 0.2151 seconds. Despite its comparatively lower overall accuracy of 92.48% for macro averaging and 89.42s% for weighted averaging, the rapid inference capability of GB makes it a strong candidate for real time malicious URL detection in heterogeneous cybersecurity environments.

1148 545

Downloads

Download data is not yet available.

References

[1] S. Verma, Harnessing the strength of digital technologies for cybersecurity, in Advances in Information Security, Privacy, and Ethics, IGI Global, 2025, pp. 120. DOI: https://doi.org/10.4018/979-8-3693-2675-6.ch001

[2] A. S. Rafsanjani, N. Binti Kamaruddin, M. Behjati, S. Aslam, A. Sarfaraz, and A. Amphawan, Enhancing malicious URL detection: A novel framework leveraging priority coefficient and feature evaluation, IEEE Access, vol. 12, pp. 8500185026, 2024. DOI: https://doi.org/10.1109/ACCESS.2024.3412331

[3] S. Li and O. Dib, Enhancing online security: A novel machine learning framework for robust detection of known and unknown malicious URLs, Journal of Theoretical and Applied Electronic Commerce Research, vol. 19, no. 4, pp. 29192960, Oct. 2024. DOI: https://doi.org/10.3390/jtaer19040141

[4] D. Orozco-Fonseca, G. Marin, and A. Lara, Taxonomy of malicious URL detection techniques, in Lecture Notes in Networks and Systems, Cham: Springer Nature Switzerland, 2024, pp. 7381. DOI: https://doi.org/10.1007/978-3-031-54235-0_7

[5] S. Krishnan and M. Naik S, An efficient framework for phishing URL detection using adaptive driftaware feature monitoring and online learning, Security and Privacy, vol. 8, no. 4, Jul. 2025. DOI: https://doi.org/10.1002/spy2.70057

[6] Sivakumar C, Sagar PL, Swetha K, Raju KA, Kumar GN, Nanditha MN, Detecting Malicious URLs using Machine Learning, in 2025 5th International Conference on Expert Clouds and Applications (ICOECA), IEEE, Mar. 2025, pp. 605612. DOI: https://doi.org/10.1109/ICOECA66273.2025.00110

[7] M. D. Sirajudin, P. Sukarno, and A. A. Wardana, Malicious uniform resource locators detection using feature extraction and deep learning, in Lecture Notes in Networks and Systems, Cham: Springer Nature Switzerland, 2025, pp. 3347. DOI: https://doi.org/10.1007/978-3-031-96759-7_3

[8] B. V. Pavani, D. Mahitha, and B. U. Maheswari, Enhancing online safety: Phishing URL detection using machine learning and explainable AI, in 2024 15th International Conference on Computing Communication and Networking Technologies (ICCCNT), IEEE, Jun. 2024, pp. 16. DOI: https://doi.org/10.1109/ICCCNT61001.2024.10723976

[9] Karajgar, Manasi Dnyanesh, Sonali Sawardekar, Seema Khamankar, Nalini Tiwari, Manjusha Patil, Vishal Kisan Borate, Yogesh Kisan Mali, and Ashvini Chaudhari, Comparison of machine learning models for identifying malicious URLs, in 2024 IEEE International Conference on Information Technology, Electronics and Intelligent Communication Systems (ICITEICS), IEEE, Jun. 2024, pp. 15. DOI: https://doi.org/10.1109/ICITEICS61368.2024.10625423

[10] M. Isangediok and K. Gajamannage, Fraud detection using optimized machine learning tools under imbalance classes, in 2022 IEEE International Conference on Big Data (Big Data), IEEE, Dec. 2022. DOI: https://doi.org/10.1109/BigData55660.2022.10020723

[11] M. V Pachpatil and A. Agrawal, Evolution of malicious URL detection: A review of techniques for malicious URL detection and classification, in Sustainable Artificial Intelligence-Powered Applications, Cham: Springer Nature Switzerland, 2025, pp. 467475. DOI: https://doi.org/10.1007/978-3-031-92854-3_55

[12] S. Kailas and R. Roopalakshmi, Think Before You Click-Malicious URL Detection in Cybersecurity: A Systematic Review and Research Roadmap., IEEE Access, vol. 13, pp. 154305154325, 2025. DOI: https://doi.org/10.1109/ACCESS.2025.3601387

[13] M. Aljabri et al., Detecting malicious URLs using machine learning techniques: Review and research directions, IEEE Access, vol. 10, pp. 121395121417, 2022. DOI: https://doi.org/10.1109/ACCESS.2022.3222307

[14] J. Islam, C. Patra, P. K. Mani, S. Biswas, D. Giri, and T. Maitra, Phishing URL detection via machine learning: A comprehensive survey, in Lecture Notes in Networks and Systems, in Lecture Notes in Networks and Systems, Singapore: Springer Nature Singapore, 2025, pp. 141159. DOI: https://doi.org/10.1007/978-981-96-6348-4_12

[15] M. Siddhartha, Malicious URLs Dataset, Kaggle, 2019. [Online]. Available: https://www.kaggle.com/datasets/sid321axn/malicious-urls-dataset. Accessed: Mar. 4, 2026.

[16] Y. Zhauniarovich, I. Khalil, T. Yu, and M. Dacier, A survey on malicious domains detection through DNS data analysis, ACM Comput. Surv., vol. 51, no. 4, pp. 136, Jul. 2018. DOI: https://doi.org/10.1145/3191329

[17] D. L. Hanintya, P. Sukarno, and A. A. Wardana, Comparing explainable AI framework: Study case on detection of DNS exfiltration attach using neural network, Procedia Comput. Sci., vol. 269, pp. 10221032, 2025. DOI: https://doi.org/10.1016/j.procs.2025.09.044

[18] S. Chaudhari, A. Thakur, and A. Rajan, An efficient malicious URL detection approach using machine learning techniques, in Lecture Notes in Electrical Engineering, Singapore: Springer Nature Singapore, 2024, pp. 485495. DOI: https://doi.org/10.1007/978-981-99-7077-3_48

[19] Y. Tian, Y. Yu, J. Sun, and Y. Wang, From past to present: A survey of malicious URL detection techniques, datasets and code repositories, Computer Science Review, 2025. DOI: https://doi.org/10.1016/j.cosrev.2025.100810

[20] O. K. Sahingoz, E. Buber, O. Demir, and B. Diri, Machine learning based phishing detection from URLs, Expert Systems with Applications., vol. 117, pp. 345357, Mar. 2019. DOI: https://doi.org/10.1016/j.eswa.2018.09.029

[21] V. Dhiman, Ensemble learning techniques for advanced threat detection in complex data environments for smart education, in Advances in Educational Technologies and Instructional Design, IGI Global, 2025, pp. 191206. DOI: https://doi.org/10.4018/979-8-3693-7723-9.ch012

[22] A. Alabdulatif, A novel ensemble of deep learning approach for cybersecurity intrusion detection with explainable Artificial Intelligence, Applied Sciences, vol. 15, no. 14, p. 7984, Jul. 2025. DOI: https://doi.org/10.3390/app15147984

[23] R. Ch, B. Naresh, P. L. Prasanna, N. Chander, E. A. Goud, and P. R. Prasad, Exploring machine learning algorithms for robust cyber threat detection and classification: A comprehensive evaluation, in 2024 International Conference on Intelligent Systems for Cybersecurity (ISCS), IEEE, May 2024. DOI: https://doi.org/10.1109/ISCS61804.2024.10581226

[24] A. Kumar and K. Guleria, Leveraging machine learning algorithms for threat detection using AI-enhanced cybersecurity datasets, in 2024 4th International Conference on Technological Advancements in Computational Sciences (ICTACS), IEEE, Nov. 2024, pp. 483488. DOI: https://doi.org/10.1109/ICTACS62700.2024.10840478

[25] F. A. Ghaleb, M. Alsaedi, F. Saeed, J. Ahmad, and M. Alasli, Cyber threat intelligence-based malicious URL detection model using ensemble learning, Sensors, vol. 22, no. 9, p. 3373, Apr. 2022. DOI: https://doi.org/10.3390/s22093373

[26] Q. Abu Al-Haija and M. Al-Fayoumi, An intelligent identification and classification system for malicious uniform resource locators (URLs), Neural Computing and Applications, vol. 35, no. 23, pp. 117, Apr. 2023. DOI: https://doi.org/10.1007/s00521-023-08592-z

[27] D. S. Arjun, D. S. Samhitha, and A. Padmavathi A and Hemprasanna, Detection of Malicious URLs using Ensemble learning techniques, in 2023 IEEE Technology & Engineering Management Conference - Asia Pacific (TEMSCON-ASPAC), IEEE, Dec. 2023. DOI: https://doi.org/10.1109/TEMSCON-ASPAC59527.2023.10531433

[28] M. R. Babu, K. S. Raja, K. Ruthvik, P. Yashwanth, and S. Rohith, Phishing URL detection using gradient boosting: A machine learning approach, International Journal of Novel Research and Development, vol. 9, no. 3, 2024.

[29] R. K. Singh, A. Kumar, and F. Ahmed, Detection of phishing websites using machine learning algorithms, in Lecture Notes in Networks and Systems, Singapore: Springer Nature Singapore, 2026, pp. 147156. DOI: https://doi.org/10.1007/978-981-96-6053-7_10

[30] Shantanu, B. Janet, and R. Joshua Arul Kumar, Malicious URL detection: A comparative study, in 2021 International Conference on Artificial Intelligence and Smart Systems (ICAIS), IEEE, Mar. 2021. DOI: https://doi.org/10.1109/ICAIS50930.2021.9396014

[31] Kim, S., Suh, Y. K., & Kim, J., EXTES: An execution-time estimation scheme for efficient computational science and engineering simulation via machine learning, IEEE Access, vol. 7, pp. 9899399002, 2019. DOI: https://doi.org/10.1109/ACCESS.2019.2929800

[32] L. Baier, N. Khl, and J. Schmitt, Increasing robustness for machine learning services in challenging environments: Limited resources and no label feedback, in Lecture Notes in Networks and Systems, Cham: Springer International Publishing, 2022, pp. 837856. DOI: https://doi.org/10.1007/978-3-030-82193-7_57

[33] S. Marchal, J. Francois, Radu State, and T. Engel, PhishStorm: Detecting phishing with streaming analytics, IEEE Transactions on Network and Service Management, vol. 11, no. 4, pp. 458471, Dec. 2014. DOI: https://doi.org/10.1109/TNSM.2014.2377295

[34] J. Chen, Z. Hu, and Z. Qian, Research on malicious URL detection based on random forest, in 2022 14th International Conference on Computer Research and Development (ICCRD), IEEE, Jan. 2022. DOI: https://doi.org/10.1109/ICCRD54409.2022.9730451

[35] S. Bishnoi and B. K. Hooda, Decision tree algorithms and their applicability in agriculture for Classification, Journal of Experimental Agriculture International, pp. 2027, May 2022. DOI: https://doi.org/10.9734/jeai/2022/v44i730833

[36] S. Patil and U. Kulkarni, Accuracy Prediction for Distributed Decision Tree using Machine Learning approach, in 2019 3rd International Conference on Trends in Electronics and Informatics (ICOEI), IEEE, Apr. 2019. DOI: https://doi.org/10.1109/ICOEI.2019.8862580

[37] N. Elmrabit, F. Zhou, F. Li, and H. Zhou, Evaluation of machine learning algorithms for anomaly detection, in 2020 International Conference on Cyber Security and Protection of Digital Services (Cyber Security), IEEE, Jun. 2020. DOI: https://doi.org/10.1109/CyberSecurity49315.2020.9138871

[38] A. B. Adetunji, O. N. Akande, F. A. Ajala, O. Oyewo, Y. F. Akande, and G. Oluwadara, House price prediction using random forest machine learning technique, Procedia Computer Science, vol. 199, pp. 806813, 2022. DOI: https://doi.org/10.1016/j.procs.2022.01.100

[39] A. A. Wardana, P. Sukarno, S. Basuki, and S. B. Utomo, Federated random forest with feature selection for collaborative intrusion detection in internet of things, Procedia Computer Science, vol. 246, pp. 2029, 2024. DOI: https://doi.org/10.1016/j.procs.2024.09.193

[40] D. Upadhyay, J. Manero, M. Zaman, and S. Sampalli, Gradient boosting feature selection with machine learning classifiers for intrusion detection on power grids, IEEE Transactions on Network and Service Management, vol. 18, no. 1, pp. 11041116, Mar. 2020. DOI: https://doi.org/10.1109/TNSM.2020.3032618

[41] A. Malinin, L. Prokhorenkova, and A. Ustimenko, Uncertainty in Gradient Boosting via Ensembles, arXiv preprint arXiv:2006.10562, 2020.

[42] A. A. Wardana, G. Koaczek, A. Warzyski, and P. Sukarno, Ensemble averaging deep neural network for botnet detection in heterogeneous Internet of Things devices, Scientific Reports, vol. 14, no. 1, p. 3878, 2024, doi: 10.1038/s41598-024-54438-6. DOI: https://doi.org/10.1038/s41598-024-54438-6

[43] A. A. Wardana, G. Koaczek, A. Warzyski, and P. Sukarno, Collaborative intrusion detection using weighted ensemble averaging deep neural network for coordinated attack detection in heterogeneous network, International Journal of Information Security, vol. 23, no. 5, pp. 33293349, 2024, doi: 10.1007/s10207-024-00891-3. DOI: https://doi.org/10.1007/s10207-024-00891-3

[44] S. Beddar-Wiesing, A. Moallemy-Oureh, M. Kempkes, and J. M. Thomas, Absolute evaluation measures for machine learning: A survey, arXiv preprint arXiv:2507.03392, 2025.

[45] A. Bochkovskiy, C.-Y. Wang, and H.-Y. M. Liao, YOLOv4: Optimal speed and accuracy of object detection, arXiv: 2004.10934, 2020.

[46] M. Azad and M. Moshkov, Applications of depth minimization of decision trees containing hypotheses for multiple-value decision tables, Entropy, vol. 25, no. 4, p. 547, Mar. 2023. DOI: https://doi.org/10.3390/e25040547

[47] A. V. Alzuhdi, H. Ar Rosyid, M. Y. Chuttur, and S. Nazir, Optimizing Random Forest algorithm to classify players memorisation via in-game data, Knowledge Engineering and Data Science, vol. 6, no. 1, p. 103, Oct. 2023. DOI: https://doi.org/10.17977/um018v6i12023p103-113

[48] C. Ma, X. Qiu, D. J. Beutel, and N. D. Lane, Gradient-less federated gradient boosting trees with learnable learning rates, Proceedings of the 3rd Workshop on Machine Learning and Systems, Apr. 2023. DOI: https://doi.org/10.1145/3578356.3592579