A Multi-Algorithm Approach for Predicting OSCE Exam Passing Status

Authors

  • Zulkifli Aisyah University, Indonesia
  • Panji Bintoro Aisyah University, Indonesia
  • Fitriana Aisyah University, Indonesia
  • Muhammad Galih Ramaputra Lampung University, Indonesia
  • Hafsah Mukaromah Aisyah University, Indonesia
Pages Icon

DOI:

https://doi.org/10.63158/journalisi.v8i2.1518

Keywords:

OSCE, Multi-Algorithm, Prediction, Accuracy Level

Abstract

This study provides a paradigm for using a digital decision support system to automate OSCE evaluation. The effectiveness of this model is restricted to the scope of small-scale data and particular educational situations at Aisyah University, despite the results demonstrating great accuracy. As a result, additional modifications are needed for its practical implementation at other institutions. However, this research provides a crucial basis for the creation of digital assessment systems that might assist teachers in identifying students who want extra aid prior to final exams. Five machine learning algorithms Neural Network (NN), Support Vector Machine (SVM), Random Forest (RF), Naive Bayes (NB), and K-Nearest Neighbors (kNN) are assessed experimentally in this study. A dataset of 439 clinical competency data from Aisyah Pringsewu University midwifery students was used to create the model. Eight clinical skill factors were used as input, including baby massage, newborn care, and family planning services. To guarantee result stability, the 5-fold cross-validation approach was used for model validation. According to the test findings, every algorithm performs well, with an accuracy of more than 90%. On this particular dataset, SVM achieved a 100% classification accuracy, whereas Random Forest and SVM showed the most efficacy. With an average validation accuracy of 95%, neural networks also demonstrated excellent performance. This study provides a paradigm for using a digital decision support system to automate OSCE evaluation. The effectiveness of this model is restricted to the scope of small-scale data and particular educational situations at Aisyah University, despite the results demonstrating great accuracy. As a result, additional modifications are needed for its practical implementation at other institutions. However, this research provides a crucial basis for the creation of digital assessment systems that might assist teachers in identifying students who want extra aid prior to final exams.

Downloads

Download data is not yet available.

References

[1] A. A. Elbilgahy, F. Eltaib, F. A. Eltaib, and R. K. KMohamed, “Implementation of Objective Structured Clinical Examination (OSCE): Perceiving Nursing Students and Teachers Attitude & Satisfaction,” Am. J. Nurs. Res., vol. 8, no. 2, pp. 220–226, 2020, doi: 10.12691/ajnr-8-2-11.

[2] Z. Zulkifli, R. Ratnasari, Y. Arifin, and C. Habib, “Agile-Scrum Methodology for Hospital Information System Development,” J. Inf. Syst. Informatics, vol. 7, no. 2, pp. 1696–1713, 2025, doi: 10.51519/journalisi.v7i2.1148.

[3] Z. Zulkifli, M. Mardiana, and D. Despa, “Software Quality Assessment Model: A New Approach for Software Testing Tools,” Int. J. Softw. Eng. Knowl. Eng., vol. 35, no. 2, pp. 139–155, 2024, doi: 10.1142/S0218194024500517.

[4] S. Lebdai, B. Bouvard, L. Martin, C. Annweiler, N. Lerolle, and E. Rineau, “Objective structured clinical examination versus traditional written examinations: a prospective observational study,” BMC Med. Educ., vol. 23, no. 1, pp. 1–9, 2023, doi: 10.1186/s12909-023-04050-5.

[5] Z. Zulkifli, S. Wahyuningsih, A. I. Hendrawan Putri, T. H. Andika, P. Bintoro, and M. Pratiwi, “Implementation of a Diabetes Status Prediction Application Using a Machine Learning Algorithm Approach,” Proc. 2024 Int. Conf. Inf. Manag. Technol. ICIMTech 2024, pp. 701–706, 2024, doi: 10.1109/ICIMTech63123.2024.10780853.

[6] Zulkifli, F. L. Gaol, A. Trisetyarso, and W. Budiharto, “Software Testing Model by Measuring the Level of Accuracy Fault Output Using Neural Network Algorithm,” Proc. 2022 IEEE 7th Int. Conf. Inf. Technol. Digit. Appl. ICITDA 2022, pp. 1–6, 2022, doi: 10.1109/ICITDA55840.2022.9971274.

[7] Z. Zulkifli, F. A. Makkiyah, D. Antoni, F. Fitriana, T. Jamaan, and A. Taufik, “Multi-Algorithm to Measure the Accuracy Level of Diabetes Status Prediction,” J. Appl. Data Sci., vol. 5, no. 2, pp. 736–746, 2024, doi: 10.47738/jads.v5i2.250.

[8] T. A. Hannan, S. Y. Umar, Z. Rob, and R. R. Choudhury, “Designing and running an online Objective Structured Clinical Examination (OSCE) on Zoom: A peer-led example,” Med. Teach., vol. 43, no. 6, pp. 651–655, 2021, doi: 10.1080/0142159X.2021.1887836.

[9] J. F. Naga and R. Q. Lavilles, “Deciphering Digital Discourse: Detecting Cyberbullying Patterns in Filipino Tweets Using Machine Learning,” CommIT J., vol. 18, no. 2, pp. 167–181, 2024, doi: 10.21512/commit.v18i2.11094.

[10] T. K. Soong and C. M. Ho, “Artificial intelligence in medical OSCEs: Reflections and future developments,” Adv. Med. Educ. Pract., vol. 12, pp. 167–173, 2021, doi: 10.2147/AMEP.S287926.

[11] M. Tekin, M. O. Yurdal, Ç. Toraman, G. Korkmaz, and İ. Uysal, “Is AI the future of evaluation in medical education?? AI vs. human evaluation in objective structured clinical examination,” BMC Med. Educ., vol. 25, no. 1, 2025, doi: 10.1186/s12909-025-07241-4.

[12] S. Rehman, M. Ali, E. Cheema, and A. Shanzeh, “Exploring the perceptions and experiences of pharmacy students about formative and summative OSCE incorporating AI in preparatory process: A mixed-methods study,” Curr. Pharm. Teach. Learn., vol. 17, no. 6, p. 102348, 2025, doi: https://doi.org/10.1016/j.cptl.2025.102348.

[13] H. Zhang et al., “Network analysis of an OSCE-based graduation skills assessment for clinical medical students,” BMC Med. Educ., vol. 25, no. 1, 2025, doi: 10.1186/s12909-025-07091-0.

[14] W. Chine, “A novel fault diagnosis technique for photovoltaic systems based on artificial neural networks,” Renew. Energy, vol. 90, pp. 501–512, 2016, doi: 10.1016/j.renene.2016.01.036.

[15] H. Wang, R. Czerminski, and A. C. Jamieson, “Neural Networks and Deep Learning,” Mach. Age Cust. Insight, pp. 91–101, 2021, doi: 10.1108/978-1-83909-694-520211010.

[16] P. Brar and D. Nandal, “A Systematic Literature Review of Machine Learning Techniques for Software Effort Estimation Models,” Proc. - 2022 5th Int. Conf. Comput. Intell. Commun. Technol. CCICT 2022, pp. 494–499, 2022, doi: 10.1109/CCiCT56684.2022.00093.

[17] D. R. Ibrahim, “Software defect prediction using feature selection and random forest algorithm,” 2017. doi: 10.1109/ICTCS.2017.39.

[18] S. Liu, “An Integrated Scheme for Online Dynamic Security Assessment Based on Partial Mutual Information and Iterated Random Forest,” IEEE Trans. Smart Grid, vol. 11, no. 4, pp. 3606–3619, 2020, doi: 10.1109/TSG.2020.2991335.

[19] C. C. By-nc-nd, “Zupan, Demsar: Introduction to Data Mining,” no. May, pp. 1–72, 2018.

[20] Z. Zulkifli, F. L. Gaol, T. Agung, and B. Widodo, “Software Testing Integration-Based Model (I-BM) Framework for Recognizing Measure Fault Output Accuracy Using Machine Learning Approach,” Int. J. Softw. Eng. Knowl. Eng., 2023.

[21] T. Fawcett, “An introduction to ROC analysis,” Pattern Recognit. Lett., vol. 27, no. 8, pp. 861–874, 2006, doi: 10.1016/j.patrec.2005.10.010.

[22] S. Ruuska, W. Hämäläinen, S. Kajava, M. Mughal, P. Matilainen, and J. Mononen, “Evaluation of the confusion matrix method in the validation of an automated system for measuring feeding behaviour of cattle,” Behav. Processes, vol. 148, pp. 56–62, 2018, doi: 10.1016/j.beproc.2018.01.004.

[23] C. Catal, O. Alan, and K. Balkan, “Class noise detection based on software metrics and ROC curves,” Inf. Sci. (Ny)., vol. 181, no. 21, pp. 4867–4877, 2011, doi: 10.1016/j.ins.2011.06.017.

Downloads

Published

2026-04-12

Issue

Vol. 8 No. 2 (2026): April

Section

Articles

License

Copyright (c) 2026 Journal of Information Systems and Informatics

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors Declaration

  1. The Authors certify that they have read, understood, and agreed to the Journal of Information Systems and Informatics (JournalISI) submission guidelines, policies, and submission declaration. The submission has been prepared using the provided template.
  2. The Authors certify that all authors have approved the publication of this manuscript and that there is no conflict of interest.
  3. The Authors confirm that the manuscript is their original work, has not received prior publication, is not under consideration for publication elsewhere, and has not been previously published.
  4. The Authors confirm that all authors listed on the title page have contributed significantly to the work, have read the manuscript, attest to the validity and legitimacy of the data and its interpretation, and agree to its submission.
  5. The Authors confirm that the manuscript is not copied from or plagiarized from any other published work.
  6. The Authors declare that the manuscript will not be submitted for publication in any other journal or magazine until a decision is made by the journal editors.
  7. If the manuscript is finally accepted for publication, the Authors confirm that they will either proceed with publication immediately or withdraw the manuscript in accordance with the journal’s withdrawal policies.
  8. The Authors agree that, upon publication of the manuscript in this journal, they transfer copyright or assign exclusive rights to the publisher, including commercial rights

How to Cite

[1]
Zulkifli, P. Bintoro, Fitriana, M. G. Ramaputra, and H. Mukaromah, “A Multi-Algorithm Approach for Predicting OSCE Exam Passing Status”, journalisi, vol. 8, no. 2, pp. 1506–1533, Apr. 2026, doi: 10.63158/journalisi.v8i2.1518.

Most read articles by the same author(s)