Explainable machine learning for predicting the success of IT projects in Nigerien SMEs: an empirical study based on 488 projects in Niamey

Falilatou Bako Ousmane; Atahualpa Sosa López

doi:10.67294/2z2yp254

Authors

Falilatou Bako Ousmane Higher School of Electronics Communications and Post, Niamey, Niger Author https://orcid.org/0009-0006-3649-6265
Dr. Atahualpa Sosa López Universidad Internacional Iberoamericana Author https://orcid.org/0000-0002-0725-5028

DOI:

https://doi.org/10.67294/2z2yp254

Keywords:

Explainable Machine Learning, IT Projects, Small and Medium Enterprises, Success Prediction, Early Warning System

Abstract

IT projects play a crucial role in the digital transformation of small and medium-sized enterprises (SMEs), but their success remains highly dependent on organizational, financial, and infrastructural constraints, particularly in developing countries. This study proposes an explainable predictive framework for the success of IT projects applied to SMEs in Niamey, Niger's main digital hub. The analysis is based on a set of 488 IT projects and compares the performance of seven machine learning algorithms: logistic regression, decision tree analysis, random forest analysis, support vector machines (SVMs), k-nearest neighbors, gradient boosting, and XGBoost. A rigorous methodology integrating data preprocessing, hyperparameter optimization using GridSearchCV, and cross-project validation based on GroupKFold was implemented. The results show that the SVM model achieved the highest predictive performance with an AUC-ROC of 0.850. To improve the interpretability of the predictions, explainable artificial intelligence analyses based on SHAP were conducted. These analyses revealed that stakeholder satisfaction, budget overruns, delays, project complexity, and certain constraints related to power supply and internet availability are the main determinants of project success. The study also led to the development of a prototype early warning system designed to support decision-making and proactively manage IT projects in SMEs.

References

Adadi, A., & Berrada, M. (2018). Peeking inside the black-box: A survey on explainable artificial intelligence (XAI). IEEE Access, 6, 52138–52160. https://doi.org/10.1109/ACCESS.2018.2870052

Bangarigadu, K., & Nunkoo, R. (2023). A success versus failure prediction model for small firms. Journal of African Business, 24(4), 529–545. https://doi.org/10.1080/15228916.2022.2119015

Berriche, L., Ait Oufroukh, N., Amroune, M., & Bouras, A. (2025). Prediction of failures in project management knowledge areas using ensemble learning techniques. Discover Applied Sciences. https://doi.org/10.1007/s42452-025-07337-y

Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32. https://doi.org/10.1023/A:1010933404324

Chen, T., & Guestrin, C. (2016). XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 785–794). https://doi.org/10.1145/2939672.2939785

Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3), 273–297. https://doi.org/10.1007/BF00994018

Cunha, B. M., & Barbosa, D. J. S. (2024). Evaluating the Effectiveness of Visual Representations of SHAP Values Toward Explainable Artificial Intelligence. In Proceedings of the Brazilian Symposium on Human Factors in Computing Systems (IHC 2024). Association for Computing Machinery. https://doi.org/10.1145/3702038.3702093

Denyer, D. (2022). Organizational resilience: A summary of academic evidence, business insights and new thinking. Cranfield School of Management and BSI.

Givisis, I., Kalatzis, D., Christakis, C., & Kiouvrekis, Y. (2025). Comparing explainable AI models: SHAP, LIME, and their role in electric field strength prediction over urban areas. Electronics, 14(23), 4766. https://doi.org/10.3390/electronics14234766

Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep learning. MIT Press. https://www.deeplearningbook.org/

Haldar, S., & Capretz, L. F. (2023). Explainable software defect prediction from cross-company project metrics using machine learning. arXiv. https://doi.org/10.48550/arXiv.2306.08655

Hastie, T., Tibshirani, R., & Friedman, J. (2021). The elements of statistical learning: Data mining, inference, and prediction (2nd ed.). Springer. https://hastie.su.domains/ElemStatLearn/

Hsiao, C. (2022). Analysis of panel data (4th ed.). Cambridge University Press. https://www.academia.edu/2121377/Analysis_of_panel_data

James, G., Witten, D., Hastie, T., & Tibshirani, R. (2021). An introduction to statistical learning: With applications in R (2nd ed.). Springer. https://doi.org/10.1007/978-1-0716-1418-1

Kerzner, H. (2022). Project management: A systems approach to planning, scheduling, and controlling (13th ed.). Wiley. https://www.wiley.com/en-us/shop/general-introductory-industrial-engineering/project-management-a-systems-approach-to-planning-scheduling-and-controlling-13th-edition-p-9781119805373

Kuhn, M., & Johnson, K. (2019). Feature engineering and selection: A practical approach for predictive models. CRC Press. https://doi.org/10.1201/9781315108230

Lundberg, S. M., & Lee, S.-I. (2017). A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems (Vol. 30). https://papers.nips.cc/paper/7062-a-unified-approach-to-interpreting-model-predictions

Molnar, C. (2022). Interpretable machine learning (2nd ed.). https://christophm.github.io/interpretable-ml-book/

Nazeer, J., & Marnewick, C. (2022). Investigating the impact of information systems project complexity on project success dimensions. (2022). Journal of modern project management, 10(2), 186-205. https://journalmodernpm.com/manuscript/index.php/jmpm/article/view/531

Nishat, M. M., Ahsan, A., & Olsson, N. O. E. (2025). Applying Machine Learning for Predictive Analysis in Project-Based Data: Insights into Variation Orders. Journal of Information Technology in Construction (ITcon), 30, 807-825. https://doi.org/10.36680/j.itcon.2025.033

Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., & Duchesnay, É. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12, 2825–2830. https://jmlr.org/papers/v12/pedregosa11a.html

Razaghzadeh, B. M., Vanani, I. R., & Goodarzi, M. (2024). Predicting the success of startups using a machine learning approach. Journal of Innovation and Entrepreneurship, 13. https://doi.org/10.1186/s13731-024-00436-x

Saarela, M., & Podgorelec, V. (2024). Recent applications of explainable AI (XAI): A systematic literature review. Applied Sciences, 14(19), 8884. https://doi.org/10.3390/app14198884

Salih, A. M., Raisi-Estabragh, Z., Galazzo, I. B., Radeva, P., Petersen, S. E., Lekadir, K., & Menegaz, G. (2025). A perspective on explainable artificial intelligence methods: SHAP and LIME. Advanced Intelligent Systems, 7(1), 2400304. https://doi.org/10.1002/aisy.202400304

Santos, J. I., Pereda, M., Ahedo, V., & Galán, J. M. (2023). Explainable machine learning for project management control. Computers & Industrial Engineering, 180, 109261. https://doi.org/10.1016/j.cie.2023.109261

Schwalbe, K. (2021). Information technology project management (9th ed.). Cengage Learning. https://dokumen.pub/information-technology-project-management-9thnbsped.html

Vimbi, V., Shaffi, N., & Mahmud, M. (2024). Interpreting artificial intelligence models: A systematic review on the application of LIME and SHAP in Alzheimer's disease detection. Brain Informatics, 11, 10. https://doi.org/10.1186/s40708-024-00222-1

World Bank. (2022). World development report 2022: Finance for an equitable recovery. https://www.worldbank.org/en/publication/wdr2022