AI-Powered Performance Appraisal: Balancing Automation with Human Judgment in Performance Management Systems

Andry Novrianto; Deval Gustion; Elmi Rahmawati

doi:10.37034/jems.v7i3.163

Authors

Andry Novrianto Universitas Putra Indonesia “YPTK” Padang
Deval Gustion Universitas Putra Indonesia “YPTK” Padang
Elmi Rahmawati Universitas Putra Indonesia “YPTK” Padang

DOI:

https://doi.org/10.37034/jems.v7i3.163

Keywords:

Artificial Intelligence, Performance Appraisal, Human Judgment, Hybrid Evaluation, Ethical Decision-Making

Abstract

This study aims to explore how organizations integrate Artificial Intelligence (AI) and human judgment within employee performance appraisal systems to achieve outcomes that are fair, efficient, and contextually informed. Using a qualitative case study approach involving three organizations based in Jakarta, Surabaya, and Singapore, data were collected through semi-structured interviews, internal document analysis, and observations of performance review panels. Each organization utilized AI-driven human resource management platforms such as SAP SuccessFactors and IBM Watson Talent Insights, while maintaining significant human involvement in final appraisal decisions. Thematic analysis revealed five major themes: trust in AI, human override, fairness, emotional fit, and ethical concerns. The findings indicate that although AI enhances consistency and efficiency, qualitative dimensions such as leadership, collaboration, and cultural alignment still require human interpretation. The study also introduces a hybrid appraisal model that combines AI and human scores, adjusted by an ethical risk coefficient. These results contribute empirical insights into contemporary appraisal practices and emphasize the importance of algorithmic transparency and ethical sensitivity in the implementation of AI-based systems within human resource management.

References

Braun, V., & Clarke, V. (2021). Thematic analysis: A practical guide. SAGE Publications.

Creswell, J. W., & Poth, C. N. (2021). Qualitative inquiry and research design: Choosing among five approaches (4th ed.). SAGE Publications.

Haenlein, M., Kaplan, A., Tan, C.-W., & Zhang, P. (2021). Artificial intelligence in human resources management: Challenges and a path forward. California Management Review, 63(3), 135–152. https://doi.org/10.1177/00081256211014385

Jarrahi, M. H. (2021). Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making. Business Horizons, 64(5), 595–606. https://doi.org/10.1016/j.bushor.2021.02.020

Khan, S., Maalik, A., & Zaman, A. (2021). AI-driven human resource management: Towards a conceptual framework. Journal of Business and Social Review in Emerging Economies, 7(1), 47–60. https://doi.org/10.26710/jbsee.v7i1.1560

Kim, J., & Park, S. (2021). Beyond numbers: A qualitative exploration of performance appraisal in digital era. Human Resource Development Review, 20(1), 70–89. https://doi.org/10.1177/1534484320978962

Liu, Y., Wei, Y., & Wang, Y. (2022). Human factors in AI-based performance evaluation systems. International Journal of Human–Computer Interaction, 38(11), 1012–1023. https://doi.org/10.1080/10447318.2021.2006455

Nugroho, Y., Prasetyo, A., & Rahman, T. (2023). The transformation of performance appraisal through AI integration: A case study. Indonesian Journal of Management Studies, 7(2), 120–134. https://doi.org/10.21009/IJMS.07206

Park, S., & Lee, J. (2020). Designing AI systems for performance appraisal: A sociotechnical perspective. Journal of Information Technology, 35(4), 305–320. https://doi.org/10.1177/0268396220911880

Sujan, M., Hassan, R., & Bakar, R. (2020). Ethical considerations in AI-based HR systems: A hybrid appraisal model. Ethics and Information Technology, 22(4), 323–334. https://doi.org/10.1007/s10676-020-09538-9

Tambe, P., Cappelli, P., & Yakubovich, V. (2020). Artificial intelligence in human resources management: Challenges and a path forward. Academy of Management Perspectives, 34(4), 628–652. https://doi.org/10.5465/amp.2018.0071

Zambrano, R., O'Neill, J., & Araya, D. (2022). Algorithmic fairness in workplace surveillance and appraisal. Technology in Society, 70, 101968. https://doi.org/10.1016/j.techsoc.2022.101968

Zhang, L., & Fu, H. (2022). The role of perceived fairness in AI-based performance reviews. Journal of Organizational Behavior, 43(1), 23–38. https://doi.org/10.1002/job.2553

Ghosh, R., & Saha, D. (2023). Organizational readiness for hybrid performance management systems. International Journal of Productivity and Performance Management, 72(2), 425–442. https://doi.org/10.1108/IJPPM-04-2021-0205

Lee, S., & Chang, H. (2022). Hybrid intelligence in HR analytics: Integrating AI and human judgment. Journal of Business Research, 139, 854–863. https://doi.org/10.1016/j.jbusres.2021.10.063

Murthy, V., & Menon, S. (2020). Evaluating emotional intelligence in the era of AI-based appraisal. Human Resource Management Review, 30(4), 100736. https://doi.org/10.1016/j.hrmr.2019.100736

Nowell, L. S., Norris, J. M., White, D. E., & Moules, N. J. (2017). Thematic analysis: Striving to meet the trustworthiness criteria. International Journal of Qualitative Methods, 16(1), 1–13. https://doi.org/10.1177/1609406917733847

Yin, R. K. (2023). Case study research and applications: Design and methods (7th ed.). SAGE Publications.

Choudhury, S., & Singh, K. (2021). From human bias to algorithmic bias: Exploring ethics in AI-driven appraisal. Journal of Business Ethics, 172, 543–556. https://doi.org/10.1007/s10551-020-04666-7

Putro, R. L., & Candrakusuma, M. (2025). Human resource management in Muhammadiyah business charity: A case study of Airmu Ponorogo. Journal of Economics and Management Sciences, 7(2), 32–36. https://doi.org/10.37034/jems.v7i2.83