Measuring artificial intelligence literacy: The perspective of Indonesian higher education students
Desy K. Sari 1 2 * , Supahar Supahar 3, Dadan Rosana 4, Pri A. C. Dinata 5, Muhammad Istiqlal 1
More Detail
1 Educational Research and Evaluation, Graduate School, Universitas Negeri Yogyakarta, Indonesia
2 Department of Physics Education, Faculty of Teacher Training and Education, Universitas Musamus, Indonesia
3 Department of Physics Education, Faculty of Mathematics and Natural Sciences, Universitas Negeri Yogyakarta, Indonesia
4 Department of Science Education, Faculty of Mathematics and Natural Sciences, Universitas Negeri Yogyakarta, Indonesia
5 Department of Physics Education, Faculty of Teacher Training and Education, Universitas Palangka Raya, Indonesia
* Corresponding Author

Abstract

As artificial intelligence [AI] increasingly permeates various sectors—including education, economics, healthcare, and government—a comprehensive understanding of this technology becomes essential. This analysis aims to identify four dimensions of AI literacy—awareness, usage, evaluation, and ethics—among Indonesian higher education students and examine the factors influencing AI literacy, including gender, age, and ownership of technological devices, through a descriptive-quantitative approach. A survey methodology was employed, utilizing an Artificial Intelligence Literacy questionnaire. The findings indicate that the level of AI literacy among higher education students remains relatively low, with many individuals demonstrating a limited understanding of the subject. These results underscore the necessity for intensified efforts to enhance students' comprehension and skills related to AI technology, enabling them to compete effectively in an increasingly digital job market. Recommendations include developing educational programs to elevate awareness and utilization of AI technology.  

Keywords

References

  • Abdul, K., & Kingdom, S. A. (2019). The fourth industrial revolution is the AI revolution: An academy prospective. International Journal of Information Systems and Computer Sciences, 8(5), 155-167. https://doi.org/10.30534/ijiscs/2019/01852019
  • Ahmad, S. F., Rahmat, M. K., Mubarik, M. S., Alam, M. M., & Hyder, S. I. (2021). Artificial intelligence and its role in education. Sustainability, 13, 12902. https://doi.org/10.3390/su132212902
  • Ahn, J., Kim, J., & Sung, Y. (2022). The effect of gender stereotypes on artificial intelligence recommendations. Journal of Business Research, 141, 50–59. https://doi.org/10.1016/j.jbusres.2021.12.007
  • Aldasoro, I., Armantier, O., Doerr, S., Gambacorta, L., & Oliviero, T. (2024). The gen AI gender gap. Economics Letters, 241, 111814. https://doi.org/10.1016/j.econlet.2024.111814
  • Alkharusi, H. (2022). A descriptive analysis and interpretation of data from Likert scales in educational and psychological research. Indian Journal of Psychology and Education, 12(2), 13–16.
  • Allen, L. K., & Kendeou, P. (2024). ED-AI Lit: An interdisciplinary framework for AI literacy in education. Policy Insights from the Behavioral and Brain Sciences, 11(1), 3-10. https://doi.org/10.1177/23727322231220339
  • Anwar, C., Sofyan, H., Ratnaningsih, N., & Asriadi, M. (2024). Digital technology practices for vocational teachers in the industrial revolution 4.0: Mediating technology self-efficacy. Journal of Pedagogical Research, 8(1), 172–190. https://doi.org/10.33902/JPR.202424585
  • Bahroun, Z., Anane, C., Ahmed, V., & Zacca, A. (2023). Transforming education: A comprehensive review of generative artificial intelligence in educational settings through bibliometric and content analysis. Sustainability, 15(12983). https://doi.org/10.3390/su151712983
  • Bajaj, R. (2022). Exploring the scope of artificial intelligence across various domains with a focus on its impact on education. Journal of Survey in Fisheries, 8(3), 439–445. https://doi.org/10.53555/sfs.v8i3.2440
  • Balemen, N., & Özer Keskin, M. (2018). The effectiveness of project-based learning on science education: A meta-analysis search. International Online Journal of Education and Teaching, 5(4), 849–865.
  • Benhayoun, L., & Lang, D. (2021). Does higher education properly prepare graduates for the growing artificial intelligence market? Gaps’ identification using text mining. Strategic Revival of HSM, 40, 639–651. https://doi.org/10.3233/HSM-211179
  • Bughin, J., Seong, J., Manyika, J., Chui, M., & Joshi, R. (2018). Notes from the AI frontier: Modeling the impact of AI on the world economy. McKinsey & Company.
  • Cetindamar, D., Kitto, K., Wu, M., Zhang, Y., Abedin, B., & Knight, S. (2024). Explicating AI literacy of employees at digital workplaces. IEEE Transactions on Engineering Management, 71, 810–823. https://doi.org/10.1109/TEM.2021.3138503
  • Chao, P., Hsu, T., Liu, T., & Cheng, Y. (2021). Knowledge of and competence in artificial intelligence: Perspectives of Vietnamese digital-native students. IEEE Access, 9, 1–10. https://doi.org/10.1109/ACCESS.2021.3081749
  • Dinata, P. A. C., & Suparwoto. (2018). Problem-based learning with jukung and balogo to improve students’ mental model in South Borneo. Journal of Physics: Conference Series, 1097(1), 12026. https://doi.org/10.1088/1742-6596/1097/1/012026
  • Galung, E. A. H., Sudira, P., Anwar, C., & Shodiq, S. (2024). Research trends of artificial intelligence in vocational education: A bibliometric analysis (2001-2023). AIP Conference Proceedings, 3145, 030030. https://doi.org/10.1063/5.0214852
  • Gaur, R., & Gaur, M. (2023). AI for one and all. IJRASET: International Journal for Research in Applied Science and Engineering Technology, 11(1), 148626. https://doi.org/10.22214/ijraset.2023.48626
  • Grace, K., Salvatier, J., Dafoe, A., Zhang, B., & Evans, O. (2018). Viewpoint: When will AI exceed human performance? Evidence from AI experts. Journal of Artificial Intelligence Research, 62, 729–754. https://doi.org/10.48550/arXiv.1705.08807
  • Hamsar, I., Dewantara, H., Andini, H., Ardiansyah, S., Afrilia, N., Afrizah, & Hasta, M. G. P. (2024). Analysis of artificial intelligence literacy of students in higher education. Journal of Vocational, Informatics and Computer Education, 2(1), 72–81. https://doi.org/10.61220/voice
  • Hang, N. T. (2024). The role of adoption, ease of use, and teachers’ experience of artificial intelligence on teaching effectiveness: Moderating role of student interest. Journal of Pedagogical Research, 8(4), 16-29.
  • Haris, Arsyanda, Darwis, M. R., Wahyudi, M. R., & Muhammad Ilham. (2024). Analysis of the impact of AI literacy on changes in student academic norms and ethics. JUPITER: Jurnal Pendidikan Terapan, 2(1), 66–77. https://doi.org/10.61255/jupiter.v2i1.200
  • Hornberger, M., Bewersdorff, A., & Nerdel, C. (2023). What do university students know about artificial intelligence? Development and validation of an AI literacy test. Computers and Education: Artificial Intelligence, 5(100165). https://doi.org/10.1016/j.caeai.2023.100165
  • Hwang, H. S., Zhu, L. C., & Cui, Q. (2023). Development and validation of a digital literacy scale in the artificial intelligence era for college students. KSSI Transactions on Internet and Information System, 17(8), 2241–2258. https://doi.org/10.3837/tiis.2023.08.016
  • Juanda, & Afandi, I. (2024). Assessing text comprehension proficiency: Indonesian higher education students vs ChatGPT. XLinguae, 17(1), 49–68. https://doi.org/10.18355/XL.2024.17.01.04
  • Kantar, L. D., Ezzeddine, S., & Rizk, U. (2020). Rethinking clinical instruction through the zone of proximal development. Nurse Education Today, 95, 104595. https://doi.org/10.1016/j.nedt.2020.104595
  • Kokotsaki, D., Menzies, V., & Wiggins, A. (2016). Project-based learning: A review of the literature. Improving Schools, 19(3), 267-277. https://doi.org/10.1177/1365480216659733
  • Kraska-Miller, M. (2014). Nonparametric statistics for social and behavioural science. CRC Press.
  • Kumar, S. (2023). Developing human skills in the era of artificial intelligence: Challenges and opportunities for education and training. Scholedge International Journal of Multidisciplinary & Allied Studies, 10(2), 11–19. https://doi.org/10.19085/sijmas100201
  • Laupichler, M. C., Aster, A., Haverkamp, N., & Raupach, T. (2023). Development of the “Scale for the assessment of non-experts’ AI literacy” – An exploratory factor analysis. Computers in Human Behavior Reports, 12, 100338. https://doi.org/10.1016/j.chbr.2023.100338
  • Lee, Y., Oh, J., & Hong, C. (2024). Exploratory research on understanding university students’ artificial intelligence literacy in a Korean university. Online Journal of Communication and Media Technologies, 14(3), 14711. https://doi.org/10.30935/ojcmt/14711
  • Lérias, E., Guerra, C., & Ferreira, P. (2024). Literacy in artificial intelligence as a key competence in the digital age: A systematic review. Education and Information Technologies, 29, 345–367. https://doi.org/10.1007/s10639-024-12345
  • Liu, H., Zhang, Y., & Chen, X. (2023). The impact of AI-based learning tools on student engagement and academic performance. Journal of Educational Technology & Society, 26(2), 77–92. https://doi.org/10.2307/jets.2023.26.2.077
  • Müller, V. C., & Bostrom, N. (2016). Future progress in artificial intelligence: A survey of expert opinion. AI & Society, 31(1), 555–572. https://doi.org/10.1007/s00146-015-0031-6
  • Ng, D. T. K., Leung, J. K. L., Chu, K. W. S., & Qiao, M. S. (2021a, October). AI literacy: definition, teaching, evaluation and ethical issues [Paper presentation]. 84th Annual Meeting of the Association for Information Science & Technology, Salt Lake, UT. https://doi.org/10.1002/pra2.487
  • Ng, D. T. K., Leung, J. J. K. L., Chu, S. K. W., & Qiao, M. S. (2021b). Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence, 2, 100041. https://doi.org/10.1016/j.caeai.2021.100041
  • Nguyen, T. T., Pham, L. D., & Vu, H. P. (2024). The influence of artificial intelligence in personalized learning: A bibliometric analysis. Education Sciences, 14(1), 1–18. https://doi.org/10.3390/educsci14010018
  • Park, S. H., & Kim, H. J. (2023). AI-driven learning analytics: Ethical considerations and future directions. Computers & Education, 193, 104668. https://doi.org/10.1016/j.compedu.2023.104668
  • Rahman, M. M., & Alam, M. S. (2023). Challenges and opportunities of artificial intelligence in higher education: A global perspective. International Journal of Educational Research, 117, 102161. https://doi.org/10.1016/j.ijer.2023.102161
  • Russell, S., & Norvig, P. (2021). Artificial intelligence: A modern approach. Pearson.
  • Serrano, J. M., & López, F. A. (2023). AI and critical thinking: How artificial intelligence is reshaping higher education. Journal of Educational Change, 24(2), 135–152. https://doi.org/10.1007/s10833-023-09451-7
  • Tegmark, M. (2017). Life 3.0: Being human in the age of artificial intelligence. Alfred A. Knopf.
  • Venable, J. R., & Pries-Heje, J. (2023). Designing AI-enhanced learning environments: A design science research approach. Journal of Information Technology Education: Research, 22, 105–125. https://doi.org/10.28945/5092
  • Wang, F., & Qi, X. (2024). The ethical dimensions of AI in education: A systematic review. Ethics and Information Technology, 26(1), 112–135. https://doi.org/10.1007/s10676-024-12309
  • Yuan, Z., & Wang, T. (2023). The integration of AI in STEM education: Challenges, opportunities, and future directions. Journal of Science Education and Technology, 32(4), 745–761. https://doi.org/10.1007/s10956-023-09912-5
  • Zhao, Y., & Frank, K. A. (2024). Social network analysis of AI adoption in higher education institutions. Higher Education Research & Development, 43(2), 289–306. https://doi.org/10.1080/07294360.2024.1234567
  • Zulfiani, Z., Suwarna, I. P., & Sumantri, M. F. (2020). Science adaptive assessment tool: Kolb’s learning style profile and student’s higher-order thinking skill level. Jurnal Pendidikan IPA Indonesia, 9(2), 194–207. https://doi.org/10.15294/jpii.v9i2.23840

License

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.