Exploring The Role of ChatGPT in Chemistry Learning : A Systematic Literature Review

Danang Priyadi, Suyanta Suyanta, Suwardi Suwardi, Illyas Md Isa

Abstract


This study used the systematic literature review method to analyze the contribution of ChatGPT in chemistry education by reviewing 30 related articles. The results showed that ChatGPT assists in various learning tasks, such as preparing lesson plans, assessing students' critical thinking and self-regulation skills, guiding practical sessions, and supporting scientific report writing. In addition, ChatGPT plays a role in the development of technology-based teaching materials and explaining complex chemical concepts. However, there are challenges in its implementation, such as the potential for students to rely on AI and the need for information verification to ensure the accuracy of scientific concepts. Therefore, in order for ChatGPT to remain a useful tool in chemistry learning, it must be accompanied by the right strategy. With appropriate guidance, this technology can increase student interaction and engagement, thereby contributing to improving the quality of chemistry teaching in the digital era


Keywords


ChatGPT, Artificial Intelligence, Chemistry Learning

Full Text:

PDF

References


Akavova, A., Temirkhanova, Z., & Lorsanova, Z. (2023). Adaptive learning and artificial intelligence in the educational space. E3S Web of Conferences, 451, 06011. https://doi.org/10.1051/e3sconf/202345106011

Akhtom, D., Osamah M, A., Eman, A., M., Amer, S., & Sahib, T. M. (2023). Unlocking Chatgpt’s Title Generation Potential: An Investigation Of Synonyms, Readability, And Introduction-Based Titles. Journal of Theoretical and Applied Information Technology, 101(22), 7435–7443.

Alnaim, N., AlSanad, D. S., Albelali, S., Almulhem, M., Almuhanna, A. F., Attar, R. W., Alsahli, M., Albagmi, S., Bakhshwain, A. M., Almazrou, S., Almutairi, S. A., AboAlsamh, H. M., Arif, W. M., Alsadhan, A. A., Alsedrah, I. T., Alanezi, F., Alibrahim, D., & Alqahtani, N. S. (2024). Effectiveness of ChatGPT in remote learning environments: An empirical study with medical students in Saudi Arabia. Nutrition and Health. https://doi.org/10.1177/02601060241273596

Alshahrani, A. (2023). Revolutionizing Blended Learning: Exploring Current Trends and Future Research Directions in the Era of ChatGPT. 2023 7th International Conference on Business and Information Management (ICBIM), 41–47. https://doi.org/10.1109/ICBIM59872.2023.10303267

Araújo, J. L., & Saúde, I. (2024). Can ChatGPT Enhance Chemistry Laboratory Teaching? Using Prompt Engineering to Enable AI in Generating Laboratory Activities. Journal of Chemical Education, 101(5), 1858–1864. https://doi.org/10.1021/acs.jchemed.3c00745

Ardyansyah, A., Yuwono, A. B., Rahayu, S., Alsulami, N. M., & Sulistina, O. (2024). Students’ Perspectives on the Application of a Generative Pre-Trained Transformer (GPT) in Chemistry Learning: A Case Study in Indonesia. Journal of Chemical Education, 101(9), 3666–3675. https://doi.org/10.1021/acs.jchemed.4c00220

Bazzari, A. H., & Bazzari, F. H. (2024). Assessing the ability of GPT-4o to visually recognize medications and provide patient education. Scientific Reports, 14(1), 26749. https://doi.org/10.1038/s41598-024-78577-y

Bettayeb, A. M., Abu Talib, M., Sobhe Altayasinah, A. Z., & Dakalbab, F. (2024). Exploring the impact of ChatGPT: conversational AI in education. Frontiers in Education, 9. https://doi.org/10.3389/feduc.2024.1379796

Bruno Silva, L. (2024). Generative Artificial Intelligence in chemistry teaching: ChatGPT, Gemini, and Copilot’s content responses. Journal of Applied Learning & Teaching, 7(2). https://doi.org/10.37074/jalt.2024.7.2.13

Chen, S., Xu, X., Zhang, H., & Zhang, Y. (2023). Roles of ChatGPT in virtual teaching assistant and intelligent tutoring system: opportunities and challenges. 2023 The 5th World Symposium on Software Engineering (WSSE), 201–206. https://doi.org/10.1145/3631991.3632024

Cheng, E. C. K., & Wang, T. (2023). Leading digital transformation and eliminating barriers for teachers to incorporate artificial intelligence in basic education in Hong Kong. Computers and Education: Artificial Intelligence, 5, 100171. https://doi.org/10.1016/j.caeai.2023.100171

Contreras, M. R., & Jaimes, J. O. P. (2024). AI Ethics in the Fields of Education and Research: A Systematic Literature Review. 2024 International Symposium on Accreditation of Engineering and Computing Education (ICACIT), 1–6. https://doi.org/10.1109/ICACIT62963.2024.10788651

Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 61(2), 228–239. https://doi.org/10.1080/14703297.2023.2190148

Dimeli, M., & Kostas, A. (2025). The Role of ChatGPT in Education: Applications, Challenges: Insights From a Systematic Review. Journal of Information Technology Education: Research, 24, 002. https://doi.org/10.28945/5422

Duque-Méndez, N. D., Tabares-Morales, V., & Ovalle, D. A. (2020). Intelligent Agents System for Adaptive Assessment (pp. 164–172). https://doi.org/10.1007/978-3-030-23990-9_20

Elmas, R., Adiguzel-Ulutas, M., & Yılmaz, M. (2024). Examining ChatGPT’s validity as a source for scientific inquiry and its misconceptions regarding cell energy metabolism. Education and Information Technologies, 29(18), 25427–25456. https://doi.org/10.1007/s10639-024-12749-1

ElSayary, A. (2024). An investigation of teachers’ perceptions of using ChatGPT as a supporting tool for teaching and learning in the digital era. Journal of Computer Assisted Learning, 40(3), 931–945. https://doi.org/10.1111/jcal.12926

Farhat, F., Chaudhry, B. M., Nadeem, M., Sohail, S. S., & Madsen, D. Ø. (2024). Evaluating Large Language Models for the National Premedical Exam in India: Comparative Analysis of GPT-3.5, GPT-4, and Bard. JMIR Medical Education, 10, e51523. https://doi.org/10.2196/51523

Fergus, S., Botha, M., & Ostovar, M. (2023). Evaluating Academic Answers Generated Using ChatGPT. Journal of Chemical Education, 100(4), 1672–1675. https://doi.org/10.1021/acs.jchemed.3c00087

Fonseca, C. (2024, June 18). The use of ChatGPT in Chemistry: the bibliometric analysis. 10th International Conference on Higher Education Advances (HEAd’24). https://doi.org/10.4995/HEAd24.2024.17276

Funa, A. A., & Gabay, R. A. E. (2025). Policy guidelines and recommendations on AI use in teaching and learning: A meta-synthesis study. Social Sciences & Humanities Open, 11, 101221. https://doi.org/10.1016/j.ssaho.2024.101221

Geetha, S. D., Khan, A., Khan, A., Kannadath, B. S., & Vitkovski, T. (2024). Evaluation of ChatGPT pathology knowledge using board-style questions. American Journal of Clinical Pathology, 161(4), 393–398. https://doi.org/10.1093/ajcp/aqad158

Ghazali, S. Al. (2024). Exploring the Potential of ChatGPT as a Substitute Teacher: A Case Study. International Journal of Information and Education Technology, 14(2), 271–278. https://doi.org/10.18178/ijiet.2024.14.2.2048

Ghimire, A., & Edwards, J. (2024). From Guidelines to Governance: A Study of AI Policies in Education (pp. 299–307). https://doi.org/10.1007/978-3-031-64312-5_36

Gupta, S., Dharamshi, R. R., & Kakde, V. (2024). An Impactful and Revolutionized Educational Ecosystem using Generative AI to Assist and Assess the Teaching and Learning benefits, Fostering the Post-Pandemic Requirements. 2024 Second International Conference on Emerging Trends in Information Technology and Engineering (ICETITE), 1–4. https://doi.org/10.1109/ic-ETITE58242.2024.10493370

Hallal, K., Hamdan, R., & Tlais, S. (2023). Exploring the potential of AI-Chatbots in organic chemistry: An assessment of ChatGPT and Bard. Computers and Education: Artificial Intelligence, 5, 100170. https://doi.org/10.1016/j.caeai.2023.100170

Hashem, R., Ali, N., El Zein, F., Fidalgo, P., & Abu Khurma, O. (2023). AI to the rescue: Exploring the potential of ChatGPT as a teacher ally for workload relief and burnout prevention. Research and Practice in Technology Enhanced Learning, 19, 023. https://doi.org/10.58459/rptel.2024.19023

Hasrod, T., Nuapia, Y. B., & Tutu, H. (2024). ChatGPT Helped Me Build a Chemistry App, and Here’s How You Can Make One Also. Journal of Chemical Education, 101(2), 653–660. https://doi.org/10.1021/acs.jchemed.3c01170

Hatmanto, E. D., & Sari, M. I. (2023). Aligning Theory and Practice: Leveraging Chat GPT for Effective English Language Teaching and Learning. E3S Web of Conferences, 440, 05001. https://doi.org/10.1051/e3sconf/202344005001

Hepp K., P., Prats Fernández, M. À., & Holgado García, J. (2015). Teacher training: technology helping to develop an innovative and reflective professional profile. RUSC. Universities and Knowledge Society Journal, 12(2), 30. https://doi.org/10.7238/rusc.v12i2.2458

Humphry, T., & Fuller, A. L. (2023). Potential ChatGPT Use in Undergraduate Chemistry Laboratories. Journal of Chemical Education, 100(4), 1434–1436. https://doi.org/10.1021/acs.jchemed.3c00006

Hung, J., & Chen, J. (2023). The Benefits, Risks and Regulation of Using ChatGPT in Chinese Academia: A Content Analysis. Social Sciences, 12(7), 380. https://doi.org/10.3390/socsci12070380

Janamala, V., Ram, I. S., & Daram, S. B. (2023). Realization of Green 5G Cellular Network Role in Medical Applications: Use of ChatGPT-AI. Annals of Biomedical Engineering, 51(11), 2337–2339. https://doi.org/10.1007/s10439-023-03257-3

Javaid, M., Haleem, A., Singh, R. P., Khan, S., & Khan, I. H. (2023). Unlocking the opportunities through ChatGPT Tool towards ameliorating the education system. BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 3(2), 100115. https://doi.org/10.1016/j.tbench.2023.100115

Kavitha, R. K., Krupa, C. R., & Kaarthiekheyan, V. (2024). AI-Powered Digital Solutions for Smart Learning. In Cybersecurity and Data Science Innovations for Sustainable Development of HEICC (pp. 213–227). CRC Press. https://doi.org/10.1201/9781032711300-15

Kim, M., & Adlof, L. (2024). Adapting to the Future: ChatGPT as a Means for Supporting Constructivist Learning Environments. TechTrends, 68(1), 37–46. https://doi.org/10.1007/s11528-023-00899-x

Kunitsu, Y. (2023). The Potential of GPT-4 as a Support Tool for Pharmacists: Analytical Study Using the Japanese National Examination for Pharmacists. JMIR Medical Education, 9, e48452. https://doi.org/10.2196/48452

Lee, G.-G., & Zhai, X. (2024). Using ChatGPT for Science Learning: A Study on Pre-service Teachers’ Lesson Planning. IEEE Transactions on Learning Technologies, 17, 1643–1660. https://doi.org/10.1109/TLT.2024.3401457

Lee, H.-Y., Chen, P.-H., Wang, W.-S., Huang, Y.-M., & Wu, T.-T. (2024). Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction. International Journal of Educational Technology in Higher Education, 21(1), 16. https://doi.org/10.1186/s41239-024-00447-4

Leite, B. (2023). Inteligência Artificial E Ensino De Química: Uma Análise Propedêutica Do Chatgpt Na Definição De Conceitos Químicos. Química Nova. https://doi.org/10.21577/0100-4042.20230059

Leon, A. J., & Vidhani, D. (2023). ChatGPT Needs a Chemistry Tutor Too. Journal of Chemical Education, 100(10), 3859–3865. https://doi.org/10.1021/acs.jchemed.3c00288

Liu, W. (2024). The cognitive basis of thematic analysis. International Journal of Research & Method in Education, 47(3), 277–287. https://doi.org/10.1080/1743727X.2023.2274337

Matsubara, S. (2024). Humans‐written versus ChatGPT‐generated case reports. Journal of Obstetrics and Gynaecology Research, 50(10), 1995–1999. https://doi.org/10.1111/jog.16078

Nascimento Júnior, W. J. D., Morais, C., & Girotto Júnior, G. (2024). Enhancing AI Responses in Chemistry: Integrating Text Generation, Image Creation, and Image Interpretation through Different Levels of Prompts. Journal of Chemical Education, 101(9), 3767–3779. https://doi.org/10.1021/acs.jchemed.4c00230

Nganji, J. T., Al-Qora’n, L. F., & Nsangong, K. (2024). An Overview of Teaching AI Literacy to University Students. In Effective Practices in AI Literacy Education: Case Studies and Reflections (pp. 11–19). Emerald Publishing Limited. https://doi.org/10.1108/978-1-83608-852-320241002

Ogugua, D., Yoon, S. N., & Lee, D. (2023). Academic Integrity in a Digital Era: Should the Use of ChatGPT Be Banned in Schools? GLOBAL BUSINESS FINANCE REVIEW, 28(7), 1–10. V

Osama, Afridi, & S, M. (2023). ChatGPT: Transcending Language Limitations in Scientific Research Using Artificial Intelligence. Journal of the College of Physicians and Surgeons Pakistan, 1198–1200. https://doi.org/10.29271/jcpsp.2023.10.1198

Park, H. K., & Martin, S. N. (2024). Exploring the Role of ChatGPT in Science Education for Asia-Pacific and Beyond: a Systematic Review. Asia-Pacific Science Education, 10(2), 233–264. https://doi.org/10.1163/23641177-bja10079

Patac, L. P., & Patac, A. V. (2025). Using ChatGPT for academic support: Managing cognitive load and enhancing learning efficiency – A phenomenological approach. Social Sciences & Humanities Open, 11, 101301. https://doi.org/10.1016/j.ssaho.2025.101301

Pati, D., & Lorusso, L. N. (2018). How to Write a Systematic Review of the Literature. HERD: Health Environments Research & Design Journal, 11(1), 15–30. https://doi.org/10.1177/1937586717747384

Qawqzeh, Y. (2024). Exploring the Influence of Student Interaction with ChatGPT on Critical Thinking, Problem Solving, and Creativity. International Journal of Information and Education Technology, 14(4), 596–601. https://doi.org/10.18178/ijiet.2024.14.4.2082

Rajala, J., Hukkanen, J., Hartikainen, M., & Niemelä, P. (2023). “”Call me Kiran" – ChatGPT as a Tutoring Chatbot in a Computer Science Course". 26th International Academic Mindtrek Conference, 83–94. https://doi.org/10.1145/3616961.3616974

Ramos, B., & Condotta, R. (2024). Enhancing Learning and Collaboration in a Unit Operations Course: Using AI as a Catalyst to Create Engaging Problem-Based Learning Scenarios. Journal of Chemical Education, 101(8), 3246–3254. https://doi.org/10.1021/acs.jchemed.4c00244

Ratten, V., & Jones, P. (2023). Generative artificial intelligence (ChatGPT): Implications for management educators. The International Journal of Management Education, 21(3), 100857. https://doi.org/10.1016/j.ijme.2023.100857

Roumeliotis, K. I., & Tselikas, N. D. (2023). ChatGPT and Open-AI Models: A Preliminary Review. Future Internet, 15(6), 192. https://doi.org/10.3390/fi15060192

Ruff, E. F., Engen, M. A., Franz, J. L., Mauser, J. F., West, J. K., & Zemke, J. M. O. (2024). ChatGPT Writing Assistance and Evaluation Assignments Across the Chemistry Curriculum. Journal of Chemical Education, 101(6), 2483–2492. https://doi.org/10.1021/acs.jchemed.4c00248

Ruff, E. F., Franz, J. L., & West, J. K. (2024). Using ChatGPT for Method Development and Green Chemistry Education in Upper-Level Laboratory Courses. Journal of Chemical Education, 101(8), 3224–3232. https://doi.org/10.1021/acs.jchemed.4c00193

Sallam, M., Al-Salahat, K., Eid, H., Egger, J., & Puladi, B. (2024). Human versus Artificial Intelligence: ChatGPT-4 Outperforming Bing, Bard, ChatGPT-3.5 and Humans in Clinical Chemistry Multiple-Choice Questions. Advances in Medical Education and Practice, Volume 15, 857–871. https://doi.org/10.2147/AMEP.S479801

Seo, K., Tang, J., Roll, I., Fels, S., & Yoon, D. (2021). The impact of artificial intelligence on learner–instructor interaction in online learning. International Journal of Educational Technology in Higher Education, 18(1), 54. https://doi.org/10.1186/s41239-021-00292-9

Sharma, D. (2024). Critical Thinking and Problem-Solving in the Age of ChatGPT: Experiential-Bibliotherapy-Blogging Project. Business and Professional Communication Quarterly, 87(4), 630–653. https://doi.org/10.1177/23294906241254780

Sorenson, B., & Hanson, K. (2024). Identifying Generative Artificial Intelligence Chatbot Use on Multiple-Choice, General Chemistry Exams Using Rasch Analysis. Journal of Chemical Education, 101(8), 3216–3223. https://doi.org/10.1021/acs.jchemed.4c00165

Taagepera, M., & Arasasingham, R. D. (2013). Using Knowledge Space Theory to Assess Student Understanding of Chemistry. In Knowledge Spaces (pp. 115–128). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-35329-1_7

Talaue, F. G. (2023). Dissonance in generative AI use among student writers: How should curriculum managers respond? E3S Web of Conferences, 426, 01058. https://doi.org/10.1051/e3sconf/202342601058

Taniguchi, M., & Lindsey, J. S. (2024). Performance of chatbots in queries concerning fundamental concepts in photochemistry. Photochemistry and Photobiology. https://doi.org/10.1111/php.14037

Tyson, J. (2023). Shortcomings of ChatGPT. Journal of Chemical Education, 100(8), 3098–3101. https://doi.org/10.1021/acs.jchemed.3c00361

Vargas-Murillo, A. R., Pari-Bedoya, I. N. M. de la A., & Guevara-Soto, F. de J. (2023). Challenges and Opportunities of AI-Assisted Learning: A Systematic Literature Review on the Impact of ChatGPT Usage in Higher Education. International Journal of Learning, Teaching and Educational Research, 22(7), 122–135. https://doi.org/10.26803/ijlter.22.7.7

West, J. K., Franz, J. L., Hein, S. M., Leverentz-Culp, H. R., Mauser, J. F., Ruff, E. F., & Zemke, J. M. (2023). An Analysis of AI-Generated Laboratory Reports across the Chemistry Curriculum and Student Perceptions of ChatGPT. Journal of Chemical Education, 100(11), 4351–4359. https://doi.org/10.1021/acs.jchemed.3c00581

Yik, B. J., & Dood, A. J. (2024). ChatGPT Convincingly Explains Organic Chemistry Reaction Mechanisms Slightly Inaccurately with High Levels of Explanation Sophistication. Journal of Chemical Education, 101(5), 1836–1846. https://doi.org/10.1021/acs.jchemed.4c00235

Yue, M., Jong, M. S.-Y., & Ng, D. T. K. (2024). Understanding K–12 teachers’ technological pedagogical content knowledge readiness and attitudes toward artificial intelligence education. Education and Information Technologies, 29(15), 19505–19536. https://doi.org/10.1007/s10639-024-12621-2

Yuliia V, K., & Babenko, O. M. (2024). Advantages and limitations of large language models in chemistry education: A comparative analysis of ChatGPT, Gemini and Copilot. (ICTERI 2024).

Zhang, L., & Ma, Y. (2023). A study of the impact of project-based learning on student learning effects: a meta-analysis study. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1202728




DOI: https://doi.org/https://doi.org/10.24815/jpsi.v13i3.45118

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 Danang Priyadi, Suyanta Suyanta


Jurnal Pendidikan Sains Indonesia (Indonesian Journal of Science Education)

ISSN 2338-4379  (print) | 2615-840X (online)
Organized by Universitas Syiah Kuala 
Published by Master of Science Education Study Program Graduate School Universitas Syiah Kuala, Banda Aceh, Indonesia
Website : http://jurnal.usk.ac.id/jpsi
Email     : jpsi@usk.ac.id

  

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.