ChatGPT's Success in the Board-Certified Pharmacotherapy Specialist (BCPS) Exam

• Published in: Journal of Research in Pharmacy
• Main Author: Al-Worafi Y.M.; Chooi W.H.; Tan C.S.; Lua P.L.; Farrukh M.J.; Zulkifly H.H.; Ming L.C.
• Format: Article
• Language: English
• Published: Marmara University 2024
• Online Access: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85196672190&doi=10.29228%2fjrp.729&partnerID=40&md5=9630eadbcd57573638223eeeb9117fd5

The advent of artificial intelligence (AI) and natural language processing technologies has ushered in a new era of innovative educational tools and resources. ChatGPT, a prominent AI-powered language model, has demonstrated remarkable potential in various fields. In this study, we aim to explore the ability of ChatGPT to answer Pharmacotherapy Specialist (BCPS) exam questions and provide justifications for its answers. We conducted a comprehensive content analysis to scrutinize the applicability and competence of ChatGPT in addressing BCPS exam inquiries while substantiating the correctness of its responses. Our findings reveal that ChatGPT was able to answer 94 out of 128 questions (73.43%) correctly and justify 80.16% of the correct answers appropriately and 76.18% of the noncorrect answers in all questions. Conclusion: The ChatGPT’s ability to answer the Pharmacotherapy Specialist (BCPS) exam and justify the answers was good. ChatGPT could help pharmacists in their preparation for this exam with caution. ChatGPT is still in the early phase of use by educators and students worldwide, and its ability to answer exams will be better in the near future. Attending training workshops about ChatGPT and AI is very important and highly recommended. Practice ChatGPT in medical and health sciences education is very important and highly recommended to explore the potential uses, benefits and risks and suggest recommendations for best practices. © 2024 Marmara University Press.