Yıl: 2024 Cilt: 6 Sayı: 1 Sayfa Aralığı: 55 - 59 Metin Dili: İngilizce DOI: 10.36519/idcm.2024.286 İndeks Tarihi: 04-04-2024

How Reliable is ChatGPT as a Novel Consultant in Infectious Diseases and Clinical Microbiology?

Öz:
Objective: The study aimed to investigate the reliability of ChatGPT’s answers to medical questions, including those sourced from patients and guide recommendations. The focus was on evaluating ChatGPT’s accuracy in responding to various types of infectious disease questions. Materials and Methods: The study was conducted using 200 questions sourced from social media, experts, and guidelines related to various infectious diseases like urinary tract infection, pneumonia, HIV, various types of hepatitis, COVID-19, skin infections, and tuberculosis. The questions were arranged for clarity and consistency by excluding repetitive or unclear ones. The answers were based on guidelines from reputable sources like the Infectious Diseases Society of America (IDSA), Centers for Disease Control and Prevention (CDC), European Association for the Study of Liver Disease (EASL) and Joint United Nations Programme on HIV/AIDS (UNAIDS) AIDSinfo. According to the scoring system, completely correct answers were given 1-point, and completely incorrect ones were given 4-points. To assess reproducibility, each question was posed twice on separate computers. Repeatability was determined by the consistency of the answers’ scores. Results: In the study, ChatGPT was posed with 200 questions: 107 from social media platforms and 93 from guidelines. The questions covered a range of topics: urinary tract infections (n=18 questions), pneumonia (n=22), HIV (n=39), hepatitis B and C (n=53), COVID-19 (n=11), skin and soft tissue infections (n=38), and tuberculosis (n=19). The lowest accuracy was 72% for urinary tract infections. ChatGPT answered 92% of social media platform questions correctly (scored 1-point) versus 69% of guideline questions (p =0.001; OR=5.48, 95% CI=2.29-13.11). Conclusion: Artificial intelligence is widely used in the medical field by both healthcare professionals and patients. Although ChatGPT answers questions from social media platforms quite properly, we recommend that healthcare professionals be conscientious when using it.
Anahtar Kelime: infectious disease Chat-GTP medical questions

Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık
  • 1 Sawyer RG, Evans HL. Surgical site infection-the next frontier in global surgery. Lancet Infect Dis. 2018;18(5):477-8. [CrossRef]
  • 2 Stevens V, Dumyati G, Fine LS, Fisher SG, van Wijngaarden E. Cumulative antibiotic exposures over time and the risk of Clostridium difficile infection. Clin Infect Dis. 2011;53(1):42-8. [CrossRef]
  • 3 Harbarth S, Samore MH, Lichtenberg D, Carmeli Y. Prolonged antibiotic prophylaxis after cardiovascular surgery and its effect on surgical site infections and antimicrobial resistance. Circulation. 2000;101(25):2916-21. [CrossRef]
  • 4 de Jonge SW, Boldingh QJJ, Solomkin JS, Dellinger EP, Egger M, Salanti G, et al. Effect of postoperative continuation of antibiotic prophylaxis on the incidence of surgical site infection: a systematic review and meta-analysis. Lancet Infect Dis. 2020;20(10):1182-92. [CrossRef]
  • 5 Branch-Elliman W, O’Brien W, Strymish J, Itani K, Wyatt C, Gupta K. Association of duration and type of surgical prophylaxis with antimicrobial-associated adverse events. JAMA Surg. 2019;154(7):590-8. [CrossRef]
  • 6 Global guidelines for prevention of surgical site infection, 2018 [Internet]. Genova: World Health organization (WHO). [cited December 7, 2023]. Available from: https://apps.who.int/iris/ bitstream/handle/10665/277399/9789241550475-eng.pdf?- sequence=1&isAllowed=y
  • 7 Bratzler DW, Dellinger EP, Olsen KM, Perl TM, Auwaerter PG, Bolon MK, et al; American Society of Health-System Pharmacists; Infectious Disease Society of America; Surgical Infection Society; Society for Healthcare Epidemiology of America. Clinical practice guidelines for antimicrobial prophylaxis in surgery. Am J Health Syst Pharm. 2013;70(3):195-283. [CrossRef]
  • 8 Berríos-Torres SI, Umscheid CA, Bratzler DW, Leas B, Stone EC, Kelz RR, et al; Healthcare Infection Control Practices Advisory Committee. Centers for Disease Control and Prevention Guideline for the Prevention of Surgical Site Infection, 2017. JAMA Surg. 2017;152(8):784-91. Erratum in: JAMA Surg. 2017;152(8):803. [CrossRef]
  • 9 Versporten A, Zarb P, Caniaux I, Gros MF, Drapier N, Miller M, et al; Global-PPS network. Antimicrobial consumption and resistance in adult hospital inpatients in 53 countries: results of an internet-based global point prevalence survey. Lancet Glob Health. 2018;6(6):e619-e29. Erratum in: Lancet Glob Health. 2018;6(9):e968. [CrossRef]
  • 10 Ohata K, Chen F, Takahashi M, Kondo T, Motoyama H, Hijiya K, et al. P-200 Early cessation of prophylaxis may increase the incidence of cytomegalovirus infection after lung transplantation. Interact CardioVasc Thorac Surg. 2015; 21(Issue suppl_1):54-5. [CrossRef]
  • 11 Marjanski T, Dziedzic R, Ostrowski M, Sledzinska A, Rzyman W. P-095 Prolonged antibiotic prophylaxis reduces perioperative respiratory complications rate after curative resections due to lung cancer. Interact CardioVasc Thorac Surg. 2017;25(suppl_1). [CrossRef]
  • 12 Zay Ya K, Win PTN, Bielicki J, Lambiris M, Fink G. Association between antimicrobial stewardship programs and antibiotic use globally: a systematic review and meta-analysis. JAMA Netw Open. 2023;6(2):e2253806. [CrossRef]
  • 13 Batlle M, Badia JM, Hernández S, Grau S, Padulles A, Boix-Palop L, et al; Members of the 7VINCut Study Group; VINCat Program. Reducing the duration of antibiotic therapy in surgical patients through a specific nationwide antimicrobial stewardship program. A prospective, interventional cohort study. Int J Antimicrob Agents. 2023;62(5):106943. [CrossRef]
  • 14 Díaz-Madriz JP, Zavaleta-Monestel E, Villalobos-Madriz JA, Rojas-Chinchilla C, Castrillo-Portillo P, Meléndez-Alfaro A, et al. Impact of the five-year intervention of an antimicrobial stewardship program on the optimal selection of surgical prophylaxis in a hospital without antibiotic prescription restrictions in Costa Rica: A retrospective study. Antibiotics (Basel). 2023;12(11):1572. [CrossRef]
  • 15 Tünay H. Evaluation of surgical antibiotics prophylaxis. Health Sci Q. 2023;3(1):43-7. [CrossRef]
  • 16 Otaigbe II, Elikwu CJ. Drivers of inappropriate antibiotic use in low- and middle-income countries. JAC Antimicrob Resist. 2023;5(3):dlad062. [CrossRef]
APA Tunçer G, Güçlü K (2024). How Reliable is ChatGPT as a Novel Consultant in Infectious Diseases and Clinical Microbiology?. , 55 - 59. 10.36519/idcm.2024.286
Chicago Tunçer Gülsah,Güçlü Kadir Görkem How Reliable is ChatGPT as a Novel Consultant in Infectious Diseases and Clinical Microbiology?. (2024): 55 - 59. 10.36519/idcm.2024.286
MLA Tunçer Gülsah,Güçlü Kadir Görkem How Reliable is ChatGPT as a Novel Consultant in Infectious Diseases and Clinical Microbiology?. , 2024, ss.55 - 59. 10.36519/idcm.2024.286
AMA Tunçer G,Güçlü K How Reliable is ChatGPT as a Novel Consultant in Infectious Diseases and Clinical Microbiology?. . 2024; 55 - 59. 10.36519/idcm.2024.286
Vancouver Tunçer G,Güçlü K How Reliable is ChatGPT as a Novel Consultant in Infectious Diseases and Clinical Microbiology?. . 2024; 55 - 59. 10.36519/idcm.2024.286
IEEE Tunçer G,Güçlü K "How Reliable is ChatGPT as a Novel Consultant in Infectious Diseases and Clinical Microbiology?." , ss.55 - 59, 2024. 10.36519/idcm.2024.286
ISNAD Tunçer, Gülsah - Güçlü, Kadir Görkem. "How Reliable is ChatGPT as a Novel Consultant in Infectious Diseases and Clinical Microbiology?". (2024), 55-59. https://doi.org/10.36519/idcm.2024.286
APA Tunçer G, Güçlü K (2024). How Reliable is ChatGPT as a Novel Consultant in Infectious Diseases and Clinical Microbiology?. Infectious diseases and clinical microbiology (Online), 6(1), 55 - 59. 10.36519/idcm.2024.286
Chicago Tunçer Gülsah,Güçlü Kadir Görkem How Reliable is ChatGPT as a Novel Consultant in Infectious Diseases and Clinical Microbiology?. Infectious diseases and clinical microbiology (Online) 6, no.1 (2024): 55 - 59. 10.36519/idcm.2024.286
MLA Tunçer Gülsah,Güçlü Kadir Görkem How Reliable is ChatGPT as a Novel Consultant in Infectious Diseases and Clinical Microbiology?. Infectious diseases and clinical microbiology (Online), vol.6, no.1, 2024, ss.55 - 59. 10.36519/idcm.2024.286
AMA Tunçer G,Güçlü K How Reliable is ChatGPT as a Novel Consultant in Infectious Diseases and Clinical Microbiology?. Infectious diseases and clinical microbiology (Online). 2024; 6(1): 55 - 59. 10.36519/idcm.2024.286
Vancouver Tunçer G,Güçlü K How Reliable is ChatGPT as a Novel Consultant in Infectious Diseases and Clinical Microbiology?. Infectious diseases and clinical microbiology (Online). 2024; 6(1): 55 - 59. 10.36519/idcm.2024.286
IEEE Tunçer G,Güçlü K "How Reliable is ChatGPT as a Novel Consultant in Infectious Diseases and Clinical Microbiology?." Infectious diseases and clinical microbiology (Online), 6, ss.55 - 59, 2024. 10.36519/idcm.2024.286
ISNAD Tunçer, Gülsah - Güçlü, Kadir Görkem. "How Reliable is ChatGPT as a Novel Consultant in Infectious Diseases and Clinical Microbiology?". Infectious diseases and clinical microbiology (Online) 6/1 (2024), 55-59. https://doi.org/10.36519/idcm.2024.286