Article Text
Abstract
Chat Generative Pre-trained Transformer (ChatGPT), an artificial intelligence chatbot, produces detailed responses and human-like coherent answers, and has been used in the clinical and academic medicine. To evaluate its accuracy in regional anesthesia topics, we produced a ChatGPT review on the addition of dexamethasone to prolong peripheral nerve blocks. A group of experts in regional anesthesia and pain medicine were invited to help shape the topic to be studied, refine the questions entered in to the ChatGPT program, vet the manuscript for accuracy, and create a commentary on the article. Although ChatGPT produced an adequate summary of the topic for a general medical or lay audience, the review that were created appeared to be inadequate for a subspecialty audience as the expert authors. Major concerns raised by the authors included the poor search methodology, poor organization/lack of flow, inaccuracies/omissions of text or references, and lack of novelty. At this time, we do not believe ChatGPT is able to replace human experts and is extremely limited in providing original, creative solutions/ideas and interpreting data for a subspecialty medical review article.
- REGIONAL ANESTHESIA
- Pharmacology
- OUTCOMES
Data availability statement
No data are available.
Statistics from Altmetric.com
Data availability statement
No data are available.
Footnotes
Twitter @ChrisWuMD, @jbLiujb, @EMARIANOMD
Contributors BC has made substantial contributions to all of the following: (1) the conception and design of the study, or acquisition of data, or analysis and interpretation of data, (2) drafting the article or revising it critically for important intellectual content, and (3) final approval of the version to be submitted. RG has made substantial contributions to all of the following: (1) the conception and design of the study, or acquisition of data, or analysis and interpretation of data, (2) drafting the article or revising it critically for important intellectual content, and (3) final approval of the version to be submitted. MCG has made substantial contributions to all of the following: (1) the conception and design of the study, or acquisition of data, or analysis and interpretation of data, (2) drafting the article or revising it critically for important intellectual content, and (3) final approval of the version to be submitted. RH has made substantial contributions to all of the following: (1) the conception and design of the study, or acquisition of data, or analysis and interpretation of data, (2) drafting the article or revising it critically for important intellectual content, and (3) final approval of the version to be submitted. JL has made substantial contributions to all of the following: (1) the conception and design of the study, or acquisition of data, or analysis and interpretation of data, (2) drafting the article or revising it critically for important intellectual content, and (3) final approval of the version to be submitted. ERM has made substantial contributions to all of the following: (1) the conception and design of the study, or acquisition of data, or analysis and interpretation of data, (2) drafting the article or revising it critically for important intellectual content, and (3) final approval of the version to be submitted. VM has made substantial contributions to all of the following: (1) the conception and design of the study, or acquisition of data, or analysis and interpretation of data, (2) drafting the article or revising it critically for important intellectual content, and (3) final approval of the version to be submitted. SGM has made substantial contributions to all of the following: (1) the conception and design of the study, or acquisition of data, or analysis and interpretation of data, (2) drafting the article or revising it critically for important intellectual content, and (3) final approval of the version to be submitted. CLW is responsible for the overall content as the guarantor and has made substantial contributions to all of the following: (1) the conception and design of the study, or acquisition of data, or analysis and interpretation of data, (2) drafting the article or revising it critically for important intellectual content, and (3) final approval of the version to be submitted.
Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests BC is a speaker for Haemonetics. RG’s institution has received funding and/or product for research purposes from Epimed, Infutronix, SPR Therapeutics, Merck, and Precision Genetics. RG’s institution serves as a consultant for Avanos. RH’s institution has received funding for his research from Avanos, NIH and AHRQ. SGM is the owner SGM Consulting. Partner Parvizi Surgical Innovations, Patent holder Multicatheter infusion system.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.