You are here

  • Home
  • Archive
  • Volume 35, Issue 6
  • Methodological Quality of Randomized Controlled Trials of Postoperative Epidural Analgesia: Validation of the Epidural Analgesia Trial Checklist as a Specific Instrument to Evaluate Methodology

Article Text

Article menu
Download PDFPDF
REVIEW ARTICLE
Methodological Quality of Randomized Controlled Trials of Postoperative Epidural Analgesia: Validation of the Epidural Analgesia Trial Checklist as a Specific Instrument to Evaluate Methodology
  1. Spencer S. Liu, MD*,
  2. Brandon M. Togioka, MD†,
  3. Robert W. Hurley, MD, PhD‡,
  4. Cuong M. Vu, MD§,
  5. Marie N. Hanna, MD†,
  6. Jamie D. Murphy, MD† and
  7. Christopher L. Wu, MD†
  1. From the *Department of Anesthesiology, Hospital of Special Surgery, and the Cornell Weill Medical Center; New York, NY; the
  2. †Department of Anesthesiology and Critical Care Medicine, The Johns Hopkins University, Baltimore, MD;
  3. ‡Department of Anesthesiology, University of Florida School of Medicine, Gainesville, FL; and
  4. §Department of Anesthesia, Massachusetts General Hospital; Boston, MA.
  1. Address correspondence to: Christopher L. Wu, MD, The Johns Hopkins Hospital, Carnegie 280, 600 North Wolfe St, Baltimore, MD 21287 (e-mail: chwu{at}jhmi.edu).

Abstract

Background: The overall benefits of epidural analgesia are controversial, in part because of the varying quality of methodology in published randomized controlled trials (RCTs). We performed a systematic review of available RCTs to examine the methodological quality of epidural analgesia trials. Current instruments for evaluating the quality of methodology are generic; thus, we also developed a specific assessment tool named Epidural Analgesia Trial Checklist (EATC).

Methods: The National Library of Medicine's PubMed database was searched (1966 to January 2006) for RCTs of epidural analgesia. All RCTs that had epidural infusion analgesia in at least 1 study arm and as primary intervention for randomization were included. Two independent reviewers were given blinded full-text paper versions of each article and reviewed all articles for inclusion in this study. Study characteristics were extracted from accepted RCTs, and reviewers completed the standardized 7-item Jadad score, 22-item Consolidated Standards of Reporting Trials (CONSORT) checklist, and 8-item EATC for evaluation of methodological quality.

Results: A total of 321 articles met all inclusion criteria. The overall median (first, third quartiles) Jadad, CONSORT, and EATC scores were 2 (1, 3), 10 (8, 11), and 4 (3, 6) (of maximum scores of 5, 22, and 8), respectively. For all assessments, we found significantly higher methodological study quality for articles with a larger study population size, those written by a first author affiliated with an anesthesiology department, and studies published after release of the CONSORT statement with a significant overall increase in methodological quality over time. There was no effect on methodological quality with regard to region of publication or number of centers. There was relatively high interrater agreement when using the EATC (κ = 0.92). The items most frequently lacking from the studies captured using the EATC were appropriate description/definition of adverse effects (11.8% of all studies properly reported this), proper presentation of visual analog scale (VAS) pain scores (31.2%), and assessment of VAS pain both at rest and with activity (39.9%).

Conclusions: Methodology scores for epidural analgesia RCTs have improved over time. The EATC seems to correlate well with other commonly used generic assessments for methodological RCT quality and be useful for assessing methodological quality of epidural RCTs. Future epidural analgesia RCTs should focus on improving appropriate description/definition of adverse effects, proper presentation of VAS pain scores, and assessment of VAS pain both at rest and with activity.

https://doi.org/10.1097/AAP.0b013e3181fa114e

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Footnotes

    • No external funding was provided. This work was supported by and should be attributed to the Department of Anesthesiology and Critical Care Medicine, The Johns Hopkins University, Baltimore, MD.