Journal of the American College of Surgeons
Volume 208, Issue 4 , Pages 621-626 , April 2009

Improving Quality Improvement: A Methodologic Framework for Evaluating Effectiveness of Surgical Quality Improvement

  • Lillian S. Kao, MD, MS, FACS

      Affiliations

    • Department of Surgery and Pediatric Surgery, University of Texas Health Science Center at Houston, Houston, TX
    • Center for Clinical Research and Evidence-Based Medicine, University of Texas Health Science Center at Houston, Houston, TX
    • Corresponding Author InformationCorrespondence address: Lillian S Kao, MD, MS, FACS, Department of Surgery, University of Texas Health Science Center at Houston, 5656 Kelley St, Suite 30S 62008, Houston, TX 77026
  • ,
  • Kevin P. Lally, MD, MS, FACS

      Affiliations

    • Department of Surgery and Pediatric Surgery, University of Texas Health Science Center at Houston, Houston, TX
  • ,
  • Eric J. Thomas, MD, MPH

      Affiliations

    • Department of Internal Medicine, University of Texas Health Science Center at Houston, Houston, TX
    • Center for Clinical Research and Evidence-Based Medicine, University of Texas Health Science Center at Houston, Houston, TX
  • ,
  • Jon E. Tyson, MD, MPH

      Affiliations

    • Center for Clinical Research and Evidence-Based Medicine, University of Texas Health Science Center at Houston, Houston, TX

Received 30 October 2008 ,Revised 7 January 2009 ,Accepted 14 January 2009.

References 

  1. Bratzler DW, Hunt DR. The surgical infection prevention and surgical care improvement projects: national initiatives to improve outcomes for patients having surgery. Clin Infect Dis. 2006;43:322–330
  2. Jones RS, Brown C, Opelka F. Surgeon compensation: “Pay for performance,” the American College of Surgeons National Surgical Quality Improvement Program, the Surgical Care Improvement Program, and other considerations. Surgery. 2005;138:829–836
  3. Rowell KS, Turrentine FE, Hutter MM, et al. Use of national surgical quality improvement program data as a catalyst for quality improvement. J Am Coll Surg. 2007;204:1293–1300
  4. Shojania KG, Grimshaw JM. Still no magic bullets: pursuing more rigorous research in quality improvement. Am J Med. 2004;116:778–780
  5. Spaeth RG, Pickering KC, Webb SM. Quality assurance and hospital structure: how the physician-hospital relationship affects quality measures. Ann Health Law. 2003;12:235–447
  6. Blumenthal D, Ferris TG. Safety in the academic medical center: transforming challenges into ingredients for improvement. Acad Med. 2006;81:817–822
  7. Shojania KG, Duncan BW, McDonald KM, Wachter RM. Safe but sound: patient safety meets evidence-based medicine. JAMA. 2002;288:508–513
  8. Farquhar C, Marjoribanks J, Basser R, et al. High dose chemotherapy and autologous bone marrow or stem cell transplantation versus conventional chemotherapy for women with metastatic breast cancer. Cochrane Database Syst Rev. 2005;(3):CD003142
  9. Wille-Jorgensen P, Guenaga KF, Matos D, Castro AA. Pre-operative mechanical bowel cleansing or not? (an updated meta-analysis). Colorectal Dis. 2005;7:304–310
  10. Beck CA, Richard H, Tu JV, Pilote L. Administrative Data Feedback for Effective Cardiac Treatment: AFFECT, a cluster randomized trial. JAMA. 2005;294:309–317
  11. Brown C, Hofer T, Johal A, et al. An epistemology of patient safety research: a framework for study design and interpretation (Part 2. Study design). Qual Saf Health Care. 2008;17:163–169
  12. Eccles M, Grimshaw J, Campbell M, Ramsay C. Research designs for studies evaluating the effectiveness of change and improvement strategies. Qual Safety Health Care. 2003;12:47–52
  13. Grimshaw J, Eccles M, Thomas R, et al. Toward evidence-based quality improvement (Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966−1998). J Gen Intern Med. 2006;21(Suppl 2):S14–S20
  14. Samsa G, Matchar D. Can continuous quality improvement be assessed using randomized trials? [see comment]. Health Serv Res. 2000;35:687–700
  15. Awad SS, Fagan SP, Bellows C, et al. Bridging the communication gap in the operating room with medical team training. Am J Surg. 2005;190:770–774
  16. Pronovost PJ, Berenholtz SM, Goeschel C, et al. Improving patient safety in intensive care units in Michigan. J Crit Care. 2008;23:207–221
  17. Kritchevsky SB, Braun BI, Bush AJ, et al. The effect of a quality improvement collaborative to improve antimicrobial prophylaxis in surgical patients: a randomized trial. Ann Intern Med. 2008;149:472–480W89−W93
  18. Lipsey MW, Wilson DB. The efficacy of psychological, educational, and behavioral treatment (Confirmation from meta-analysis). Am Psychol. 1993;48:1181–1209
  19. Peterson ED. Optimizing the science of quality improvement. JAMA. 2005;294:369–371
  20. Barnett AG, van der Pols JC, Dobson AJ. Regression to the mean: what it is and how to deal with it. Int J Epidemiol. 2005;34:215–220
  21. Adamina M, Guller U, Weber WP, Oertli D. Propensity scores and the surgeon. Br J Surg. 2006;93:389–394
  22. Rubin DB. Estimating causal effects from large data sets using propensity scores. Ann Intern Med. 1997;127(8 Pt 2):757–763
  23. Stamou SC, Camp SL, Stiegel RM, et al. Quality improvement program decreases mortality after cardiac surgery. J Thorac Cardiovasc Surg. 2008;136:494–499e8
  24. Cable G. Enhancing causal interpretations of quality improvement interventions. Qual Health Care. 2001;10:179–186
  25. Scalea TM, Bochicchio GV, Bochicchio KM, et al. Tight glycemic control in critically injured trauma patients. Ann Surg. 2007;246:605–610discussion 10−12
  26. Ramsay CR, Matowe L, Grilli R, et al. Interrupted time series designs in health technology assessment: lessons from two systematic reviews of behavior change strategies. Int J Technol Assess Health Care. 2003;19:613–623
  27. Cook T, Campbell D. Qausi-experimentation: design and analysis issues for field settings. Boston, MA: Houghton Mifflin Company; 1979;
  28. Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC Med Res Methodol. 2006;6:54
  29. Rhodes RS, Biester TW. Certification and maintenance of certification in surgery. Surg Clin North Am. 2007;87:825;The stepped wedge trial design: a systematic review 836, vi
  30. Birkmeyer JD, Shahian DM, Dimick JB, et al. Blueprint for a new American College of Surgeons: National Surgical Quality Improvement Program. J Am Coll Surg. 2008;207:777–782
  31. Davidoff F, Batalden P, Stevens D, et al. Publication guidelines for improvement studies in health care: evolution of the SQUIRE Project. Ann Intern Med. 2008;149:670–676
  32. Shojania KG, Grimshaw JM. Evidence-based quality improvement: the state of the science. Health Aff (Millwood). 2005;24:138–150
  33. Jha AK, Schneider EC. From motives to results: improving the effectiveness of quality improvement. Am J Med. 2004;117:359–361

 Disclosure Information: Nothing to disclose.

 Supported by the Robert Wood Johnson Physician Faculty Scholars Program.

PII: S1072-7515(09)00041-6

doi: 10.1016/j.jamcollsurg.2009.01.021

Journal of the American College of Surgeons
Volume 208, Issue 4 , Pages 621-626 , April 2009