The full content of Annals is available to subscribers

Subscribe/Learn More  >
Academia and the Profession |

Comparing Hospital Mortality in Adult Patients with Pneumonia: A Case Study of Statistical Methods in a Managed Care Program

A. Russell Localio, JD, MPH, MS; Bruce H. Hamory, MD; Tonya J. Sharp, BA; Susan L. Weaver, MS; Thomas R. TenHave, PhD; and J. Richard Landis, PhD
[+] Article, Author, and Disclosure Information

From Pennsylvania State University, Hershey, Pennsylvania. Requests for Reprints: A. Russell Localio, Penn State University College of Medicine, P.O. Box 850, Hershey, PA 17033. Acknowledgments: The authors thank Allan C. Anderson, Vice President and Chief Operating Officer at Hershey Medical Center, for his support of this project.

Copyright ©2004 by the American College of Physicians

Ann Intern Med. 1995;122(2):125-132. doi:10.7326/0003-4819-122-2-199501150-00009
Text Size: A A A

Objective: To compare and contrast a managed care program's analysis of differences in hospital mortality with results obtained by accepted statistical methods.

Design: A re-analysis of computerized discharge data using the same method used by a managed care program, and using conventional methods of categorical data analysis. One thousand computer simulations of a method for comparing hospitals by severity-adjusted mortality were done to determine the probability of falsely identifying hospitals as high-mortality outliers.

Setting: 22 acute care hospitals in central Pennsylvania.

Patients: All adult patients with pneumonia (n = 4587; diagnosis-related groups 089-090) less than 65 years of age who were discharged from the 22 hospitals in 1989, 1990, and 1991, excluding patients with the acquired immunodeficiency syndrome and transplant recipients.

Measurements: In-hospital mortality adjusted for age and severity of illness using MedisGroups admission severity group score.

Results: The hospital that had the highest mortality for adult pneumonia according to the managed care program's analysis did not, according to an appropriate analysis, differ significantly from other area hospitals (likelihood ratio test, P = 0.23). Random variation in this sample of patients with a low average mortality rate (3.5%) showed a 60% chance that 1 or more of the 22 hospitals would be falsely identified as a “high-mortality outlier” when simplistic statistical methods were used.

Conclusion: Organizations seeking to compare the quality of hospitals and physicians through outcome data need to recognize that simplistic methods applicable to large samples fail when applied to the outcomes of typical patients, such as those admitted for pneumonia. Although these comparisons are much in demand, careful attention must be paid to their statistical methods to ensure validity and fairness.


Grahic Jump Location
Figure 1.
Adjusted hospital mortality.PPP

Ranking and statistical significance. Normalized differences (z) between observed and expected mortality for 22 central Pennsylvania hospitals using the managed care method and our reanalysis. z = ± 3.08 corresponds to a critical value of 0.002 (adjusted for multiple comparisons), and z = ± 1.96 corresponds to a critical value of 0.05 (no adjustment). Several hospitals' ranks change markedly with reanalysis. No hospital remains an “outlier” when a critical value of 0.002 (z = ± 3.08) is applied.

Grahic Jump Location




Citing articles are presented as examples only. In non-demo SCM6 implementation, integration with CrossRef’s "Cited By" API will populate this tab (http://www.crossref.org/citedby.html).


Submit a Comment/Letter
Submit a Comment/Letter

Summary for Patients

Clinical Slide Sets

Terms of Use

The In the Clinic® slide sets are owned and copyrighted by the American College of Physicians (ACP). All text, graphics, trademarks, and other intellectual property incorporated into the slide sets remain the sole and exclusive property of the ACP. The slide sets may be used only by the person who downloads or purchases them and only for the purpose of presenting them during not-for-profit educational activities. Users may incorporate the entire slide set or selected individual slides into their own teaching presentations but may not alter the content of the slides in any way or remove the ACP copyright notice. Users may make print copies for use as hand-outs for the audience the user is personally addressing but may not otherwise reproduce or distribute the slides by any means or media, including but not limited to sending them as e-mail attachments, posting them on Internet or Intranet sites, publishing them in meeting proceedings, or making them available for sale or distribution in any unauthorized form, without the express written permission of the ACP. Unauthorized use of the In the Clinic slide sets will constitute copyright infringement.


Buy Now for $32.00

to gain full access to the content and tools.

Want to Subscribe?

Learn more about subscription options

Related Articles
Related Point of Care
Topic Collections
Forgot your password?
Enter your username and email address. We'll send you a reminder to the email address on record.