Holly Janes, PhD; Margaret S. Pepe, PhD; Wen Gu, MS
Acknowledgment: The authors thank Patrick Bossuyt for very helpful discussions of the material.
Potential Financial Conflicts of Interest: None disclosed.
Requests for Single Reprints: Holly Janes, PhD, Fred Hutchinson Cancer Research Center; 1100 Fairview Avenue North M2-C200, Seattle, WA 98109; e-mail, firstname.lastname@example.org.
Current Author Addresses: Drs. Janes and Pepe: Fred Hutchinson Cancer Research Center, 1100 Fairview Avenue North, Seattle, WA 98109.
Dr. Gu: Department of Biostatistics, University of Washington, Box 357232, Seattle, WA 98195.
The recent epidemiologic and clinical literature is filled with studies evaluating statistical models for predicting disease or some other adverse event. Risk stratification tables are a new way to evaluate the benefit of adding a new risk marker to a risk prediction model that includes an established set of markers. This approach involves cross-tabulating risk predictions from models with and without the new marker. In this article, the authors use examples to show how risk stratification tables can be used to compare 3 important measures of model performance between the models with and those without the new marker: the extent to which the risks calculated from the models reflect the actual fraction of persons in the population with events (calibration); the proportions in which the population is stratified into clinically relevant risk categories (stratification capacity); and the extent to which participants with events are assigned to high-risk categories and those without events are assigned to low-risk categories (classification accuracy). They detail common misinterpretations and misuses of the risk stratification method and conclude that the information that can be extracted from risk stratification tables is an enormous improvement over commonly reported measures of risk prediction model performance (for example, c-statistics and HosmerLemeshow tests) because it describes the value of the models for guiding medical decisions.
Janes H, Pepe MS, Gu W. Assessing the Value of Risk Predictions by Using Risk Stratification Tables. Ann Intern Med. ;149:751–760. doi: 10.7326/0003-4819-149-10-200811180-00009
Download citation file:
Published: Ann Intern Med. 2008;149(10):751-760.
Breast Cancer, Cancer Screening/Prevention, Hematology/Oncology, Prevention/Screening.
Results provided by:
Copyright © 2018 American College of Physicians. All Rights Reserved.
Print ISSN: 0003-4819 | Online ISSN: 1539-3704
Conditions of Use