Skip Navigation
American College of Physicians Logo
  • Subscribe
  • Submit a Manuscript
  • Sign In
    Sign in below to access your subscription for full content
    INDIVIDUAL SIGN IN
    Sign In|Set Up Account
    You will be directed to acponline.org to register and create your Annals account
    INSTITUTIONAL SIGN IN
    Open Athens|Shibboleth|Log In
    Annals of Internal Medicine
    SUBSCRIBE
    Subscribe to Annals of Internal Medicine.
    You will be directed to acponline.org to complete your purchase.
Annals of Internal Medicine Logo Menu
  • Latest
  • Issues
  • Channels
  • CME/MOC
  • In the Clinic
  • Journal Club
  • Web Exclusives
  • Author Info
Advanced Search
  • ‹ PREV ARTICLE
  • This Issue
  • NEXT ARTICLE ›
Reviews |4 July 2006

Narrative Review: Assessment of C-Reactive Protein in Risk Prediction for Cardiovascular Disease Free

Donald M. Lloyd-Jones, MD, ScM; Kiang Liu, PhD; Lu Tian, ScD; Philip Greenland, MD

Donald M. Lloyd-Jones, MD, ScM
From Feinberg School of Medicine, Northwestern University, Chicago, Illinois.

Kiang Liu, PhD
From Feinberg School of Medicine, Northwestern University, Chicago, Illinois.

Lu Tian, ScD
From Feinberg School of Medicine, Northwestern University, Chicago, Illinois.

Philip Greenland, MD
From Feinberg School of Medicine, Northwestern University, Chicago, Illinois.

Article, Author, and Disclosure Information
Author, Article, and Disclosure Information
  • From Feinberg School of Medicine, Northwestern University, Chicago, Illinois.

    Potential Financial Conflicts of Interest: None disclosed.

    Requests for Single Reprints: Donald M. Lloyd-Jones, MD, ScM, Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University, 680 North Lake Shore Drive, Suite 1102, Chicago, IL 60611; e-mail, dlj@northwestern.edu.

    Current Author Addresses: Drs. Lloyd-Jones, Liu, Tian, and Greenland: Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University, 680 North Lake Shore Drive, Suite 1102, Chicago, IL 60611.

×
  • ‹ PREV ARTICLE
  • This Issue
  • NEXT ARTICLE ›
Jump To
  • Full Article
  • FULL ARTICLE
  • FULL ARTICLE
    • Abstract
    • Differences between Association and Predictive Utility
    • Utility of CRP in CVD Risk Prediction
    • Conclusions
    • Glossary
      1. References
  • Figures
  • Tables
  • Supplements
  • Audio/Video
  • Summary for Patients
  • Clinical Slide Sets
  • CME / MOC
  • Comments
  • Twitter Link
  • Facebook Link
  • Email Link
More
  • LinkedIn Link

Abstract

Some experts propose C-reactive protein (CRP) as a screening tool for prediction of cardiovascular disease (CVD). Many epidemiologic studies show positive associations between elevated CRP levels and incident CVD. Assessment of the value of new prognostic tests, however, must rely on understanding of test characteristics rather than on associations measured by relative risks. In the case of CRP, test characteristics must be judged in the context of currently available CVD risk prediction algorithms. In this review of literature published before January 2006, the authors describe what is known about the additional utility of CRP in risk prediction. They find no definitive evidence that, for most individuals, CRP adds substantial predictive value above that provided by risk estimation using traditional risk factors for CVD. Use of CRP may add to risk estimation in a limited subset of individuals who are at intermediate predicted risk according to the Framingham risk score. The authors propose that many questions still must be addressed before CRP is incorporated into risk prediction algorithms and before universal screening with CRP can be recommended.

Key Summary Points

Novel risk markers for cardiovascular disease (CVD) are often said to add independent predictive value for risk prediction, based on the finding of a significant relative risk after adjustment for traditional risk factors.
However, the utility of novel risk markers for screening and risk prediction should be judged not by relative risks but by test characteristics such as sensitivity, specificity, predictive values, likelihood ratios, model calibration, c-statistics, and areas under receiver-operating characteristic curves.
Inflammation has emerged as a key mediator of atherogenesis and triggering of CVD events.
C-reactive protein (CRP) is a nonspecific marker of inflammation that, in healthy individuals, has been shown to be associated with future incidence of CVD.
Few studies have reported test characteristics for CRP, particularly in the context of traditional risk prediction algorithms such as the Framingham risk score.
In the overall adult population, CRP appears to add little to risk prediction that uses the Framingham risk score. Likewise, among subgroups of individuals predicted to be at high (>20%) or low (<10%) risk by Framingham, CRP levels contribute little further risk discrimination. Among those predicted to be at intermediate 10-year risk (10% to 20%) by Framingham, CRP levels greater than 3.0 mg/L may indicate high risk and need for more intensive preventive therapy.
Many questions remain before CRP can be accepted as a standard CVD risk factor, incorporated into risk prediction algorithms, or used for universal screening.
Future studies of CRP and other novel CVD risk markers should focus on test characteristics, not just relative risks, in order to better define their utility for risk prediction when added to traditional CVD risk factors.
Hundreds of putative risk factors have been associated with cardiovascular disease (CVD) (1). With remarkable frequency, investigators continue to propose additional behavioral, biochemical, environmental, and genetic risk markers. Recent extensive evidence supports inflammation as a key pathogenetic mechanism in the development and progression of atherosclerosis and in triggering clinical atherothrombotic CVD events. C-reactive protein (CRP) is one possible marker of vascular inflammation, and some investigators hypothesize that CRP plays a direct role in promoting vascular inflammation, vessel damage, and clinical CVD events (2-4), although this remains controversial.
Concomitantly, some experts recommend routine measurement of CRP using high-sensitivity assays as a major new population screening test for prediction of CVD risk (5, 6). Scientific (7-9) and lay (10-13) media have enthusiastically embraced, advocated, and promoted CRP for risk prediction. We believe that this enthusiasm is premature. Instead, we recommend thorough consideration of what is known about CRP's test characteristics and the effectiveness, costs, and benefits of its measurement. The literature examining CRP levels and incident cardiovascular disease among healthy individuals focuses mainly on associations between CRP and CVD, without adequately considering CRP's test characteristics and its additional utility over and above that provided by traditional risk factor measurement. In this critical review of literature published before January 2006, we use a framework for evaluating diagnostic tests in risk prediction to show what is and is not known about the role for CRP in cardiovascular risk prediction.

Differences between Association and Predictive Utility

Countless studies report “strong, independent” associations between novel risk markers and CVD. Typically, these studies find unadjusted odds ratios for disease in the range of 2.0 to 3.0, and occasionally a bit higher, for individuals with the highest compared with the lowest levels of the factor. After adjustment for age, sex, and other established CVD risk factors, the relative risks (which may be reported as rate ratios, odds ratios, or hazards ratios, depending on the study design) for the association are typically attenuated to within the range of 1.5 to 2.0. Such findings indicate that an “independent” association exists between the marker and disease, provided one assumes that the multivariable model adjusted for all important confounding. However, whether such an association indicates clinical utility for measuring the factor is an entirely different issue.
Decisions about the predictive utility of new tests should not focus on associations and relative risks. The consequences of decision making based solely on significant associations would include screening for and treating hundreds of risk markers and risk factors. Rather, we should base decisions about the additional utility of a new test for risk prediction on the test's performance (that is, sensitivity, specificity, predictive values, and clinical likelihood ratios) in the context of existing predictors. Useful ways to examine potential additional utility in the context of existing predictors include examination of the calibration of models with the new risk factor and comparisons of the areas under receiver-operating characteristic curves (AUCs) or c-statistics for risk scores calculated without and with the novel risk marker. (See the Glossary for definitions of these and other terms relevant to test utility and prediction.) All these test characteristics must be carefully considered before it can be determined whether a novel risk marker truly adds prognostic value above that provided by existing risk prediction, whether it helps to identify and reclassify risk status appropriately, and whether it has utility across the population or only in specified subgroups. Ultimately, these characteristics will determine whether a novel prognostic screening test is useful in informing clinical decision making regarding treatment.
The AUC and the c-statistic are equivalent functions of the sensitivity and specificity of a test across the spectrum of all possible cut-points defining a positive and a negative test result. They represent the ability of a test to discriminate cases from noncases. For the purposes of this review, we refer to c-statistics, although most investigators to date have published their findings as AUCs. Although reliance on the c-statistic alone as a measure of test performance has limitations (14), one can think of the c-statistic as the probability that a randomly selected person from the affected population will have a higher test score or value than a randomly selected person from the unaffected population. The c-statistic ranges from 0.50 (no discrimination beyond random chance) to 1.0 (perfect discrimination). C-statistics between 0.70 and 0.80 are considered acceptable, and those between 0.80 and 0.90 are considered excellent (15).
As recently demonstrated by Pepe and colleagues (16), extremely large odds ratios are required for clinically meaningful increases in these test characteristics. For example, for a binary risk marker considered in isolation, a univariate odds ratio of 9.0 or greater would be required for excellent discrimination of cases from noncases. When the marker is considered in the context of preexisting risk factors or a risk score, multivariable (“independent”) odds ratios in excess of 3.0 for the marker would typically be required to increase the c-statistic (and hence improve discrimination of cases from noncases) by an additional 5% or more (16). Thus, only unusually strong, independent risk factors can markedly improve risk discrimination in the population as a whole; most new risk factors do not achieve this level of added risk above standard risk factors. It is true that 2 prediction strategies may yield the same c-statistic but have different utility. A given strategy may have a higher sensitivity at a given specificity, or vice versa. Thus, examination of the 2 receiver-operating characteristic curves and consideration of where the maximal clinical benefit lies are useful to determine the overall utility of a test in the population and for subgroups.
The observation that single risk factors predict CVD risk poorly can be explained by the fact that CVD is a complex disease with multiple antecedents. Accordingly, investigators developed multivariable risk prediction algorithms to predict the absolute and relative risks for occurrence of CVD and coronary heart disease (CHD) events over the next decade (17-20). The Framingham risk score (20, 21)), which uses age, sex, total and high-density lipoprotein cholesterol levels, blood pressure, smoking, and diabetes as variables to predict risk, is widely recommended. When a model containing these traditional risk factors was applied to several diverse epidemiologic cohorts, the AUC ranged from 0.66 to 0.83 in men and from 0.72 to 0.88 in women (17). Thus, despite some contrary claims (22-24), traditional risk factors, when considered in combination, provide valuable approximations of CVD risk that are superior to approximations based on single risk factors (17,25). Given the improvement in risk discrimination provided by multivariable models, these multivariable risk estimates are the logical standard to which new risk factors must be added and compared.
The National Cholesterol Education Program's Third Adult Treatment Panel (21) used a modified form of the Framingham risk score as its risk prediction tool. The panel suggested thresholds of 10-year risk on which treatment decisions regarding lipid-lowering therapy should be based, in order to match the intensity of therapy to the magnitude of absolute risk. In the panel's scheme, individuals with a predicted 10-year risk for CHD less than 10% are considered to be at low risk, those with a risk of 10% to 20% are considered to be at intermediate risk, and those with a risk greater than 20% (or with existing CHD or CHD risk equivalents) are considered to be at high risk. The focus is on identifying individuals at highest risk in order to initiate drug therapy. At present, an estimated 66% of U.S. adults are at low risk, 21% are at intermediate risk, and 13% are at high risk (26).

Utility of CRP in CVD Risk Prediction

Having established some of the issues related to the utility of a novel marker in risk prediction, we now consider the specific case of CRP. We searched for relevant English-language literature archived in MEDLINE from 1966 through December 2005 using the terms C-reactive protein or CRP in combination with coronary or cardiovascular. We also combined the preceding terms with the terms sensitivity, specificity, likelihood ratio, c-statistic, receiver operating characteristic, or ROC and supplemented the 2 MEDLINE searches by examining bibliographies from key articles and systematic reviews. We selected population-based studies, including cohort, case–cohort, case–control, and nested case–control studies, which examined the prospective risk for incident CHD or CVD on the basis of CRP measurements. We excluded studies examining the role of CRP for risk stratification after onset of cardiovascular events or in the setting of acute coronary events.

Question 1: Is CRP Associated with CVD?

Several large prospective cohort studies show that higher levels of CRP are associated with increased risk for CVD. These studies typically reported age-adjusted relative risks for CVD in the range of 2.0 to 3.0 for the highest compared with the lowest strata of CRP. Danesh and colleagues (27) recently reported a meta-analysis of 22 prospective studies published between 1996 and 2003 that examined CRP as a predictor for CVD events. Participants in these studies had a mean age at entry of 57 years and were followed for a mean of 12 years; 7068 participants developed CHD. All the studies used high-sensitivity CRP assays, and almost all adjusted for smoking and at least some other CHD risk factors. For the highest compared with the lowest tertile of CRP, the combined multivariable-adjusted odds ratio for coronary heart disease was 1.58 (95% CI, 1.48 to 1.68). Studies published since this meta-analysis continue to show similar adjusted relative risks for CRP (28-32). For example, in the Women's Health Study, women in the top 10% compared with the bottom 10% of CRP levels had multivariable-adjusted relative risks of only 2.1 (28). Thus, CRP is consistently, although weakly, associated with CHD after adjustment for established risk factors.

Question 2: What Magnitude of Multivariable Relative Risk Would Substantially Improve the C-Statistic with Addition of CRP to Traditional Risk Factors?

To answer this question, we expanded an analysis approach suggested by Pepe and colleagues (16) to examine the change in c-statistic associated with the addition of a new variable to an existing risk score. Assuming that the correlation coefficient between CRP and the Framingham risk score is 0.3 (33), a multivariable-adjusted odds ratio of 3.4 for the highest versus the lowest quartile of CRP levels would be required to increase the c-statistic from 0.80 to 0.85, a moderate improvement. A more marked improvement in AUC from 0.80 to 0.90 would require a multivariable-adjusted odds ratio of 6.9. C-reactive protein and almost all other novel risk factors that have been described in the clinical literature in the past decade do not approach these levels of multivariable relative risk.
These data indicate that any new or “novel” risk factor will need to be very strongly associated with CVD and very poorly correlated with the traditional risk factors in the Framingham risk score if it is to provide substantial improvement in risk discrimination. However, much of the univariate association between CRP and CVD can be explained through the correlation of CRP with other risk factors, including age, smoking, obesity, diabetes, alcohol intake, hormone replacement therapy use, fibrinogen, and other thrombotic and inflammatory markers (34, 35). Studies show significant correlations of CRP with burden of established risk factors (34, 35) and with the metabolic syndrome (36), and CRP level also correlates significantly with the Framingham risk score (33). A recent study using the National Health and Nutrition Examination Survey III sample found that the risk for elevated CRP level attributable to the presence of any elevated or borderline traditional CVD risk factors was 78% in men and 67% in women (37). These data suggest that an elevated CRP level is in large measure attributable to traditional CVD risk factors, providing insight into its limited additional clinical utility in multivariable risk models.

Question 3: Does CRP Add to Existing Algorithms for Risk Prediction?

Most studies of CRP and risk prediction have reported only relative risk findings. As of January 2006, only 1 study had published sensitivity and specificity values, 7 studies had published data on changes in c-statistics, and none had published likelihood ratios to indicate the utility of CRP when added to established risk factors or risk prediction algorithms. Thus, we urge publication of findings on other test characteristics of CRP added to traditional risk factors in future studies.
The Table shows comparisons of c-statistics with and without CRP included in the multivariable model, from studies that have reported these data (27, 29, 31, 36, 38-40). None of these studies showed substantial improvements in risk discrimination when CRP was considered in the context of the full range of traditional risk factors for CVD. The largest improvement in c-statistic with addition of CRP to the Framingham risk score was observed in a cohort of 3435 men from southern Germany, age 45 to 74 years (40). In that study, the c-statistic increased only 1.5% when CRP was added to the Framingham risk score, from 0.735 to 0.750. In the Women's Health Study (a prospective study of 27939 healthy women, of whom only approximately 2% had CVD events over 8 years), CRP alone yielded a c-statistic of 0.64 for prediction of CVD (38). This level of c-statistic is similar to that seen for most risk factors when considered alone. When CRP was included in a multivariable model that did not include low-density lipoprotein cholesterol for predicting 8-year risk for CVD, the c-statistic of 0.81 indicated a relatively high degree of discrimination for risk estimation. However, when low-density lipoprotein cholesterol was substituted for CRP in the multivariable model, the c-statistic also was 0.81 (38). In the Rotterdam Study, involving 7983 healthy men and women, 157 participants had incident myocardial infarctions during follow-up. These 157 participants were compared with 500 randomly selected controls in a nested case–control study. When CRP was added to the Framingham risk function, using the upper 20% of the CRP distribution as the cutoff for a positive test result, sensitivity of prediction increased modestly from 31.2% to 39.5% and specificity increased from 84.4% to 87.0%. However, as shown in the Table, addition of CRP did not significantly improve the c-statistics of the Framingham risk function alone in this study (39) or most others (27, 29, 31, 36).

Table. Comparison of Areas under Receiver-Operating Characteristic Curve for Models with Traditional Cardiovascular Disease Risk Factors alone or with the Addition of C-Reactive Protein to the Model

Table. Comparison of Areas under Receiver-Operating Characteristic Curve for Models with Traditional Cardiovascular Disease Risk Factors alone or with the Addition of C-Reactive Protein to the Model

Question 4: Does a Low CRP Level Markedly Reduce Risk for People Who Are Predicted To Be at High Risk according to Established CVD Risk Factors?

The preceding questions have examined CRP as a tool for risk prediction from the perspective of the entire population. It is possible that CRP might add more predictive value by further stratifying or reclassifying risk among certain subgroups. To address this question, some studies have stratified participants on their risk predicted by the Framingham equations and examined whether CRP levels substantially change the magnitude of risk within these strata. This approach reduces the inherent predictive value of the continuous Framingham risk score by turning it into a categorical variable, but it may help to determine whether CRP adds value in some subgroups.
For example, in the Women's Health Study (38), the investigators stratified participants into 4 levels of absolute predicted CVD risk over the ensuing 10 years, using the Framingham coronary risk score. Women were also stratified into groups based on CRP levels: low (<1.0 mg/L), intermediate (1.0 to 3.0 mg/L), and high (>3.0 mg/L). As shown in the Figure, the greatest contribution in stratifying risk came from the traditional risk factors in the Framingham equation (with risks varying more than 20-fold), regardless of CRP level. Women in the highest stratum of absolute Framingham-predicted CVD risk (≥10%) and who had intermediate or high CRP levels were at substantially greater risk than the rest of the cohort. Women with high predicted risk but low levels of CRP did have somewhat lower risk than those with intermediate and high levels of CRP (Figure). However, risk among these women with high levels of traditional risk factors but low CRP levels was still greater than 10 times higher than that of the referent group (38), a finding observed in other studies in men (40). Thus, CRP slightly modulated the predicted risk, but not to the extent of changing the management of the patient. In other words, addition of CRP did not cause reclassification of high-risk women into the low-risk category, where the recommendations for lipid-lowering therapy would definitely change (21). Furthermore, no data exist to indicate that the substantial risk factor burden present in the highest-risk women should go untreated merely because of a low CRP level.
Figure.

Multivariable relative risk for cardiovascular disease (CVD), based on level of C-reactive protein (CRP) and level of absolute predicted 10-year Framingham coronary heart disease risk in the Women's Health Study.

Question 5: Does a High CRP Level Markedly Increase Risk for People Who Are Predicted To Be at Low Risk according to Established CVD Risk Factors?

Several studies have observed that, among individuals predicted to be at low risk according to traditional risk factors, high CRP levels do not indicate substantially higher CVD event rates (38-40). For example, in the Women's Health Study, among women in the 2 lowest strata of Framingham-predicted 10-year risk (0% to 4%), high levels of CRP did not substantially increase the risk for CVD (Figure) (38). Thus, high CRP levels accompanied by low levels of traditional CVD risk factors do not identify individuals at high risk; thus, treatment recommendations would not change despite knowledge of the CRP level. The answers to questions 4 and 5 indicate that, for individuals at low or high predicted cardiovascular risk on the basis of traditional risk factors, CRP does not change the overall magnitude of observed risk, and it has little or no value for deciding which patients merit preventive treatments.

Question 6: Does CRP Modulate Risk Prediction for People Predicted To Be at Intermediate Risk?

Available data indicate that CRP, like other novel risk markers (41)), may add to risk discrimination in the subset of individuals at intermediate predicted risk for CHD by Framingham risk score. For example, men in the MONICA (MONItoring of trends and determinants in CArdiovascular disease) Augsburg cohort study (40) with predicted risk in the intermediate range of 15% to 19% and with elevated CRP levels had observed 10-year event rates greater than those in some men predicted to be at high risk in the absence of CRP data. These results suggest that such individuals should receive intensive primary prevention therapy, as if they are in reality at “high risk.” Current clinical practice guidelines already suggest the option of treatment for patients at this level of predicted risk, in the absence of CRP measurement, but it is also true that some patients and physicians would prefer to have the additional assurance that high risk is present before committing to long-term drug therapies (21).

Question 7: Can One Use Uniform Criteria for CRP To Predict Risk in Different Population Subgroups?

Data from several studies suggest that current clinical cut-points recommended for high-sensitivity CRP assays cannot be applied universally. Median CRP levels vary widely, with African-American and Hispanic persons having median CRP levels 2 to 3 times those in Chinese persons (42-44). Median levels of CRP for Chinese persons are 1.0 mg/L or less (that is, more than half of these patients have CRP levels in the low-risk range), whereas the median levels of CRP for African-American persons are 3.0 mg/L or greater (more than half have high-risk CRP levels) (42-44).
The potential for substantial misclassification of risk by CRP exists if uniform cut-points are used across all ethnicities. For example, in 1 multiethnic cohort study (43), 65.7% of middle-aged Chinese individuals had CRP levels of 1.0 mg/L or less and only 6.3% had CRP levels greater than 3.0 mg/L, compared with 42.7% and 25.0%, respectively, among white persons. These differences were observed even though the Chinese participants had higher levels of triglycerides, hemoglobin A1c, insulin, plasminogen activator inhibitor-1, and systolic blood pressure. In the same multiethnic study, 51.6% of participants with Framingham-predicted risk less than 10% nonetheless had CRP levels in the intermediate or high range (revealing substantial misclassification by CRP), and most such individuals were of South Asian or aboriginal extraction. Conversely, 15.9% of participants with predicted risk greater than 20% had low CRP levels (43). Therefore, use of uniform CRP cut-points to define CVD risk is probably not appropriate across diverse populations. Somewhat similar criticisms may be leveled at other continuous risk factors, such as cholesterol and blood pressure. However, therapies aimed at directly reducing those risk factors have proven benefit in reducing CVD events regardless of subgroup.

Question 8: Does Decreasing CRP Level Itself Reduce Events?

Measurement of novel risk markers can be clinically useful if data from prospective controlled trials demonstrate that targeting individuals with elevated levels and specifically lowering the factor in question reduce events. We currently lack data testing the primary hypothesis that institution of therapies, such as statins or aspirin, solely on the basis of CRP levels will decrease future CVD events. It also remains unclear whether reductions in CRP levels and CVD events observed with statin medications are due (directly and indirectly) to changes in lipids alone or to direct effects of statins on inflammation and CRP levels. Primary data do not exist to document that lowering of CRP level itself reduces event rates. Although widely publicized as showing that CRP reduction improves outcomes over and above the improvement provided by reduction of low-density lipoprotein cholesterol levels in secondary prevention of CHD, recent data from an analysis of the PROVE-IT (PRavastatin Or atorVastatin Evaluation and Infection Therapy) trial (45) add no new information to this debate. Unfortunately, the authors did not report baseline CRP levels or change in CRP levels between initiation of statin therapy and initial measurement of CRP 30 days later. They also did not report on or adjust for important potential confounders (46-48). Other data examining CRP levels in cholesterol-lowering primary prevention trials have not yet demonstrated that independent lowering of CRP levels itself reduces events (49).

Conclusions

Inflammation is a major mechanism in the process of atherogenesis and in triggering of clinical CVD events. Some experts propose that CRP, a nonspecific marker of inflammation, is a new tool that improves CVD risk estimation and that it should be used as a routine clinical risk assessment test (6). However, as with almost all novel risk factors that have been described for cardiovascular risk, CRP, when examined critically, does not improve risk discrimination enough to recommend its routine adoption for population screening.
In 2003, the Centers for Disease Control and Prevention and the American Heart Association published a scientific statement on the applications of screening with markers of inflammation (5). The panel made the following class IIa recommendation: “Measurement of hs[high-sensitivity]-CRP … in those judged at intermediate risk by global risk assessment (10 to 20% risk for CHD per 10 years), at the discretion of the physician, may help direct further evaluation and therapy in the primary prevention of CVD. The benefits of such therapy based on this strategy remain uncertain.” The panel also concluded that “the entire adult population should not be screened for hs-CRP for purposes of cardiovascular risk assessment.”
Three years later, we agree with the panel's recommendation. Specific individuals may benefit from knowledge of their CRP level, but many questions still must be answered before we accept it as a standard CVD risk factor, incorporate it into risk prediction algorithms, and use it for universal screening. Until we understand whether and how we should incorporate CRP into clinical practice, it should remain, at most, a “tiebreaker” test, measured selectively in individuals at intermediate risk for CVD when the merits of beginning drug therapy for other risk factors are unclear. Future evaluations of CRP should focus not on measurement of associations but on test characteristics such as likelihood ratios and the additional utility of CRP over and above traditional risk factor measurement.

Glossary

Area under the receiver-operating characteristic curve (AUC): Summary statistic of the power of a diagnostic test for discriminating between persons with and without disease. It indicates the probability, across the entire spectrum of cutoff values for the test, that a given individual with disease (or who develops disease) will have a higher value on the test than an individual who does not have (or will not develop) disease. A perfect test has an AUC of 1.0; a test that is no better than chance has an AUC of 0.5.
C-statistic: The probability that a given individual with disease (or who will develop disease) has a higher score from a model designed to predict disease than an individual without disease (or who will not develop disease). This is equivalent to the AUC.
Likelihood ratios: The positive likelihood ratio is the ratio of the true-positive rate to the false-positive rate for a test. The positive likelihood ratio also represents the slope of the receiver-operating characteristic curve at a given sensitivity and specificity. The negative likelihood ratio is the ratio of the false-negative rate to the true-negative rate for a test. These likelihood ratios indicate the magnitude by which the prior odds of disease are changed by a positive or negative test result.
Model calibration: The degree to which a model provides accurate estimates of risk in the sample from which it is derived and in subsequent test samples.
Predictive values: The positive predictive value is the probability that disease is (or will be) present given a positive test result. The negative predictive value is the probability that disease is (or will be) absent given a negative test result.
Receiver-operating characteristic (ROC) curve: A graphical representation of test characteristics, with sensitivity on one axis and 1 − specificity on the other axis, for a diagnostic or prognostic test over all possible cut-points for defining a positive and a negative test result.
Sensitivity: The probability that a test result is positive given that disease is (or will be) present; also known as the true-positive rate.
Specificity: The probability that a test result is negative given that disease is (or will be) absent; also known as the true-negative rate.

References

  1. Hopkins
    PN
    ,  
    Williams
    RR
    .  
    A survey of 246 suggested coronary risk factors.
    Atherosclerosis
    1981
    40
    1
    52
     PubMed
    CrossRef
     PubMed
  2. Lagrand
    WK
    ,  
    Visser
    CA
    ,  
    Hermens
    WT
    ,  
    Niessen
    HW
    ,  
    Verheugt
    FW
    ,  
    Wolbink
    GJ
    ,  
    et al
    C-reactive protein as a cardiovascular risk factor: more than an epiphenomenon?
    Circulation
    1999
    100
    96
    102
     PubMed
    CrossRef
     PubMed
  3. Pasceri
    V
    ,  
    Willerson
    JT
    ,  
    Yeh
    ET
    .  
    Direct proinflammatory effect of C-reactive protein on human endothelial cells.
    Circulation
    2000
    102
    2165
    8
     PubMed
    CrossRef
     PubMed
  4. Torzewski
    M
    ,  
    Rist
    C
    ,  
    Mortensen
    RF
    ,  
    Zwaka
    TP
    ,  
    Bienek
    M
    ,  
    Waltenberger
    J
    ,  
    et al
    C-reactive protein in the arterial intima: role of C-reactive protein receptor-dependent monocyte recruitment in atherogenesis.
    Arterioscler Thromb Vasc Biol
    2000
    20
    2094
    9
     PubMed
    CrossRef
     PubMed
  5. Pearson
    TA
    ,  
    Mensah
    GA
    ,  
    Alexander
    RW
    ,  
    Anderson
    JL
    ,  
    Cannon
    RO
    3rd
    ,  
    Criqui
    M
    ,  
    et al
    Markers of inflammation and cardiovascular disease: application to clinical and public health practice: a statement for healthcare professionals from the Centers for Disease Control and Prevention and the American Heart Association.
    Circulation
    2003
    107
    499
    511
     PubMed
    CrossRef
     PubMed
  6. Ridker
    PM
    ,  
    Wilson
    PW
    ,  
    Grundy
    SM
    .  
    Should C-reactive protein be added to metabolic syndrome and to assessment of global cardiovascular risk?
    Circulation
    2004
    109
    2818
    25
     PubMed
    CrossRef
     PubMed
  7. Patel
    VB
    ,  
    Robbins
    MA
    ,  
    Topol
    EJ
    .  
    C-reactive protein: a ‘golden marker’ for inflammation and coronary artery disease.
    Cleve Clin J Med
    2001
    68
    521
    4, 527-34
     PubMed
    CrossRef
     PubMed
  8. Ridker
    PM
    .  
    Clinical application of C-reactive protein for cardiovascular disease detection and prevention.
    Circulation
    2003
    107
    363
    9
     PubMed
    CrossRef
     PubMed
  9. Yeh
    ET
    ,  
    Willerson
    JT
    .  
    Coming of age of C-reactive protein: using inflammation markers in cardiology.
    Circulation
    2003
    107
    370
    1
     PubMed
    CrossRef
     PubMed
  10. Predicting heart attacks [Editorial]. The New York Times. 17 November 2002:A10.
  11. The new heart disease threat [Editorial]. The New York Times. 11 January 2005:A18.
  12. Foreman J. CRP test: what's not to like? The Boston Globe. 19 November 2002:C1.
  13. Lemonick MD. Should you be tested? Time. 17 January 2005:34.
  14. Hilden
    J
    .  
    The area under the ROC curve and its competitors.
    Med Decis Making
    1991
    11
    95
    101
     PubMed
    CrossRef
     PubMed
  15. Hosmer
    DW
    ,  
    Lemeshow
    S
    .  
    Applied Logistic Regression. 2nd ed.
    New York
    J Wiley
    2000
  16. Pepe
    MS
    ,  
    Janes
    H
    ,  
    Longton
    G
    ,  
    Leisenring
    W
    ,  
    Newcomb
    P
    .  
    Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker.
    Am J Epidemiol
    2004
    159
    882
    90
     PubMed
    CrossRef
     PubMed
  17. Prediction of mortality from coronary heart disease among diverse populations: is there a common predictive function?
    Heart
    2002
    88
    222
    8
     PubMed
    CrossRef
     PubMed
  18. Conroy
    RM
    ,  
    Pyorala
    K
    ,  
    Fitzgerald
    AP
    ,  
    Sans
    S
    ,  
    Menotti
    A
    ,  
    DeBacker
    G
    ,  
    et al
    Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project.
    Eur Heart J
    2003
    24
    987
    1003
     PubMed
    CrossRef
     PubMed
  19. Assmann
    G
    ,  
    Cullen
    P
    ,  
    Schulte
    H
    .  
    Simple scoring scheme for calculating the risk of acute coronary events based on the 10-year follow-up of the prospective cardiovascular Munster (PROCAM) study.
    Circulation
    2002
    105
    310
    5
     PubMed
    CrossRef
     PubMed
  20. Wilson
    PW
    ,  
    D'Agostino
    RB
    ,  
    Levy
    D
    ,  
    Belanger
    AM
    ,  
    Silbershatz
    H
    ,  
    Kannel
    WB
    .  
    Prediction of coronary heart disease using risk factor categories.
    Circulation
    1998
    97
    1837
    47
     PubMed
    CrossRef
     PubMed
  21. Third Report of the National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III) final report.
    Circulation
    2002
    106
    3143
    421
     PubMed
     PubMed
  22. Futterman
    LG
    ,  
    Lemberg
    L
    .  
    Fifty percent of patients with coronary artery disease do not have any of the conventional risk factors.
    Am J Crit Care
    1998
    7
    240
    4
     PubMed
     PubMed
  23. Lefkowitz
    RJ
    ,  
    Willerson
    JT
    .  
    Prospects for cardiovascular research.
    JAMA
    2001
    285
    581
    7
     PubMed
    CrossRef
     PubMed
  24. Nieto
    FJ
    .  
    Cardiovascular disease and risk factor epidemiology: a look back at the epidemic of the 20th century [Editorial].
    Am J Public Health
    1999
    89
    292
    4
     PubMed
    CrossRef
     PubMed
  25. Magnus
    P
    ,  
    Beaglehole
    R
    .  
    The real contribution of the major risk factors to the coronary epidemics: time to end the “only-50%” myth.
    Arch Intern Med
    2001
    161
    2657
    60
     PubMed
    CrossRef
     PubMed
  26. Klingman
    D
    ,  
    Williams
    SA
    ,  
    Benner
    JS
    ,  
    Smith
    TW
    ,  
    Ahn
    J
    ,  
    O'Donnell
    JC
    .  
    Gauging the treatment gap in dyslipidemia: findings from the 1999-2000 National Health and Nutrition Examination Survey.
    Am Heart J
    2005
    150
    595
    601
     PubMed
    CrossRef
     PubMed
  27. Danesh
    J
    ,  
    Wheeler
    JG
    ,  
    Hirschfield
    GM
    ,  
    Eda
    S
    ,  
    Eiriksdottir
    G
    ,  
    Rumley
    A
    ,  
    et al
    C-reactive protein and other circulating markers of inflammation in the prediction of coronary heart disease.
    N Engl J Med
    2004
    350
    1387
    97
     PubMed
    CrossRef
     PubMed
  28. Ridker
    PM
    ,  
    Rifai
    N
    ,  
    Cook
    NR
    ,  
    Bradwin
    G
    ,  
    Buring
    JE
    .  
    Non-HDL cholesterol, apolipoproteins A-I and B100, standard lipid measures, lipid ratios, and CRP as risk factors for cardiovascular disease in women.
    JAMA
    2005
    294
    326
    33
     PubMed
    CrossRef
     PubMed
  29. Shlipak
    MG
    ,  
    Fried
    LF
    ,  
    Cushman
    M
    ,  
    Manolio
    TA
    ,  
    Peterson
    D
    ,  
    Stehman-Breen
    C
    ,  
    et al
    Cardiovascular mortality risk in chronic kidney disease: comparison of traditional and novel risk factors.
    JAMA
    2005
    293
    1737
    45
     PubMed
    CrossRef
     PubMed
  30. Pai
    JK
    ,  
    Pischon
    T
    ,  
    Ma
    J
    ,  
    Manson
    JE
    ,  
    Hankinson
    SE
    ,  
    Joshipura
    K
    ,  
    et al
    Inflammatory markers and the risk of coronary heart disease in men and women.
    N Engl J Med
    2004
    351
    2599
    610
     PubMed
    CrossRef
     PubMed
  31. Wilson
    PW
    ,  
    Nam
    BH
    ,  
    Pencina
    M
    ,  
    D'Agostino
    RB
    Sr
    ,  
    Benjamin
    EJ
    ,  
    O'Donnell
    CJ
    .  
    C-reactive protein and risk of cardiovascular disease in men and women from the Framingham Heart Study.
    Arch Intern Med
    2005
    165
    2473
    8
     PubMed
    CrossRef
     PubMed
  32. Ridker
    PM
    ,  
    Cook
    N
    .  
    Clinical usefulness of very high and very low levels of C-reactive protein across the full range of Framingham Risk Scores.
    Circulation
    2004
    109
    1955
    9
     PubMed
    CrossRef
     PubMed
  33. Albert
    MA
    ,  
    Glynn
    RJ
    ,  
    Ridker
    PM
    .  
    Plasma concentration of C-reactive protein and the calculated Framingham Coronary Heart Disease Risk Score.
    Circulation
    2003
    108
    161
    5
     PubMed
    CrossRef
     PubMed
  34. Bermudez
    EA
    ,  
    Rifai
    N
    ,  
    Buring
    J
    ,  
    Manson
    JE
    ,  
    Ridker
    PM
    .  
    Interrelationships among circulating interleukin-6, C-reactive protein, and traditional cardiovascular risk factors in women.
    Arterioscler Thromb Vasc Biol
    2002
    22
    1668
    73
     PubMed
    CrossRef
     PubMed
  35. Ray
    KK
    ,  
    Cannon
    CP
    ,  
    Cairns
    R
    ,  
    Morrow
    DA
    ,  
    Rifai
    N
    ,  
    Kirtane
    AJ
    ,  
    et al
    Relationship between uncontrolled risk factors and C-reactive protein levels in patients receiving standard or intensive statin therapy for acute coronary syndromes in the PROVE IT-TIMI 22 trial.
    J Am Coll Cardiol
    2005
    46
    1417
    24
     PubMed
    CrossRef
     PubMed
  36. Rutter
    MK
    ,  
    Meigs
    JB
    ,  
    Sullivan
    LM
    ,  
    D'Agostino
    RB
    Sr
    ,  
    Wilson
    PW
    .  
    C-reactive protein, the metabolic syndrome, and prediction of cardiovascular events in the Framingham Offspring Study.
    Circulation
    2004
    110
    380
    5
     PubMed
    CrossRef
     PubMed
  37. Miller
    M
    ,  
    Zhan
    M
    ,  
    Havas
    S
    .  
    High attributable risk of elevated C-reactive protein level to conventional coronary heart disease risk factors: the Third National Health and Nutrition Examination Survey.
    Arch Intern Med
    2005
    165
    2063
    8
     PubMed
    CrossRef
     PubMed
  38. Ridker
    PM
    ,  
    Rifai
    N
    ,  
    Rose
    L
    ,  
    Buring
    JE
    ,  
    Cook
    NR
    .  
    Comparison of C-reactive protein and low-density lipoprotein cholesterol levels in the prediction of first cardiovascular events.
    N Engl J Med
    2002
    347
    1557
    65
     PubMed
    CrossRef
     PubMed
  39. van der Meer
    IM
    ,  
    deMaat
    MP
    ,  
    Kiliaan
    AJ
    ,  
    van der Kuip
    DA
    ,  
    Hofman
    A
    ,  
    Witteman
    JC
    .  
    The value of C-reactive protein in cardiovascular risk prediction: the Rotterdam Study.
    Arch Intern Med
    2003
    163
    1323
    8
     PubMed
    CrossRef
     PubMed
  40. Koenig
    W
    ,  
    Lowel
    H
    ,  
    Baumert
    J
    ,  
    Meisinger
    C
    .  
    C-reactive protein modulates risk prediction based on the Framingham Score: implications for future risk assessment: results from a large cohort study in southern Germany.
    Circulation
    2004
    109
    1349
    53
     PubMed
    CrossRef
     PubMed
  41. Greenland
    P
    ,  
    LaBree
    L
    ,  
    Azen
    SP
    ,  
    Doherty
    TM
    ,  
    Detrano
    RC
    .  
    Coronary artery calcium score combined with Framingham score for risk prediction in asymptomatic individuals.
    JAMA
    2004
    291
    210
    5
     PubMed
    CrossRef
     PubMed
  42. Albert
    MA
    ,  
    Glynn
    RJ
    ,  
    Buring
    J
    ,  
    Ridker
    PM
    .  
    C-reactive protein levels among women of various ethnic groups living in the United States (from the Women's Health Study).
    Am J Cardiol
    2004
    93
    1238
    42
     PubMed
    CrossRef
     PubMed
  43. Anand
    SS
    ,  
    Razak
    F
    ,  
    Yi
    Q
    ,  
    Davis
    B
    ,  
    Jacobs
    R
    ,  
    Vuksan
    V
    ,  
    et al
    C-reactive protein as a screening test for cardiovascular risk in a multiethnic population.
    Arterioscler Thromb Vasc Biol
    2004
    24
    1509
    15
     PubMed
    CrossRef
     PubMed
  44. Khera
    A
    ,  
    McGuire
    DK
    ,  
    Murphy
    SA
    ,  
    Stanek
    HG
    ,  
    Das
    SR
    ,  
    Vongpatanasin
    W
    ,  
    et al
    Race and gender differences in C-reactive protein levels.
    J Am Coll Cardiol
    2005
    46
    464
    9
     PubMed
    CrossRef
     PubMed
  45. Ridker
    PM
    ,  
    Cannon
    CP
    ,  
    Morrow
    D
    ,  
    Rifai
    N
    ,  
    Rose
    LM
    ,  
    McCabe
    CH
    ,  
    et al
    C-reactive protein levels and outcomes after statin therapy.
    N Engl J Med
    2005
    352
    20
    8
     PubMed
    CrossRef
     PubMed
  46. Kinjo
    K
    ,  
    Sato
    H
    ,  
    Ohnishi
    Y
    ,  
    Hishida
    E
    ,  
    Nakatani
    D
    ,  
    Mizuno
    H
    ,  
    et al
    Impact of high-sensitivity C-reactive protein on predicting long-term mortality of acute myocardial infarction.
    Am J Cardiol
    2003
    91
    931
    5
     PubMed
    CrossRef
     PubMed
  47. Harb
    TS
    ,  
    Zareba
    W
    ,  
    Moss
    AJ
    ,  
    Ridker
    PM
    ,  
    Rifai
    N
    ,  
    Marder
    VJ
    ,  
    et al
    Association between inflammatory markers, hemostatic, and lipid factors in postinfarction patients.
    Am J Cardiol
    2003
    91
    1120
    3
     PubMed
    CrossRef
     PubMed
  48. Sanchis
    J
    ,  
    Bodi
    V
    ,  
    Llacer
    A
    ,  
    Nunez
    J
    ,  
    Facila
    L
    ,  
    Ruiz
    V
    ,  
    et al
    Usefulness of C-reactive protein and left ventricular function for risk assessment in survivors of acute myocardial infarction.
    Am J Cardiol
    2004
    94
    766
    9
     PubMed
    CrossRef
     PubMed
  49. Ridker
    PM
    ,  
    Rifai
    N
    ,  
    Clearfield
    M
    ,  
    Downs
    JR
    ,  
    Weis
    SE
    ,  
    Miles
    JS
    ,  
    et al
    Measurement of C-reactive protein for the targeting of statin therapy in the primary prevention of acute coronary events.
    N Engl J Med
    2001
    344
    1959
    65
     PubMed
    CrossRef
     PubMed
Figure.

Multivariable relative risk for cardiovascular disease (CVD), based on level of C-reactive protein (CRP) and level of absolute predicted 10-year Framingham coronary heart disease risk in the Women's Health Study.

Table. Comparison of Areas under Receiver-Operating Characteristic Curve for Models with Traditional Cardiovascular Disease Risk Factors alone or with the Addition of C-Reactive Protein to the Model

Table. Comparison of Areas under Receiver-Operating Characteristic Curve for Models with Traditional Cardiovascular Disease Risk Factors alone or with the Addition of C-Reactive Protein to the Model

Clinical Slide Sets

Terms of Use

The In the Clinic® slide sets are owned and copyrighted by the American College of Physicians (ACP). All text, graphics, trademarks, and other intellectual property incorporated into the slide sets remain the sole and exclusive property of the ACP. The slide sets may be used only by the person who downloads or purchases them and only for the purpose of presenting them during not-for-profit educational activities. Users may incorporate the entire slide set or selected individual slides into their own teaching presentations but may not alter the content of the slides in any way or remove the ACP copyright notice. Users may make print copies for use as hand-outs for the audience the user is personally addressing but may not otherwise reproduce or distribute the slides by any means or media, including but not limited to sending them as e-mail attachments, posting them on Internet or Intranet sites, publishing them in meeting proceedings, or making them available for sale or distribution in any unauthorized form, without the express written permission of the ACP. Unauthorized use of the In the Clinic slide sets will constitute copyright infringement.

This feature is available only to Registered Users

Subscribe/Learn More
Submit a Comment

0 Comments

PDF
Not Available
Citations
Citation

Lloyd-Jones DM, Liu K, Tian L, et al. Narrative Review: Assessment of C-Reactive Protein in Risk Prediction for Cardiovascular Disease. Ann Intern Med. 2006;145:35–42. doi: https://doi.org/10.7326/0003-4819-145-1-200607040-00129

Download citation file:

  • Ris (Zotero)
  • EndNote
  • BibTex
  • Medlars
  • ProCite
  • RefWorks
  • Reference Manager

© 2019

×
Permissions

Published: Ann Intern Med. 2006;145(1):35-42.

DOI: 10.7326/0003-4819-145-1-200607040-00129

©
2006 American College of Physicians
170 Citations

See Also

The Effect of Including C-Reactive Protein in Cardiovascular Risk Prediction Models for Women
C-Reactive Protein and Cardiovascular Disease Risk: Still an Unknown Quantity?
Association between Protein Levels and Mortality in Patients with Peripheral Arterial Disease
View MoreView Less

Related Articles

C-Reactive Protein as a Risk Factor for Coronary Heart Disease: A Systematic Review and Meta-analyses for the U.S. Preventive Services Task Force
Annals of Internal Medicine; 151 (7): 483-495
The Effect of Including C-Reactive Protein in Cardiovascular Risk Prediction Models for Women
Annals of Internal Medicine; 145 (1): 21-29
Update in Women's Health: Evidence Published in 2016
Annals of Internal Medicine; 166 (7): W48-W52
Is C-Reactive Protein Specific for Vascular Disease in Women?
Annals of Internal Medicine; 136 (7): 529-533
View MoreView Less

Journal Club

Review: Folic acid may reduce risk for CVD and stroke, and B-vitamin complex may reduce risk for stroke
Annals of Internal Medicine; 169 (8): JC44
In type 2 diabetes with CVD and kidney disease, empagliflozin reduced mortality and hospitalization
Annals of Internal Medicine; 168 (10): JC52
Review: In primary care, CRP testing, shared decision making, and procalcitonin reduce antibiotic prescribing for ARI
Annals of Internal Medicine; 168 (2): JC11
In stable CVD, rivaroxaban plus aspirin reduced CV events and increased bleeding compared with aspirin alone
Annals of Internal Medicine; 167 (10): JC52
View MoreView Less

Related Topics

Cardiology
Coronary Risk Factors
Prevention/Screening

Cardiology, Coronary Risk Factors, Prevention/Screening.

PubMed Articles

Screening active ingredients of rosemary based on spectrum-effect relationships between UPLC fingerprint and vasorelaxant activity using three chemometrics.
J Chromatogr B Analyt Technol Biomed Life Sci 2019;
Examining the impact of data quality and completeness of electronic health records on predictions of patients' risks of cardiovascular disease.
Int J Med Inform 2019;
View More

Results provided by: PubMed

CME/MOC Activity Requires Users to be Registered and Logged In.
Sign in below to access your subscription for full content
INDIVIDUAL SIGN IN
Sign In|Set Up Account
You will be directed to acponline.org to register and create your Annals account
Annals of Internal Medicine
CREATE YOUR FREE ACCOUNT
Create Your Free Account|Why?
To receive access to the full text of freely available articles, alerts, and more. You will be directed to acponline.org to complete your registration.
×
The Comments Feature Requires Users to be Registered and Logged In.
Sign in below to access your subscription for full content
INDIVIDUAL SIGN IN
Sign In|Set Up Account
You will be directed to acponline.org to register and create your Annals account
Annals of Internal Medicine
CREATE YOUR FREE ACCOUNT
Create Your Free Account|Why?
To receive access to the full text of freely available articles, alerts, and more. You will be directed to acponline.org to complete your registration.
×
link to top

Content

  • Home
  • Latest
  • Issues
  • Channels
  • CME/MOC
  • In the Clinic
  • Journal Club
  • Web Exclusives

Information For

  • Author Info
  • Reviewers
  • Press
  • Readers
  • Institutions / Libraries / Agencies
  • Advertisers

Services

  • Subscribe
  • Renew
  • Alerts
  • Current Issue RSS
  • Latest RSS
  • In the Clinic RSS
  • Reprints & Permissions
  • Contact Us
  • Help
  • About Annals
  • About Mobile
  • Patient Information
  • Teaching Tools
  • Annals in the News
  • Share Your Feedback

Awards and Cover

  • Personae (Cover Photo)
  • Junior Investigator Awards
  • Poetry Prize

Other Resources

  • ACP Online
  • Career Connection
  • ACP Advocate Blog
  • ACP Journal Wise

Follow Annals On

  • Twitter Link
  • Facebook Link
acp link acp
silverchair link silverchair

Copyright © 2019 American College of Physicians. All Rights Reserved.

Print ISSN: 0003-4819 | Online ISSN: 1539-3704

Privacy Policy

|

Conditions of Use

This site uses cookies. By continuing to use our website, you are agreeing to our privacy policy. | Accept
×

You need a subscription to this content to use this feature.

×
PDF Downloads Require Access to the Full Article.
Sign in below to access your subscription for full content
INDIVIDUAL SIGN IN
Sign In|Set Up Account
You will be directed to acponline.org to register and create your Annals account
INSTITUTIONAL SIGN IN
Open Athens|Shibboleth|Log In
Annals of Internal Medicine
PURCHASE OPTIONS
Buy This Article|Subscribe
You will be redirected to acponline.org to sign-in to Annals to complete your purchase.
CREATE YOUR FREE ACCOUNT
Create Your Free Account|Why?
To receive access to the full text of freely available articles, alerts, and more. You will be directed to acponline.org to complete your registration.
×
Access to this Free Content Requires Users to be Registered and Logged In. Please Choose One of the Following Options
Sign in below to access your subscription for full content
INDIVIDUAL SIGN IN
Sign In|Set Up Account
You will be directed to acponline.org to register and create your Annals account
Annals of Internal Medicine
CREATE YOUR FREE ACCOUNT
Create Your Free Account|Why?
To receive access to the full text of freely available articles, alerts, and more. You will be directed to acponline.org to complete your registration.
×