Skip Navigation
American College of Physicians Logo
  • Subscribe
  • Submit a Manuscript
  • Sign In
    Sign in below to access your subscription for full content
    INDIVIDUAL SIGN IN
    Sign In|Set Up Account
    You will be directed to acponline.org to register and create your Annals account
    INSTITUTIONAL SIGN IN
    Open Athens|Shibboleth|Log In
    Annals of Internal Medicine
    SUBSCRIBE
    Subscribe to Annals of Internal Medicine.
    You will be directed to acponline.org to complete your purchase.
Annals of Internal Medicine Logo Menu
  • Latest
  • Issues
  • Channels
  • CME/MOC
  • In the Clinic
  • Journal Club
  • Web Exclusives
  • Author Info
Advanced Search
  • ‹ PREV ARTICLE
  • This Issue
  • NEXT ARTICLE ›
Articles |4 March 2008

Improved Diagnostic Evaluation of Suspected Tuberculosis Free

Davinder P.S. Dosanjh, DPhil; Timothy S.C. Hinks, MD; John A. Innes, MD; Jonathan J. Deeks, PhD; Geoffrey Pasvol, DPhil; Sarah Hackforth, RGN; Hansa Varia, RGN; Kerry A. Millington, DPhil; Rubamalar Gunatheesan, MD; Valerie Guyot-Revol, PhD; Ajit Lalvani, DM

Davinder P.S. Dosanjh, DPhil
From Tuberculosis Immunology Group, Imperial College London, London; University of Oxford, Oxford; Birmingham Heartlands Hospital and University of Birmingham, Birmingham; and Northwick Park Hospital, Harrow, United Kingdom.

Timothy S.C. Hinks, MD
From Tuberculosis Immunology Group, Imperial College London, London; University of Oxford, Oxford; Birmingham Heartlands Hospital and University of Birmingham, Birmingham; and Northwick Park Hospital, Harrow, United Kingdom.

John A. Innes, MD
From Tuberculosis Immunology Group, Imperial College London, London; University of Oxford, Oxford; Birmingham Heartlands Hospital and University of Birmingham, Birmingham; and Northwick Park Hospital, Harrow, United Kingdom.

Jonathan J. Deeks, PhD
From Tuberculosis Immunology Group, Imperial College London, London; University of Oxford, Oxford; Birmingham Heartlands Hospital and University of Birmingham, Birmingham; and Northwick Park Hospital, Harrow, United Kingdom.

Geoffrey Pasvol, DPhil
From Tuberculosis Immunology Group, Imperial College London, London; University of Oxford, Oxford; Birmingham Heartlands Hospital and University of Birmingham, Birmingham; and Northwick Park Hospital, Harrow, United Kingdom.

Sarah Hackforth, RGN
From Tuberculosis Immunology Group, Imperial College London, London; University of Oxford, Oxford; Birmingham Heartlands Hospital and University of Birmingham, Birmingham; and Northwick Park Hospital, Harrow, United Kingdom.

Hansa Varia, RGN
From Tuberculosis Immunology Group, Imperial College London, London; University of Oxford, Oxford; Birmingham Heartlands Hospital and University of Birmingham, Birmingham; and Northwick Park Hospital, Harrow, United Kingdom.

Kerry A. Millington, DPhil
From Tuberculosis Immunology Group, Imperial College London, London; University of Oxford, Oxford; Birmingham Heartlands Hospital and University of Birmingham, Birmingham; and Northwick Park Hospital, Harrow, United Kingdom.

Rubamalar Gunatheesan, MD
From Tuberculosis Immunology Group, Imperial College London, London; University of Oxford, Oxford; Birmingham Heartlands Hospital and University of Birmingham, Birmingham; and Northwick Park Hospital, Harrow, United Kingdom.

Valerie Guyot-Revol, PhD
From Tuberculosis Immunology Group, Imperial College London, London; University of Oxford, Oxford; Birmingham Heartlands Hospital and University of Birmingham, Birmingham; and Northwick Park Hospital, Harrow, United Kingdom.

Ajit Lalvani, DM
From Tuberculosis Immunology Group, Imperial College London, London; University of Oxford, Oxford; Birmingham Heartlands Hospital and University of Birmingham, Birmingham; and Northwick Park Hospital, Harrow, United Kingdom.

Article, Author, and Disclosure Information
Author, Article, and Disclosure Information
  • From Tuberculosis Immunology Group, Imperial College London, London; University of Oxford, Oxford; Birmingham Heartlands Hospital and University of Birmingham, Birmingham; and Northwick Park Hospital, Harrow, United Kingdom.

    Note: Drs. Dosanjh and Hinks contributed equally to this work.

    Acknowledgment: The authors thank the study participants; Sarah Gooding, for collection and processing of some samples; and Muhunthan Thillai, for critical appraisal and revision of the final manuscript.

    Grant Support: By the Wellcome Trust (Dr. Lalvani is a Wellcome Senior Research Fellow in Clinical Science), the Sir Halley Stewart Trust (Dr. Dosanjh's studentship), a Wellcome Trust PhD Prize Studentship (Dr. Millington), and a United Kingdom Department of Health Senior Fellowship in Evidence Synthesis (Dr. Deeks).

    Potential Financial Conflicts of Interest:Consultancies: A. Lalvani (Oxford Immunotec Ltd. [nonexecutive director from 2003 to 2007]). Honoraria: G. Pasvol (Transactions of the Royal Society of Tropical Medicine). Stock ownership or options (other than mutual funds): D.P.S. Dosanjh (Oxford Immunotec Ltd.), A Lalvani (Oxford Immunotec Ltd.), University of Oxford (Oxford Immunotech Ltd.). Patents received: A. Lalvani (T-cell–based diagnosis of tuberculous infection), University of Oxford (T-cell–based diagnosis of tuberculous infection). Patents pending: D.P.S. Dosanjh (T-cell–based diagnosis of tuberculous infection), A. Lalvani (T-cell–based diagnosis of tuberculous infection, University of Oxford (T-cell–based diagnosis of tuberculous infection).

    Reproducible Research Statement: The analytic data set of all participants' diagnoses, tuberculin skin test results, ELISpot results, and ELISpotPLUS results can be made available to academic investigators on request by written agreement.

    Requests for Single Reprints: Ajit Lalvani, DM, Tuberculosis Immunology Group, Department of Respiratory Medicine, Faculty of Medicine, Imperial College London, St. Mary's Campus, Norfolk Place, London W2 1PG, United Kingdom; e-mail, a.lalvani@imperial.ac.uk.

    Current Author Addresses: Dr. Dosanjh: University of Oxford Medical School, William Osler House, John Radcliffe Hospital, Oxford OX3 9DU, United Kingdom.

    Dr. Hinks: Allergy, Inflammation, and Repair Group, Level D, Southampton General Hospital, Southampton SO16 6YD, United Kingdom.

    Dr. Innes and Ms. Hackforth: Department of Infection & Tropical Medicine, Birmingham Heartlands Hospital, Bordsley Green East, Birmingham B9 5SS, United Kingdom.

    Dr. Deeks: Department of Public Health and Epidemiology, University of Birmingham, Edgbaston, Birmingham B15 2TT, United Kingdom.

    Dr. Pasvol and Ms. Varia: Department of Infection and Tropical Medicine, Northwick Park Hospital, Imperial College London, Watford Road, Harrow HA1 3UJ, United Kingdom.

    Drs. Millington and Lalvani: Department of Respiratory Medicine, Imperial College London, St. Mary's Campus, Norfolk Place, London W2 1PG, United Kingdom.

    Dr. Gunatheesan: University of Melbourne Medical School, Melbourne, Australia.

    Dr. Guyot-Revol: Genopoietic, 1390 rue Centrale-Beynost, 01708 Miribel Cedex, France.

    Author Contributions: Conception and design: J.A. Innes, A. Lalvani. Analysis and interpretation of the data: D.P.S. Dosanjh, T.S.C. Hinks, J.J. Deeks, K.A. Millington, A. Lalvani.

    Drafting of the article: D.P.S. Dosanjh, T.S.C. Hinks, G. Pasvol, A. Lalvani.

    Critical revision of the article for important intellectual content: D.P.S. Dosanjh, T.S.C. Hinks, J.A. Innes, J.J. Deeks, G. Pasvol, K.A. Millington, A. Lalvani.

    Final approval of the article: D.P.S. Dosanjh, J.J. Deeks, G. Pasvol, V. Guyot-Revol, A. Lalvani.

    Provision of study materials or patients: J.A. Innes, G. Pasvol, S. Hackforth, H. Varia, A. Lalvani.

    Statistical expertise: D.P.S. Dosanjh, J.J. Deeks.

    Obtaining of funding: A Lalvani.

    Administrative, technical, or logistic support: D.P.S. Dosanjh, G. Pasvol, S. Hackforth, K.A. Millington, A. Lalvani.

    Collection and assembly of data: D.P.S. Dosanjh, T.S.C. Hinks, S. Hackforth, K.A. Millington, V. Guyot-Revol.

×
  • ‹ PREV ARTICLE
  • This Issue
  • NEXT ARTICLE ›
Jump To
  • Full Article
  • FULL ARTICLE
  • FULL ARTICLE
    • Abstract
    • Editors’ Notes
    • Methods
    • Results
    • Discussion
      1. References
  • Figures
  • Tables
  • Supplements
  • Audio/Video
  • Summary for Patients
  • Clinical Slide Sets
  • CME / MOC
  • Comments
  • Twitter Link
  • Facebook Link
  • Email Link
More
  • LinkedIn Link

Abstract

Background:

The role of new T-cell–based blood tests for tuberculosis in the diagnosis of active tuberculosis is unclear.

Objective:

To compare the performance of 2 interferon-γ assays and tuberculin skin testing in adults with suspected tuberculosis.

Design:

Prospective study conducted in routine practice.

Setting:

2 urban hospitals in the United Kingdom.

Patients:

389 adults, predominantly of South Asian and black ethnicity, with moderate to high clinical suspicion of active tuberculosis.

Intervention:

Tuberculin skin testing, the enzyme-linked immunospot assay (ELISpot) incorporating early secretory antigenic target-6 and culture filtrate protein-10 (standard ELISpot), and ELISpot incorporating a novel antigen, Rv3879c (ELISpotPLUS) were performed during diagnostic assessment by independent persons who were blinded to results of the other test.

Measurements:

Sensitivity, specificity, predictive values, and likelihood ratios.

Results:

194 patients had a final diagnosis of active tuberculosis, of which 79% were culture-confirmed. Sensitivity for culture confirmed and highly probable tuberculosis was 89% (95% CI, 84% to 93%) with ELISpotPLUS, 85% (CI, 79% to 90%) with standard ELISpot, 79% (CI, 72% to 85%) with 15-mm threshold tuberculin skin testing, and 83% (CI, 77% to 89%) with stratified thresholds of 15 and 10 mm in vaccinated and unvaccinated patients, respectively. The ELISpotPLUS assay was more sensitive than tuberculin skin testing with 15-mm cutoff points (P = 0.01) but not with stratified cutoff points (P = 0.10). The ELISpotPLUS assay had 4% higher diagnostic sensitivity than standard ELISpot (P = 0.02). Combined sensitivity of ELISpotPLUS and tuberculin skin testing was 99% (CI, 95% to 100%), conferring a negative likelihood ratio of 0.02 (CI, 0 to 0.06) when both test results were negative.

Limitations:

Local standards for tuberculin skin testing differed from others used internationally. The study sample included few immunosuppressed patients.

Conclusion:

The ELISpotPLUS assay is more sensitive than standard ELISpot and, when used in combination with tuberculin skin testing, enables rapid exclusion of active infection in patients with moderate to high pretest probability of tuberculosis.

Editors’ Notes

Context

  • Can new T-cell–based blood tests rule out active tuberculosis?

Contribution

  • In this study involving 389 adults with moderate to high suspicion of active tuberculosis, the sensitivity of a new T-cell–based enzyme-linked immunoassay (ELISpotPLUS) was higher than that of 15-mm threshold tuberculin skin testing (89% vs. 79%) and similar to that of 10-mm threshold skin testing (83%) in unvaccinated patients for identifying culture-confirmed and highly probable tuberculosis. Patients with negative results on both ELISpotPLUS and skin tests had a very low likelihood of tuberculosis (negative likelihood ratio, 0.02).

Implication

  • The ELISpotPLUS assay, particularly when used in combination with tuberculin skin testing, can help exclude a diagnosis of active tuberculosis.

—The Editors
Improved diagnosis of tuberculosis is necessary to contain and reverse the rising global burden of this disease (1). The poor speed and sensitivity of existing diagnostic tools (2–4) cause delays in diagnosis and treatment of active tuberculosis, and diagnosis of extrapulmonary and paucibacillary forms is often especially challenging. Given that Mycobacterium tuberculosis infection is a prerequisite for active tuberculosis, reliable determination of infection status could accelerate diagnostic assessment by enabling rapid exclusion of tuberculosis. Recently developed T-cell–based interferon-γ release assays for tuberculosis may overcome some of the limitations of the tuberculin skin test (5–10). These immunoassays detect interferon-γ secreted by T cells in response to antigens encoded in the region of difference 1 of M. tuberculosis complex, a genomic segment absent from bacille Calmette–Guérin and most environmental mycobacteria (11). Test results are therefore not confounded by previous bacille Calmette–Guérin vaccination, conferring higher specificity than the tuberculin skin test (7–10). Moreover, results are available the next day and are unaffected by the boosting phenomenon (12).
The 2 types of T-cell–based interferon-γ release assay are whole-blood enzyme-linked immunosorbent assay (ELISA) and enzyme-linked immunospot assay (ELISpot). The whole-blood ELISA is available commercially as QuantiFERON-TB Gold and an “in-tube” variant, QuantiFERON-TB Gold In-tube (Cellestis, Carnegie, Australia) (13, 14). The ELISpot, developed by Lalvani and colleagues (15, 16), is available commercially as T-SPOT.TB (Oxford Immunotec, Abingdon, United Kingdom) (15–18). Recent U.S. and United Kingdom national guidelines (19, 20) recommend T-cell–based interferon-γ release assays for diagnosis of latent tuberculosis, but their clinical utility in evaluation of patients with suspected active tuberculosis is poorly defined.
We compared the performance characteristics of 2 assays and tuberculin skin testing individually and in combination for the diagnostic work-up of patients with suspected active tuberculosis. The standard ELISpot assay uses early secretory antigenic target-6 and culture filtrate protein-10, the same peptides as the 2 region of difference 1–encoded antigens included in T-SPOT.TB. The ELISpotPLUS assay incorporates a novel region of difference 1–encoded antigen, Rv3879c, alongside early secretory antigenic target-6 and culture filtrate protein-10 (21).

Methods

Participants

One day each week from 12 July 2002 to 29 June 2005, we prospectively enrolled adults who presented to Heartlands Hospital, Birmingham, and Northwick Park Hospital, London, United Kingdom, with suspected tuberculosis. We invited patients 16 years of age or older to participate and provide written informed consent if their attending physician considered tuberculosis to be part of the differential diagnosis. We used no exclusion criteria. The Birmingham Heartlands Hospital, Harrow, and Oxford Clinical Research Ethics Committees granted ethical approval. Because the background prevalence of HIV is low in this population (22), we tested patients for HIV antibodies during diagnostic work-up only on the basis of clinical suspicion. We identified only 20 patients who were HIV antibody–positive.

Tuberculin Skin Testing

Tuberculin skin testing was performed as part of routine care, and experienced nurses read the results by using the Mantoux method with 0.1 mL (10 tuberculin units) of purified protein derivative (PPD)–Siebert (Evans Vaccines, Liverpool, United Kingdom). Intradermal inoculation was confirmed by the cutaneous appearance of peau d'orange. Induration was measured after 72 hours with a ruler and recorded in millimeters. Because PPD for Mantoux testing was unavailable for 10 months during the study period, 104 patients were tested by using the Heaf method, with the standard multiple puncture 6-needle disposable-head Heaf gun (Bignall Surgical Instruments, Littlehampton, United Kingdom) and concentrated PPD (100 000 tuberculin units/mL; Evans Vaccines). Heaf tests were read 1 week later, as recommended, and graded from 0 to 4. The nurses who performed and read skin tests were blinded to ELISpot results. We considered induration of 15 mm or greater on the Mantoux test or grade 3 or 4 on the Heaf test (which is considered equivalent to the 15-mm threshold [23, 24]) to be a positive result. We assessed bacille Calmette–Guérin vaccination status by history and, where present, by scar. We also assessed tuberculin skin test performance by using stratified cutoff points of 15 mm and 10 mm (grade 2 to 4 on the Heaf test) in vaccinated and unvaccinated patients, respectively (“stratified 10-mm threshold”) (23, 24).

The ELISpot Assay

Before or within 1 week of initiating therapy, we obtained a sample of 30 mL of heparinized blood and used 7.5 × 106 peripheral blood mononuclear cells for ELISpot assays. We seeded precoated interferon-γ ELISpot plates (Mabtech AB, Stockholm, Sweden) with 2.5 × 105 peripheral blood mononuclear cells per well (17). Duplicate wells contained no antigen (negative control) or phytohemagglutinin (positive control) (ICN Biomedical, Aurora, Ohio) at 5 µg/mL. A further 13 pairs of duplicate wells each contained 1 of 13 peptide pools, which incorporated 5 to 7 overlapping 15-mer peptides. The assay on which T-SPOT.TB is based, defined as standard ELISpot in this study, comprises 35 such peptides assembled into 6 pools and spanning the length of early secretory antigenic target-6 and culture filtrate protein-10. Forty-five peptides from selected regions of Rv3873, Rv3878, and Rv3879c (Research Genetics, Huntsville, Alabama) were assembled into 7 pools (21). The ELISpotPLUS assay was defined as the 35 early secretory antigenic target-6 and culture filtrate protein-10 peptides, with 17 peptides from Rv3879c, assembled into 3 additional pools. The final concentration of each peptide was 10 µg/mL. After overnight incubation at 37 °C in 5% carbon dioxide, the plates were developed with preconjugated detector antibody (Mabtech AB) followed by chromogenic substrate (Moss, Pasadena, Maryland) (17). Spot-forming cells were counted by using an automated ELISpot reader (AID-GmbH, Strassberg, Germany). We predefined settings for the intensity and size of a counted spot and used the same settings throughout. We transferred mean readings from duplicate wells to a spreadsheet electronically and scored them as positive or negative by using a customized software program, ELISTAT (AID-GmbH). We scored responses as positive if test wells contained a mean of at least 5 spot-forming cells more than the mean of the negative control wells and were at least twice the mean of the negative control wells. This predefined cutoff point is the standard threshold used with our assay format in 9 studies including a total of 2506 participants (15–17, 25–30). Operators performing and reading the assays were blinded to tuberculin skin test results and personal identifiers. The ELISpot results were checked and countersigned before data entry by a scientist who did not perform the assays.

Diagnosis

Attending physicians performed diagnostic work-up as part of routine clinical practice, which was directed on a case-by-case basis by the patient's clinical presentation. Two research nurses collected clinical, radiologic, and microbiological data on standardized forms at recruitment, during follow-up, and at final case notes review. Two physicians who were blinded to all ELISpot data assigned each patient to 1 of 4 predefined diagnostic categories (Table 1), which are similar to those used in other studies (25). Category 4 inevitably included some patients with inactive or latent tuberculosis. To compensate for heterogeneity, we further classified patients in this category into 4 predefined subgroups, analogous to American Thoracic Society classes 4, 2, 1, and 0 (31), in decreasing likelihood of latent tuberculosis (Table 1). We stratified by radiologic evidence or history of previous tuberculosis, risk factors for latent infection, and skin test results.

Table 1. Categorization of the Study Population

Table 1. Categorization of the Study Population

Statistical Analysis

We calculated the sensitivity, specificity, likelihood ratios, and predictive values for each test and for sequences of 2 tests used in combination. Because the primary clinical utility of immune-based testing is to rule out tuberculosis, our predefined analytical plan focused primarily on sensitivities, negative likelihood ratios, and negative predictive values. We compared proportions by using Pearson chi-square and Fisher exact tests where sample sizes differed substantially (because of missing results for 1 of the tests). We compared the data from the ELISpot and ELISpotPLUS tests by using the McNemar chi-square test, treating the data as paired and dropping the 6 individuals who did not have an ELISpotPLUS result. We assumed that missing data were missing completely at random for our analyses, but we provide sufficient information for other analyses to be performed with different assumptions about reasons for missing data. Two-tailed P values are reported.
We calculated primary analyses of sensitivity, specificity, likelihood ratios, and predictive values by using categories 1 (culture-confirmed), 2 (highly probable), and 4 (active tuberculosis excluded) (Table 1). Category 3 (clinically indeterminate) cases were not included in the calculation of test performances. To investigate whether the inclusion of category 2 cases affected sensitivity, we calculated performance by using only categories 1 and 4, and to investigate whether the inclusion of categories 4A, 4B, and 4C (which included patients with latent and inactive tuberculosis) affected specificity, we calculated performance by using only categories 1, 2, and 4D (no risk factors for tuberculosis exposure).
We assessed the performance of combinations of the 2 tests by using logistic regression models. For this analysis, we necessarily restricted the data set to patients with results from both tests. Logistic regression models can be constructed in the same form as Bayesian updating (posttest odds = pretest odds × likelihood ratio) by including the log of the pretest odds of prevalence (a constant term of known value) as an offset in the model. The linear predictor then estimates log likelihood ratios rather than log odds ratios, but bootstrap methods are required to obtain valid CIs (32). We used model parameterizations from Knottnerus (33) to compute likelihood ratios for the additional diagnostic value of each test in a testing sequence, whereas we followed the recommendations of Albert (34) to obtain estimates of likelihood ratios for combinations of tests. We computed nonparametric, bias-adjusted CIs for parameter estimates from 1000 bootstrap samples.
We computed predictors of false-negative test results by using chi-square or Fisher exact tests, using the Bonferroni correction for multiple comparisons. We performed our analyses by using GraphPad Prism 4 (GraphPad Software, San Diego, California) and Stata, version 9.0 (Stata, College Station, Texas).

Role of the Funding Source

The Wellcome Trust had no role in study design, data collection, data analysis, data interpretation, or writing of the report.

Results

We enrolled 389 consenting adult patients, whose demographic characteristics are shown in Table 2. Blood was unavailable from 3 patients, tuberculin skin test results were unavailable in 67 patients, and 15 ELISpot assays (4%) were indeterminate (Figure 1). The 67 patients without tuberculin skin test results were similar to those with skin test results in terms of age, sex, ethnicity, presence of tuberculosis, site of disease, and presence of comorbid conditions (data provided on request). We classified 154 patients (40%) as having culture-confirmed tuberculosis, 40 (10%) as having highly probable tuberculosis, and 39 (10%) as clinically indeterminate; we excluded active tuberculosis in 154 patients (40%) (Table 1 and Appendix Figure 1). Twenty-eight percent of tuberculosis cases were extrapulmonary; Table 3 shows the clinical subtypes of tuberculosis and alternative diagnoses for patients without tuberculosis.

Table 2. Participant Characteristics

Table 2. Participant Characteristics
Figure 1.

Study flow diagram.

ELISpot = enzyme-linked immunospot assay incorporating early secretory antigenic target-6 and culture filtrate protein-10; ELISpotPLUS = enzyme-linked immunospot assay incorporating early secretory antigenic target-6, culture filtrate protein-10, and Rv3879c; TB = tuberculosis; TST= tuberculin skin testing. *Results were indeterminate because of no achievement of positive control (11 patients), high background (1 patient), peptide contamination (1 patient), inconclusive assay (1 patient), or defective ELISpot plate (1 patient). †Results were not available because of history of TB (clinically contraindicated) (45 patients), patient did not return for reading (8 patients), result not recorded (8 patients), reason unknown (3 patients), death (1 patient), test performed elsewhere (1 patient), or patient declined consent (1 patient). ‡Tuberculin skin test results were based on a 15-mm cutoff point and considered positive if induration was ≥15 mm on the Mantoux test or grade 3 to 4 on the Heaf test regardless of bacille Calmette–Guérin vaccination status.

Appendix Figure 1.

Study flow diagram, stratified by final diagnosis and then by test result.

These are the same data shown in Figure 1 but displayed in a different manner to allow scrutiny of the entire raw data set. ELISpot = enzyme-linked immunospot assay incorporating early secretory antigenic target-6 and culture filtrate protein-10; ELISpotPLUS = enzyme-linked immunospot assay incorporating early secretory antigenic target-6, culture filtrate protein-10, and Rv3879c; TB = tuberculosis; TST= tuberculin skin testing. *Results were not available because of history of TB (clinically contraindicated) (45 patients), patient did not return for reading (8 patients), result not recorded (8 patients), reason unknown (3 patients), death (1 patient), test performed elsewhere (1 patient), or patient declined consent (1 patient). †Tuberculin skin test results were based on a 15-mm cutoff point and considered positive if induration was ≥15 mm on the Mantoux test or grade 3 to 4 on the Heaf test regardless of bacille Calmette–Guérin vaccination status. ‡Results were indeterminate because of no achievement of positive control (11 patients), high background (1 patient), peptide contamination (1 patient), inconclusive assay (1 patient), or defective ELISpot plate (1 patient).

Table 3. Final Diagnoses of Study Participants

Table 3. Final Diagnoses of Study Participants
For culture-confirmed and highly probable cases, diagnostic sensitivities were 89% (95% CI, 84% to 93%) with ELISpotPLUS, 85% (CI, 79% to 90%) with standard ELISpot, 79% (CI, 72% to 85%) with 15-mm threshold tuberculin skin testing, and 83% (CI, 77% to 89%) with stratified 10-mm threshold tuberculin skin testing (Table 4). The ELISpotPLUS assay was more sensitive than tuberculin skin testing with the 15-mm threshold (P = 0.01) but not with the stratified 10-mm threshold (P = 0.10). The ELISpotPLUS assay was more sensitive than tuberculin skin testing with a 15-mm threshold in the 297 patients with results from both tests (89% [CI, 83% to 94%] versus 81% [CI, 73% to 87%]; P = 0.04), but not with stratified-10 mm threshold (85% [CI, 78% to 90%]; P = 0.2). The sensitivity of ELISpotPLUS was 4.2% higher than that of standard ELISpot (P = 0.02). Seven patients with active tuberculosis had ELISpot responses to novel peptides but not to early secretory antigenic target-6 or culture filtrate protein-10, of whom 4 were positive to Rv3873, 3 to Rv3878, and all 7 to Rv3879c.

Table 4. Accuracy for the Diagnosis of Active Tuberculosis

Table 4. Accuracy for the Diagnosis of Active Tuberculosis
In a sensitivity analysis to investigate whether inclusion of highly probable cases (category 2, which was biased in favor of the tuberculin skin test because a diagnosis of highly probable tuberculosis was based in part on skin test results) affected performance estimates, we reestimated sensitivity by using only culture-confirmed cases (category 1). Sensitivities were 91% (CI, 85% to 95%) with ELISpotPLUS, 87% (CI, 80% to 92%) with standard ELISpot, 79% (CI, 71% to 86%) with tuberculin skin testing using the 15-mm threshold, and 82 % (CI, 74% to 89%) with the stratified 10-mm threshold. The ELISpotPLUS assay was more sensitive than tuberculin skin testing using either the 15-mm (P = 0.005) or the stratified 10-mm threshold (P = 0.03) (Table 4).
Tuberculin skin testing and ELISpot had higher sensitivity when used in combination. For culture-confirmed or highly probable diagnoses of tuberculosis, sensitivity of ELISpotPLUS with tuberculin skin testing was 99% (CI, 95% to 100%) and standard ELISpot with tuberculin skin testing was 97% (CI, 93% to 99%) (Figure 2). A negative result on both tests was associated with likelihood ratios of 0.02 (CI, 0 to 0.09) for ELISpotPLUS with tuberculin skin testing and 0.04 (CI, 0.02 to 0.12) for standard ELISpot with tuberculin skin testing. Positive results from both tests provided likelihood ratios of 5.5 (CI, 3.2 to 9.5) for ELISpotPLUS with tuberculin skin testing and 5.7 (CI, 3.2 to 9.9) for standard ELISpot with tuberculin skin testing, whereas discordant results (likelihood ratios, 0.93 to 1.56) had no diagnostic value. Figure 2 shows sequential likelihood ratios when ELISpot assays are followed by tuberculin skin testing, and Appendix Figure 2 shows corresponding results when tuberculin skin testing is used first.
Figure 2.

Likelihood ratios, sensitivities, and specificities of tests used in combination, using ELISpot or ELISpotPLUS first.

Data are for patients in whom results on both tests were available (n = 265). Except where stated, values are likelihood ratios with 95% CIs. Tuberculin skin test thresholds for positivity were induration ≥15 mm on the Mantoux test or grade 3 to 4 on the Heaf test. ELISpot = enzyme-linked immunospot incorporating early secretory antigenic target-6 and culture filtrate protein-10; ELISpotPLUS = enzyme-linked immunospot incorporating early secretory antigenic target-6, culture filtrate protein-10, and Rv3879c; TB = tuberculosis; TST = tuberculin skin testing. Top. ELISpot followed by TST. *Combined sensitivity of 1 or more positive results from tests used in combination, 97% (CI, 93% to 99%). †Combined specificity for a double-negative result from tests used in combination, 62% (CI, 53% to 71%). Bottom. ELISpotPLUS followed by TST. ‡Combined sensitivity of 1 or more positive results from tests used in combination, 99% (CI, 95% to 100%). §Combined specificity for a double-negative result from tests used in combination, 61% (CI, 52% to 70%).

Appendix Figure 2.

Likelihood ratios, sensitivities, and specificities of tests used in combination for diagnostic evaluation, using tuberculin skin testing (TST) as the first test.

Data are for patients in whom results on both tests were available (n = 265). Except where stated, numbers are likelihood ratios with 95% CIs. Tuberculin skin test thresholds for positivity were induration ≥15 mm on the Mantoux test or grade 3 to 4 on the Heaf test. ELISpot = enzyme-linked immunospot incorporating early secretory antigenic target-6 and culture filtrate protein-10; ELISpotPLUS = enzyme-linked immunospot incorporating early secretory antigenic target-6, culture filtrate protein-10, and Rv3879c; TB = tuberculosis. Top. TST followed by ELISpot. *Combined sensitivity of 1 or more positive results from tests used in combination, 97% (CI, 93% to 99%). †Combined specificity for a double-negative result from tests used in combination, 62% (CI, 53% to 71%). Bottom. TST followed by ELISpotPLUS. ‡Combined sensitivity of 1 or more positive results from tests used in combination, 99% (CI, 95% to 100%). §Combined specificity for a double-negative result from tests used in combination, 61% (CI, 52% to 70%).

The high sensitivity of the combined tests reflects the fact that false-negative tuberculin skin test results and false-negative ELISpot results occurred in different patient populations. In univariate analysis among culture-confirmed and highly probable cases, the presence of factors associated with cutaneous anergy (5) or risk for progression from latent infection to active tuberculosis (35) was associated with false-negative tuberculin skin test results (P = 0.001) but not with false-negative ELISpot results (P = 0.55). Specifically, 28% (CI, 11% to 44%) of patients with false-negative tuberculin skin test results had factors associated with cutaneous anergy (3 had diabetes and 3 were HIV-positive), compared with 5.0% (CI, 1.1% to 8.8%) of those with true-positive results. Eleven patients with tuberculosis were deemed immunocompromised on the basis of being HIV-positive (8 patients) or receiving long-term corticosteroid treatment (3 patients); 10 had positive ELISpot results and all 11 had positive ELISpotPLUS results. Neither age nor presence of any comorbid condition was associated with false-negative tuberculin skin test or ELISpot results (P > 0.11 in all cases).
The sensitivity of culture was 79% (CI, 73% to 85%) for confirmed and highly probable tuberculosis, which was lower than that of both ELISpot assays; this difference was significant for ELISpotPLUS (P = 0.005). Microscopy had a sensitivity of 39% (CI, 32% to 46%). Microbiological techniques had lower sensitivity in extrapulmonary disease than in pulmonary disease (culture, 53% [CI, 39% to 67%] vs. 89% [CI, 83% to 94%], respectively [P < 0.001]; microscopy, 14% (CI, 5.5% to 26%) vs. 49% (CI, 40% to 58%), respectively [P < 0.001]), whereas ELISpotPLUS had nonsignificantly higher sensitivity in extrapulmonary disease (94% [CI, 84% to 99%]) than in pulmonary disease (88% [CI, 81% to 93%]) (P = 0.19). Among patients with suspected pulmonary tuberculosis, the sensitivity of sputum microscopy with ELISpotPLUS was 94% (CI, 89% to 98%) for culture-confirmed and highly probable cases, generating a negative likelihood ratio of 0.10 and a negative predictive value of 90%, compared with a sensitivity of 78% (CI, 69% to 85%) for microscopy combined with tuberculin skin testing (P < 0.001).
Specificity of ELISpotPLUS was 69% (CI, 61% to 77%) for active disease in all category 4 patients, which was lower than the specificity of tuberculin skin testing (81% [CI, 73% to 87%]; P = 0.03). Although ELISpotPLUS gave more diagnostic negative likelihood ratios and negative predictive values than tuberculin skin testing, positive likelihood ratios and positive predictive values were somewhat lower, most likely because of detection of latent infection in category 4 patients; this finding is consistent with the 84% (CI, 60% to 97%) specificity of ELISpotPLUS calculated by using category 4D patients (who were considered least likely to have latent infection). The specificity of standard ELISpot was similar to that of ELISpotPLUS (Table 4). Three of 21 category 4D patients had false-positive results by standard ELISpot, and 3 of 19 had false-postive results by ELISpotPLUS. All 3 individuals who had false-positive ELISpotPLUS results were United Kingdom–born white persons with 0 mm of induration on the Mantoux test, and 2 were 75 years of age or older. Only 2 category 4D patients who were negative by standard ELISpot were positive to any of the new antigens; both responded to Rv3873 alone. Thus, inclusion of Rv3879c alone in ELISpotPLUS enhanced diagnostic sensitivity without compromising specificity.
Our comparison of the Heaf test and the Mantoux test with a 15-mm induration threshold for patients with culture-confirmed and highly probable cases of tuberculosis revealed a nonsignificant increase in sensitivity for the Heaf test (86% [CI, 74% to 82%] for the Heaf test vs. 76% [CI, 66% to 84%] for the Mantoux test; P = 0.14) and a higher specificity for the Mantoux test (66% [CI, 46% to 82%]) for the Heaf test vs. 85% [CI, 77% to 92%] for the Mantoux test; P = 0.02) (subgroup data provided on request). Receiver-operator characteristic analysis indicated that the area under the curve for both skin test formats was identical at 0.84. Subgroup analysis of combined use of standard ELISpot or ELISpotPLUS followed by Mantoux testing (for the 184 patients who received Mantoux testing) gave similar final likelihood ratios to those observed in the whole study population tested with Mantoux or Heaf methods (265 patients; subgroup data provided on request).
Overall, 4.7% of positive results on standard ELISpot or ELISpotPLUS were dependent on a single peptide pool response of 5 to 10 spot-forming cells per well. These results might be considered borderline positive.

Discussion

This prospective study has defined a role for T-cell–based interferon-γ release assay testing in the diagnostic evaluation of patients with suspected tuberculosis. The 89% sensitivity of ELISpotPLUS for a diagnosis of culture-confirmed or highly probable tuberculosis was higher than that of the standard ELISpot, tuberculin skin testing, and culture. The combined sensitivity of ELISpotPLUS and tuberculin skin testing in confirmed and highly probable cases was 99%.
The negative likelihood ratio of 0.15 with ELISpotPLUS means that a negative result would reduce the odds of tuberculosis by 6.5-fold, which allows it to be used as a rule-out test in patients with a moderate or low pretest probability of tuberculosis. Given the high pretest probability of tuberculosis (0.50) in our patient population (patients attending urban infectious disease units), the negative predictive value of ELISpotPLUS alone was modest at 83%. However, the 99% combined sensitivity of tuberculin skin testing and ELISpotPLUS and the corresponding negative likelihood ratio of 0.02 allow the combined use of these assays as a rule-out test for tuberculosis, even in populations with high pretest probabilities, such as our study sample. Pretest probabilities in other settings, such as general medical or primary care clinics in low-prevalence countries, will be much lower, and the negative predictive value of ELISpotPLUS, alone or in combination with skin testing, will be correspondingly higher. The higher sensitivity of ELISpotPLUS compared with standard ELISpot was entirely attributable to the addition of 1 antigen, Rv3879c (to which Rv3873 and Rv3878 provided no further incremental sensitivity), which supports inclusion of Rv3879c in T-cell–based interferon-γ release assays.
Analysis of tuberculin skin testing using the lower 10-mm induration threshold in patients not vaccinated with bacille Calmette–Guérin showed a nonsignificant increase in sensitivity and decrease in specificity. Whereas ELISpotPLUS was not significantly more sensitive than skin testing with the stratified 10-mm threshold in patients with confirmed and highly probable tuberculosis, it was significantly more sensitive in the patients with culture-confirmed disease. This is probably because the diagnosis of highly probable tuberculosis was based in part on skin test results, which biases results in favor of the skin test.
Our results are probably generalizable to clinical units evaluating patients with suspected tuberculosis in other low-prevalence countries because we performed our study in routine clinical practice and included a wide spectrum of clinical cases and alternative diagnoses (36, 37). This may also account for the lower sensitivity of standard ELISpot in our study compared with earlier, smaller studies of more selected patient groups (16, 18, 38). Because our population comprised relatively few immunocompromised patients, our results cannot be generalized to populations with a higher prevalence of HIV co-infection, although previous studies of larger numbers of patients with tuberculosis who were co-infected with HIV suggest that ELISpot has high sensitivity in this group (25, 28). Our study population was predominantly South Asian and black; further studies are required in other ethnic groups. Results will be less generalizable outside low-prevalence countries, because the utility of ELISpot in endemic regions will be limited by higher background rates of latent tuberculosis (29, 39). This reduces the utility of a positive result; however, negative results (although proportionally fewer) would still be useful to rule out a diagnosis of tuberculosis (8, 25, 40).
Any T-cell–based test with a high sensitivity for M. tuberculosis infection will detect latent infection in patients who are suspected of having tuberculosis but in whom active tuberculosis has been excluded. Because our study population predominantly comprised patients with suspected tuberculosis from ethnic groups with a high prevalence of tuberculosis and latent tuberculosis, patients without active tuberculosis had a much higher risk for latent infection than would healthy control patients selected for very low risk for infection. This explains the 66% to 86% specificities of ELISpot and tuberculin skin testing when used as markers of active tuberculosis. Hence, when used to support a diagnosis of active tuberculosis, immune-based tests of infection should be interpreted in the context of the overall clinical picture and diagnostic work-up (40), as is recognized for tuberculin skin testing.
Given that culture remains the diagnostic gold standard and is required for identifying drug resistance, we believe our findings will have the following effects on clinical decision making. First, a negative ELISpotPLUS result can assist in excluding tuberculosis when the pretest probability is low-to-moderate. When pretest probabilities are higher, combined use of ELISpotPLUS and tuberculin skin testing excludes tuberculosis with a greater degree of certainty (Figure 2). The likelihood ratio of 0.02 to 0.04 refines a pretest probability of 50% to a posttest probability of approximately 2% (41) in patients with double-negative results, who constituted more than one quarter of those tested in our study. Conversely, a positive ELISpotPLUS (or standard ELISpot) result with a corresponding likelihood ratio of 2.8 is of limited value. However, in patients with positive results on both ELISpot and the tuberculin skin test, who constituted nearly one half of those tested, the corresponding likelihood ratio of 5.5 increased the probability of active tuberculosis by approximately 30% (41). Thus, double-positive results may help guide decisions about early initiation of presumptive treatment in severe disease while awaiting culture results and in extrapulmonary disease, in which culture is frequently negative. Combined testing also generates some discordant results (Figure 2). In these cases, which amounted to one quarter of persons tested, the near-unity likelihood ratios do not alter pretest probabilities and do not contribute to the diagnostic work-up.
The rate of indeterminate ELISpot results in our study was similar to the 3% to 4% rates observed in other studies (42, 43) and less than the 11% to 21% rates observed with whole-blood ELISA in routine practice (42, 44). Indeterminate ELISA results are associated with immunosuppressive therapies or conditions (42, 44), but no such association was seen for ELISpot in this or other studies (25, 42, 43, 45, 46). Moreover, the proportion of patients with tuberculosis was no higher among those with indeterminate results. As expected, false-negative skin test results were associated with factors known to cause anergy or progression to active disease. These factors did not confound the ELISpot results, consistent with previous findings (10, 15, 42).
The 99% combined sensitivity of tuberculin skin testing and ELISpot reflects the fact that patients who had a false-negative result on one test were distinct from those who had a false-negative result on the other. This implies that distinct immunologic processes underlie failure of these different, yet complementary, immune-based tests.
The main weakness of our study arises from the problem of differing standards for tuberculin skin testing. Standards vary worldwide, differing by type of tuberculin, production standards, method of administration, dose, and skin test cutoff points (13, 23, 24, 31, 35, 47). Where possible, we used a 10–tuberculin unit PPD–Siebert Mantoux test (in accordance with the United Kingdom standard at the time) and corresponding cutoff points for induration. In one quarter of patients, a Heaf test was used for logistical reasons. When standard thresholds for Mantoux test equivalence were used (23, 24), the Heaf test showed a nonsignificant increase in diagnostic sensitivity and a significant decrease in specificity relative to the Mantoux test. Subgroup analysis of patients who had Mantoux testing showed that conclusions for combined testing with ELISpot or ELISpotPLUS followed by Mantoux testing were similar to those for the study population as a whole. Parallel testing with the alternative whole-blood ELISA T-cell–based interferon-γ release assay would have been of interest, but neither this test nor the T-SPOT.TB (which is based on the standard ELISpot used here) was available when our study began. The modest sample size, limited number of immunocompromised patients, and lack of a definitive gold standard are also limitations of our study. Because many patients with tuberculosis are culture-negative (48), a microbiological gold standard used alone is too insensitive to evaluate new diagnostic tests. We therefore included highly probable cases in our composite reference standard, which better reflects the clinically relevant population, and our sensitivity analysis confirmed that estimates based on the composite reference standard were similar to those based on the microbiological reference standard. Finally, because this is only the second study to evaluate Rv3879c (21) and the first prospective study, further validation of its incremental sensitivity is required.
In summary, we found that ELISpotPLUS was a sensitive and clinically useful diagnostic test for evaluation of patients with suspected tuberculosis. Incorporation of a novel antigen, Rv3879c, conferred improved sensitivity over standard ELISpot. Combined use of tuberculin skin testing with either ELISpotPLUS or ELISpot enabled rapid exclusion of tuberculosis in patients with moderate to high probability of infection.

References

  1. The STOP TB Partnership. The global plan to stop TB, 2006–2015. Geneva: World Health Organization; 2006. Acessed at www.who.int/tb/publications/global_plan_to_stop_tb/en/ on 2 January 2008.
  2. Schluger
    NW
    ,  
    Perez
    D
    ,  
    Liu
    YM
    .  
    Reconstitution of immune responses to tuberculosis in patients with HIV infection who receive antiretroviral therapy.
    Chest
    2002
    122
    597
    602
     PubMed
    CrossRef
     PubMed
  3. Steingart
    KR
    ,  
    Henry
    M
    ,  
    Ng
    V
    ,  
    Hopewell
    PC
    ,  
    Ramsay
    A
    ,  
    Cunningham
    J
    ,  
    et al
    Fluorescence versus conventional sputum smear microscopy for tuberculosis: a systematic review.
    Lancet Infect Dis
    2006
    6
    570
    81
     PubMed
    CrossRef
     PubMed
  4. Dinnes
    J
    ,  
    Deeks
    J
    ,  
    Kunst
    H
    ,  
    Gibson
    A
    ,  
    Cummins
    E
    ,  
    Waugh
    N
    ,  
    et al
    A systematic review of rapid diagnostic tests for the detection of tuberculosis infection.
    Health Technol Assess
    2007
    11
    1
    196
     PubMed
    CrossRef
     PubMed
  5. Huebner
    RE
    ,  
    Schein
    MF
    ,  
    Bass
    JB
    Jr
    .  
    The tuberculin skin test.
    Clin Infect Dis
    1993
    17
    968
    75
     PubMed
    CrossRef
     PubMed
  6. Menzies
    D
    .  
    Interpretation of repeated tuberculin tests. Boosting, conversion, and reversion.
    Am J Respir Crit Care Med
    1999
    159
    15
    21
     PubMed
    CrossRef
     PubMed
  7. Menzies
    D
    ,  
    Pai
    M
    ,  
    Comstock
    G
    .  
    Meta-analysis: new tests for the diagnosis of latent tuberculosis infection: areas of uncertainty and recommendations for research.
    Ann Intern Med
    2007
    146
    340
    54
    CrossRef
     PubMed
  8. Lalvani
    A
    .  
    Diagnosing tuberculosis infection in the 21st century: new tools to tackle an old enemy.
    Chest
    2007
    131
    1898
    906
     PubMed
    CrossRef
     PubMed
  9. Pai
    M
    ,  
    Riley
    LW
    ,  
    Colford
    JM
    Jr
    .  
    Interferon-gamma assays in the immunodiagnosis of tuberculosis: a systematic review.
    Lancet Infect Dis
    2004
    4
    761
    76
     PubMed
    CrossRef
     PubMed
  10. Richeldi
    L
    .  
    An update on the diagnosis of tuberculosis infection.
    Am J Respir Crit Care Med
    2006
    174
    736
    42
     PubMed
    CrossRef
     PubMed
  11. Behr
    MA
    ,  
    Wilson
    MA
    ,  
    Gill
    WP
    ,  
    Salamon
    H
    ,  
    Schoolnik
    GK
    ,  
    Rane
    S
    ,  
    et al
    Comparative genomics of BCG vaccines by whole-genome DNA microarray.
    Science
    1999
    284
    1520
    3
     PubMed
    CrossRef
     PubMed
  12. Richeldi
    L
    ,  
    Ewer
    K
    ,  
    Losi
    M
    ,  
    Roversi
    P
    ,  
    Fabbri
    LM
    ,  
    Lalvani
    A
    .  
    Repeated tuberculin testing does not induce false positive ELISPOT results [Letter].
    Thorax
    2006
    61
    180
     PubMed
    CrossRef
     PubMed
  13. Mori
    T
    ,  
    Sakatani
    M
    ,  
    Yamagishi
    F
    ,  
    Takashima
    T
    ,  
    Kawabe
    Y
    ,  
    Nagao
    K
    ,  
    et al
    Specific detection of tuberculosis infection: an interferon-gamma-based assay using new antigens.
    Am J Respir Crit Care Med
    2004
    170
    59
    64
     PubMed
    CrossRef
     PubMed
  14. Arend
    SM
    ,  
    Thijsen
    SF
    ,  
    Leyten
    EM
    ,  
    Bouwman
    JJ
    ,  
    Franken
    WP
    ,  
    Koster
    BF
    ,  
    et al
    Comparison of two interferon-gamma assays and tuberculin skin test for tracing tuberculosis contacts.
    Am J Respir Crit Care Med
    2007
    175
    618
    27
     PubMed
    CrossRef
     PubMed
  15. Lalvani
    A
    ,  
    Pathan
    AA
    ,  
    Durkan
    H
    ,  
    Wilkinson
    KA
    ,  
    Whelan
    A
    ,  
    Deeks
    JJ
    ,  
    et al
    Enhanced contact tracing and spatial tracking of Mycobacterium tuberculosis infection by enumeration of antigen-specific T cells.
    Lancet
    2001
    357
    2017
    21
     PubMed
    CrossRef
     PubMed
  16. Lalvani
    A
    ,  
    Pathan
    AA
    ,  
    McShane
    H
    ,  
    Wilkinson
    RJ
    ,  
    Latif
    M
    ,  
    Conlon
    CP
    ,  
    et al
    Rapid detection of Mycobacterium tuberculosis infection by enumeration of antigen-specific T cells.
    Am J Respir Crit Care Med
    2001
    163
    824
    8
     PubMed
    CrossRef
     PubMed
  17. Ewer
    K
    ,  
    Deeks
    J
    ,  
    Alvarez
    L
    ,  
    Bryant
    G
    ,  
    Waller
    S
    ,  
    Andersen
    P
    ,  
    et al
    Comparison of T-cell-based assay with tuberculin skin test for diagnosis of Mycobacterium tuberculosis infection in a school tuberculosis outbreak.
    Lancet
    2003
    361
    1168
    73
     PubMed
    CrossRef
     PubMed
  18. Meier
    T
    ,  
    Eulenbruch
    HP
    ,  
    Wrighton-Smith
    P
    ,  
    Enders
    G
    ,  
    Regnath
    T
    .  
    Sensitivity of a new commercial enzyme-linked immunospot assay (T SPOT-TB) for diagnosis of tuberculosis in clinical practice.
    Eur J Clin Microbiol Infect Dis
    2005
    24
    529
    36
     PubMed
    CrossRef
     PubMed
  19. Mazurek
    GH
    ,  
    Jereb
    J
    ,  
    Lobue
    P
    ,  
    Iademarco
    MF
    ,  
    Metchock
    B
    ,  
    Vernon
    A
    .  
    Division of Tuberculosis Elimination
    National Center for HIV, STD, and TB Prevention
    Centers for Disease Control and Prevention (CDC)
    Guidelines for using the QuantiFERON-TB Gold test for detecting Mycobacterium tuberculosis infection, United States.
    MMWR Recomm Rep
    2005
    54
    49
    55
     PubMed
     PubMed
  20. National Collaborating Centre for Chronic Conditions
    Tuberculosis: clinical diagnosis and management of tuberculosis, and measures for its prevention and control.
    London
    Royal Coll of Physicians
    2006
  21. Liu
    XQ
    ,  
    Dosanjh
    D
    ,  
    Varia
    H
    ,  
    Ewer
    K
    ,  
    Cockle
    P
    ,  
    Pasvol
    G
    ,  
    et al
    Evaluation of T-cell responses to novel RD1- and RD2-encoded Mycobacterium tuberculosis gene products for specific detection of human tuberculosis infection.
    Infect Immun
    2004
    72
    2574
    81
     PubMed
    CrossRef
     PubMed
  22. Rose
    AM
    ,  
    Watson
    JM
    ,  
    Graham
    C
    ,  
    Nunn
    AJ
    ,  
    Drobniewski
    F
    ,  
    Ormerod
    LP
    ,  
    et al
    Public Health Laboratory Service/British Thoracic Society/Department of Health Collaborative Group
    Tuberculosis at the end of the 20th century in England and Wales: results of a national survey in 1998.
    Thorax
    2001
    56
    173
    9
     PubMed
    CrossRef
     PubMed
  23. Control and prevention of tuberculosis in the United Kingdom: code of practice 2000. Joint Tuberculosis Committee of the British Thoracic Society.
    Thorax
    2000
    55
    887
    901
     PubMed
    CrossRef
     PubMed
  24. Department of Health
    Immunisation against infectious disease.
    London
    HMSO
    1996
  25. Liebeschuetz
    S
    ,  
    Bamber
    S
    ,  
    Ewer
    K
    ,  
    Deeks
    J
    ,  
    Pathan
    AA
    ,  
    Lalvani
    A
    .  
    Diagnosis of tuberculosis in South African children with a T-cell-based assay: a prospective cohort study.
    Lancet
    2004
    364
    2196
    203
     PubMed
    CrossRef
     PubMed
  26. Pathan
    AA
    ,  
    Wilkinson
    KA
    ,  
    Klenerman
    P
    ,  
    McShane
    H
    ,  
    Davidson
    RN
    ,  
    Pasvol
    G
    ,  
    et al
    Direct ex vivo analysis of antigen-specific IFN-gamma-secreting CD4 T cells in Mycobacterium tuberculosis-infected individuals: associations with clinical disease state and effect of treatment.
    J Immunol
    2001
    167
    5217
    25
     PubMed
    CrossRef
     PubMed
  27. Soysal
    A
    ,  
    Millington
    KA
    ,  
    Bakir
    M
    ,  
    Dosanjh
    D
    ,  
    Aslan
    Y
    ,  
    Deeks
    JJ
    ,  
    et al
    Effect of BCG vaccination on risk of Mycobacterium tuberculosis infection in children with household tuberculosis contact: a prospective community-based study.
    Lancet
    2005
    366
    1443
    51
     PubMed
    CrossRef
     PubMed
  28. Chapman
    AL
    ,  
    Munkanta
    M
    ,  
    Wilkinson
    KA
    ,  
    Pathan
    AA
    ,  
    Ewer
    K
    ,  
    Ayles
    H
    ,  
    et al
    Rapid detection of active and latent tuberculosis infection in HIV-positive individuals by enumeration of Mycobacterium tuberculosis-specific T cells.
    AIDS
    2002
    16
    2285
    93
     PubMed
    CrossRef
     PubMed
  29. Lalvani
    A
    ,  
    Nagvenkar
    P
    ,  
    Udwadia
    Z
    ,  
    Pathan
    AA
    ,  
    Wilkinson
    KA
    ,  
    Shastri
    JS
    ,  
    et al
    Enumeration of T cells specific for RD1-encoded antigens suggests a high prevalence of latent Mycobacterium tuberculosis infection in healthy urban Indians.
    J Infect Dis
    2001
    183
    469
    77
     PubMed
    CrossRef
     PubMed
  30. Richeldi
    L
    ,  
    Ewer
    K
    ,  
    Losi
    M
    ,  
    Bergamini
    BM
    ,  
    Roversi
    P
    ,  
    Deeks
    J
    ,  
    et al
    T cell-based tracking of multidrug resistant tuberculosis infection after brief exposure.
    Am J Respir Crit Care Med
    2004
    170
    288
    95
     PubMed
    CrossRef
     PubMed
  31. Diagnostic Standards and Classification of Tuberculosis in Adults and Children. This official statement of the American Thoracic Society and the Centers for Disease Control and Prevention was adopted by the ATS Board of Directors, July 1999. This statement was endorsed by the Council of the Infectious Disease Society of America, September 1999.
    Am J Respir Crit Care Med
    2000
    161
    1376
    95
     PubMed
    CrossRef
     PubMed
  32. Chan
    SF
    ,  
    Deeks
    JJ
    ,  
    Macaskill
    P
    ,  
    Irwig
    L
    .  
    Three methods to construct predictive models using logistic regression and likelihood ratios to facilitate adjustment for pretest probability give similar results.
    J Clin Epidemiol
    2008
    61
    52
    63
     PubMed
    CrossRef
     PubMed
  33. Knottnerus
    JA
    .  
    Application of logistic regression to the analysis of diagnostic data: exact modeling of a probability tree of multiple binary variables.
    Med Decis Making
    1992
    12
    93
    108
     PubMed
    CrossRef
     PubMed
  34. Albert
    A
    .  
    On the use and computation of likelihood ratios in clinical chemistry.
    Clin Chem
    1982
    28
    1113
    9
     PubMed
     PubMed
  35. Targeted tuberculin testing and treatment of latent tuberculosis infection. This official statement of the American Thoracic Society was adopted by the ATS Board of Directors, July 1999. This is a Joint Statement of the American Thoracic Society (ATS) and the Centers for Disease Control and Prevention (CDC). This statement was endorsed by the Council of the Infectious Diseases Society of America. (IDSA), September 1999, and the sections of this statement.
    Am J Respir Crit Care Med
    2000
    161
    S221
    47
     PubMed
    CrossRef
     PubMed
  36. Jaeschke
    R
    ,  
    Guyatt
    GH
    ,  
    Sackett
    DL
    .  
    Users' guides to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients? The Evidence-Based Medicine Working Group.
    JAMA
    1994
    271
    703
    7
     PubMed
    CrossRef
     PubMed
  37. Small
    PM
    ,  
    Perkins
    MD
    .  
    More rigour needed in trials of new diagnostic agents for tuberculosis.
    Lancet
    2000
    356
    1048
    9
     PubMed
    CrossRef
     PubMed
  38. Lee
    JY
    ,  
    Choi
    HJ
    ,  
    Park
    IN
    ,  
    Hong
    SB
    ,  
    Oh
    YM
    ,  
    Lim
    CM
    ,  
    et al
    Comparison of two commercial interferon-gamma assays for diagnosing Mycobacterium tuberculosis infection.
    Eur Respir J
    2006
    28
    24
    30
     PubMed
    CrossRef
     PubMed
  39. Kang
    YA
    ,  
    Lee
    HW
    ,  
    Hwang
    SS
    ,  
    Um
    SW
    ,  
    Han
    SK
    ,  
    Shim
    YS
    ,  
    et al
    Usefulness of whole-blood interferon-gamma assay and interferon-gamma enzyme-linked immunospot assay in the diagnosis of active pulmonary tuberculosis.
    Chest
    2007
    132
    959
    65
     PubMed
    CrossRef
     PubMed
  40. Barnes
    PF
    .  
    Diagnosing latent tuberculosis infection: the 100-year upgrade [Editorial].
    Am J Respir Crit Care Med
    2001
    163
    807
    8
     PubMed
    CrossRef
     PubMed
  41. Grimes
    DA
    ,  
    Schulz
    KF
    .  
    Refining clinical diagnosis with likelihood ratios.
    Lancet
    2005
    365
    1500
    5
     PubMed
    CrossRef
     PubMed
  42. Ferrara
    G
    ,  
    Losi
    M
    ,  
    D'Amico
    R
    ,  
    Roversi
    P
    ,  
    Piro
    R
    ,  
    Meacci
    M
    ,  
    et al
    Use in routine clinical practice of two commercial blood tests for diagnosis of infection with Mycobacterium tuberculosis: a prospective study.
    Lancet
    2006
    367
    1328
    34
     PubMed
    CrossRef
     PubMed
  43. Piana
    F
    ,  
    Codecasa
    LR
    ,  
    Cavallerio
    P
    ,  
    Ferrarese
    M
    ,  
    Migliori
    GB
    ,  
    Barbarano
    L
    ,  
    et al
    Use of a T-cell-based test for detection of tuberculosis infection among immunocompromised patients.
    Eur Respir J
    2006
    28
    31
    4
     PubMed
    CrossRef
     PubMed
  44. Ferrara
    G
    ,  
    Losi
    M
    ,  
    Meacci
    M
    ,  
    Meccugni
    B
    ,  
    Piro
    R
    ,  
    Roversi
    P
    ,  
    et al
    Routine hospital use of a new commercial whole blood interferon-gamma assay for the diagnosis of tuberculosis infection.
    Am J Respir Crit Care Med
    2005
    172
    631
    5
     PubMed
    CrossRef
     PubMed
  45. Dheda
    K
    ,  
    Lalvani
    A
    ,  
    Miller
    RF
    ,  
    Scott
    G
    ,  
    Booth
    H
    ,  
    Johnson
    MA
    ,  
    et al
    Performance of a T-cell-based diagnostic test for tuberculosis infection in HIV-infected individuals is independent of CD4 cell count.
    AIDS
    2005
    19
    2038
    41
     PubMed
    CrossRef
     PubMed
  46. Piana F, Codecasa LR, Besozzi G, Migliori GB, Cirillo DM. Use of commercial interferon-gamma assays in immunocompromised patients for tuberculosis diagnosis [Letter]. Am J Respir Crit Care Med. 2006;173:130; author reply 130-1. [PMID: 16368794]
  47. Lee
    E
    ,  
    Holzman
    RS
    .  
    Evolution and current use of the tuberculin test.
    Clin Infect Dis
    2002
    34
    365
    70
     PubMed
    CrossRef
     PubMed
  48. Thwaites
    GE
    ,  
    Chau
    TT
    ,  
    Stepniewska
    K
    ,  
    Phu
    NH
    ,  
    Chuong
    LV
    ,  
    Sinh
    DX
    ,  
    et al
    Diagnosis of adult tuberculous meningitis by use of clinical and laboratory features.
    Lancet
    2002
    360
    1287
    92
     PubMed
    CrossRef
     PubMed
Figure 1.

Study flow diagram.

ELISpot = enzyme-linked immunospot assay incorporating early secretory antigenic target-6 and culture filtrate protein-10; ELISpotPLUS = enzyme-linked immunospot assay incorporating early secretory antigenic target-6, culture filtrate protein-10, and Rv3879c; TB = tuberculosis; TST= tuberculin skin testing. *Results were indeterminate because of no achievement of positive control (11 patients), high background (1 patient), peptide contamination (1 patient), inconclusive assay (1 patient), or defective ELISpot plate (1 patient). †Results were not available because of history of TB (clinically contraindicated) (45 patients), patient did not return for reading (8 patients), result not recorded (8 patients), reason unknown (3 patients), death (1 patient), test performed elsewhere (1 patient), or patient declined consent (1 patient). ‡Tuberculin skin test results were based on a 15-mm cutoff point and considered positive if induration was ≥15 mm on the Mantoux test or grade 3 to 4 on the Heaf test regardless of bacille Calmette–Guérin vaccination status.

Appendix Figure 1.

Study flow diagram, stratified by final diagnosis and then by test result.

These are the same data shown in Figure 1 but displayed in a different manner to allow scrutiny of the entire raw data set. ELISpot = enzyme-linked immunospot assay incorporating early secretory antigenic target-6 and culture filtrate protein-10; ELISpotPLUS = enzyme-linked immunospot assay incorporating early secretory antigenic target-6, culture filtrate protein-10, and Rv3879c; TB = tuberculosis; TST= tuberculin skin testing. *Results were not available because of history of TB (clinically contraindicated) (45 patients), patient did not return for reading (8 patients), result not recorded (8 patients), reason unknown (3 patients), death (1 patient), test performed elsewhere (1 patient), or patient declined consent (1 patient). †Tuberculin skin test results were based on a 15-mm cutoff point and considered positive if induration was ≥15 mm on the Mantoux test or grade 3 to 4 on the Heaf test regardless of bacille Calmette–Guérin vaccination status. ‡Results were indeterminate because of no achievement of positive control (11 patients), high background (1 patient), peptide contamination (1 patient), inconclusive assay (1 patient), or defective ELISpot plate (1 patient).

Figure 2.

Likelihood ratios, sensitivities, and specificities of tests used in combination, using ELISpot or ELISpotPLUS first.

Data are for patients in whom results on both tests were available (n = 265). Except where stated, values are likelihood ratios with 95% CIs. Tuberculin skin test thresholds for positivity were induration ≥15 mm on the Mantoux test or grade 3 to 4 on the Heaf test. ELISpot = enzyme-linked immunospot incorporating early secretory antigenic target-6 and culture filtrate protein-10; ELISpotPLUS = enzyme-linked immunospot incorporating early secretory antigenic target-6, culture filtrate protein-10, and Rv3879c; TB = tuberculosis; TST = tuberculin skin testing. Top. ELISpot followed by TST. *Combined sensitivity of 1 or more positive results from tests used in combination, 97% (CI, 93% to 99%). †Combined specificity for a double-negative result from tests used in combination, 62% (CI, 53% to 71%). Bottom. ELISpotPLUS followed by TST. ‡Combined sensitivity of 1 or more positive results from tests used in combination, 99% (CI, 95% to 100%). §Combined specificity for a double-negative result from tests used in combination, 61% (CI, 52% to 70%).

Appendix Figure 2.

Likelihood ratios, sensitivities, and specificities of tests used in combination for diagnostic evaluation, using tuberculin skin testing (TST) as the first test.

Data are for patients in whom results on both tests were available (n = 265). Except where stated, numbers are likelihood ratios with 95% CIs. Tuberculin skin test thresholds for positivity were induration ≥15 mm on the Mantoux test or grade 3 to 4 on the Heaf test. ELISpot = enzyme-linked immunospot incorporating early secretory antigenic target-6 and culture filtrate protein-10; ELISpotPLUS = enzyme-linked immunospot incorporating early secretory antigenic target-6, culture filtrate protein-10, and Rv3879c; TB = tuberculosis. Top. TST followed by ELISpot. *Combined sensitivity of 1 or more positive results from tests used in combination, 97% (CI, 93% to 99%). †Combined specificity for a double-negative result from tests used in combination, 62% (CI, 53% to 71%). Bottom. TST followed by ELISpotPLUS. ‡Combined sensitivity of 1 or more positive results from tests used in combination, 99% (CI, 95% to 100%). §Combined specificity for a double-negative result from tests used in combination, 61% (CI, 52% to 70%).

Table 1. Categorization of the Study Population

Table 1. Categorization of the Study Population

Table 2. Participant Characteristics

Table 2. Participant Characteristics

Table 3. Final Diagnoses of Study Participants

Table 3. Final Diagnoses of Study Participants

Table 4. Accuracy for the Diagnosis of Active Tuberculosis

Table 4. Accuracy for the Diagnosis of Active Tuberculosis

Clinical Slide Sets

Terms of Use

The In the Clinic® slide sets are owned and copyrighted by the American College of Physicians (ACP). All text, graphics, trademarks, and other intellectual property incorporated into the slide sets remain the sole and exclusive property of the ACP. The slide sets may be used only by the person who downloads or purchases them and only for the purpose of presenting them during not-for-profit educational activities. Users may incorporate the entire slide set or selected individual slides into their own teaching presentations but may not alter the content of the slides in any way or remove the ACP copyright notice. Users may make print copies for use as hand-outs for the audience the user is personally addressing but may not otherwise reproduce or distribute the slides by any means or media, including but not limited to sending them as e-mail attachments, posting them on Internet or Intranet sites, publishing them in meeting proceedings, or making them available for sale or distribution in any unauthorized form, without the express written permission of the ACP. Unauthorized use of the In the Clinic slide sets will constitute copyright infringement.

This feature is available only to Registered Users

Subscribe/Learn More
Submit a Comment

3 Comments

Liu Hong

Institute of Digestive Diseases, Xijing Hospital, Fourth Military Medical University

March 15, 2008

The application strategy of tuberculin skin testing, ELISpotPLUS and ELISpot

To the editor:

We read with interest the article by Dosanjh and colleagues (1). They clearly show that ELISpotPLUS is a sensitive and clinically useful diagnostic test for evaluation of patients with suspected tuberculosis. However, they don¡¯t show the cost effectiveness of ELISpotPLUS versus tuberculin skin testing and ELISpot. Clinicians will need to know which assay is recommended for wide clinical application. Could the authors comment on the application strategy of the three assays, including separate application and combined application?

This study is based on the participants predominantly in South Asian and black ethnicity, so the results may not be applicable for all patients with suspected tuberculosis. Will incorporation of Rv3879c improve sensitivity over standard ELISpot for all patients? Could the authors comment on the potential effect of epigenetic inheritance on the roles of Rv3879c, which is regulated by a special molecular network? So it is indispensable to ask whether the molecular network involve other important antigens for the clinical diagnostic evaluation of suspected tuberculosis.

References:

1. Dosanjh DP, Hinks TS, Innes JA, et al. Improved Diagnostic Evaluation of Suspected Tuberculosis. Ann Intern Med. 2008 Mar 4;148(5):325-36.

Conflict of Interest:

None declared

David M. Brett-Major

Division of Infectious Diseases, National Naval Medical Center, Bethesda MD

March 17, 2008

No Title

No Comment

Ivan Landires

Institut Pasteur, UP Pathogénomique Mycobacterienne Integrée, Paris, France

April 2, 2008

Can IFN Gamma Release Assays Differentiate Between Active Tuberculosis and Sarcoidosis ?

Dear Editor,

We have read with great interest the recent article by Dosanjh and colleagues (1) who found that the ELISpotPLUS assay was a clinically useful diagnostic test for evaluation of patients with suspected tuberculosis. This assay uses an additional region of difference 1"“encoded antigen, Rv3879c, alongside early secretory antigenic target-6 (ESAT-6) and culture filtrate protein-10, which are all part of the recently identified, novel ESX-1 secretion system of Mycobacterium tuberculosis (2).

As mentioned in the editorial (3), the use of these tests for the diagnosis of active tuberculosis is based on the logic that one must have tuberculous infection in order to have tuberculosis disease. But, is the ELISpotPLUS assay able to establish a differential diagnosis between active tuberculosis and sarcoidosis? M. tuberculosis has been proposed as a candidate trigger for the development of sarcoidosis and several mycobacterial antigens have been recovered from sarcoidal tissue (4). Recent studies have detected Th-1 immune responses to M. tuberculosis ESAT -6 using the ELISpot assay in sarcoidosis patients (5). A diagnosis of sarcoidosis is firm when chest radiographic evidence is accompanied by compatible biopsy and characteristic clinical features, with all other causes of granulomas ruled out (4). For that reason it will be important to evaluate ELISpotPLUS responses to ESX-1 peptides in sarcoidosis patients and compare these findings with ELIspotPLUS results from patients with active tuberculosis. Overall, we suggest that this issue merits further investigation.

References.

1. Dosanjh DP, Hinks TS, Innes JA, Deeks JJ, Pasvol G, Hackforth S, et al. Improved diagnostic evaluation of suspected tuberculosis. Ann Intern Med. 2008; 148: 325-36.

2. Brodin P, Rosenkrands I, Andersen P, Cole ST, and Brosch R. ESAT-6 proteins: protective antigens and virulence factors? Trends Microbiol. 2004; 12:500-508.

3. Menzies D. Using tests for latent tuberculous infection to diagnose active tuberculosis: can we eat our cake and have it too? Ann Intern Med. 2008; 148: 325-36.

4. Iannuzzi MC, Rybicki BA, Teirstein AS. Sarcoidosis. N Engl J Med. 2007; 357: 2153-65.

5. Drake WP, Dhason MS, Nadaf M, Shepherd BE, Vadivelu S, Hajizadeh R, et al. Cellular recognition of Mycobacterium tuberculosis ESAT-6 and KatG peptides in systemic sarcoidosis. Infect Immun. 2007; 75: 527-30.

Conflict of Interest:

None declared

PDF
Not Available
Citations
Citation

Dosanjh DP, Hinks TS, Innes JA, et al. Improved Diagnostic Evaluation of Suspected Tuberculosis. Ann Intern Med. 2008;148:325–336. doi: https://doi.org/10.7326/0003-4819-148-5-200803040-00003

Download citation file:

  • Ris (Zotero)
  • EndNote
  • BibTex
  • Medlars
  • ProCite
  • RefWorks
  • Reference Manager

© 2019

×
Permissions

Published: Ann Intern Med. 2008;148(5):325-336.

DOI: 10.7326/0003-4819-148-5-200803040-00003

©
2008 American College of Physicians
116 Citations

See Also

Using Tests for Latent Tuberculous Infection to Diagnose Active Tuberculosis: Can We Eat Our Cake and Have It Too?
Correction: Improved Diagnostic Evaluation of Suspected Tuberculosis
View MoreView Less

Related Articles

Risk Factors for a Positive Tuberculin Skin Test among Employees of an Urban, Midwestern Teaching Hospital
Annals of Internal Medicine; 122 (8): 580-585
Annals for Educators - 21 November 2017
Annals of Internal Medicine; 167 (10): ED10
Efficacy of Control Measures in Preventing Nosocomial Transmission of Multidrug-Resistant Tuberculosis to Patients and Health Care Workers
Annals of Internal Medicine; 122 (2): 90-95
Prognostic Value of a T-Cell–Based, Interferon-γ Biomarker in Children with Tuberculosis Contact
Annals of Internal Medicine; 149 (11): 777-786
View MoreView Less

Journal Club

A model was sensitive but not specific for screening for tuberculosis in contact patients
Annals of Internal Medicine; 149 (8): JC4-15
Isoniazid prevented active tuberculosis in patients with HIV treated with antiretroviral therapy
Annals of Internal Medicine; 161 (6): JC12
Review: Xpert MTB/RIF assay detects extrapulmonary TB in lymph nodes and CSF, but not pleural fluid
Annals of Internal Medicine; 162 (4): JC11
View MoreView Less

Related Point of Care

Tuberculosis
Annals of Internal Medicine; 166 (3): ITC17-ITC32
Tuberculosis
Annals of Internal Medicine; 150 (11): ITC6-1
View MoreView Less

Related Topics

Infectious Disease
Mycobacterial Infections
Prevention/Screening

Infectious Disease, Mycobacterial Infections, Prevention/Screening.

PubMed Articles

Candida coinfection among patients with pulmonary tuberculosis in Asia and Africa; A systematic review and meta-analysis of cross-sectional studies.
Microb Pathog 2019.
Telemedicine Technologies and Tuberculosis Management: A Randomized Controlled Trial.
Telemed J E Health 2019.
View More

Results provided by: PubMed

CME/MOC Activity Requires Users to be Registered and Logged In.
Sign in below to access your subscription for full content
INDIVIDUAL SIGN IN
Sign In|Set Up Account
You will be directed to acponline.org to register and create your Annals account
Annals of Internal Medicine
CREATE YOUR FREE ACCOUNT
Create Your Free Account|Why?
To receive access to the full text of freely available articles, alerts, and more. You will be directed to acponline.org to complete your registration.
×
The Comments Feature Requires Users to be Registered and Logged In.
Sign in below to access your subscription for full content
INDIVIDUAL SIGN IN
Sign In|Set Up Account
You will be directed to acponline.org to register and create your Annals account
Annals of Internal Medicine
CREATE YOUR FREE ACCOUNT
Create Your Free Account|Why?
To receive access to the full text of freely available articles, alerts, and more. You will be directed to acponline.org to complete your registration.
×
link to top

Content

  • Home
  • Latest
  • Issues
  • Channels
  • CME/MOC
  • In the Clinic
  • Journal Club
  • Web Exclusives

Information For

  • Author Info
  • Reviewers
  • Press
  • Readers
  • Institutions / Libraries / Agencies
  • Advertisers

Services

  • Subscribe
  • Renew
  • Alerts
  • Current Issue RSS
  • Latest RSS
  • In the Clinic RSS
  • Reprints & Permissions
  • Contact Us
  • Help
  • About Annals
  • About Mobile
  • Patient Information
  • Teaching Tools
  • Annals in the News
  • Share Your Feedback

Awards and Cover

  • Personae (Cover Photo)
  • Junior Investigator Awards
  • Poetry Prize

Other Resources

  • ACP Online
  • Career Connection
  • ACP Advocate Blog
  • ACP Journal Wise

Follow Annals On

  • Twitter Link
  • Facebook Link
acp link acp
silverchair link silverchair

Copyright © 2019 American College of Physicians. All Rights Reserved.

Print ISSN: 0003-4819 | Online ISSN: 1539-3704

Privacy Policy

|

Conditions of Use

This site uses cookies. By continuing to use our website, you are agreeing to our privacy policy. | Accept
×

You need a subscription to this content to use this feature.

×
PDF Downloads Require Access to the Full Article.
Sign in below to access your subscription for full content
INDIVIDUAL SIGN IN
Sign In|Set Up Account
You will be directed to acponline.org to register and create your Annals account
INSTITUTIONAL SIGN IN
Open Athens|Shibboleth|Log In
Annals of Internal Medicine
PURCHASE OPTIONS
Buy This Article|Subscribe
You will be redirected to acponline.org to sign-in to Annals to complete your purchase.
CREATE YOUR FREE ACCOUNT
Create Your Free Account|Why?
To receive access to the full text of freely available articles, alerts, and more. You will be directed to acponline.org to complete your registration.
×
Access to this Free Content Requires Users to be Registered and Logged In. Please Choose One of the Following Options
Sign in below to access your subscription for full content
INDIVIDUAL SIGN IN
Sign In|Set Up Account
You will be directed to acponline.org to register and create your Annals account
Annals of Internal Medicine
CREATE YOUR FREE ACCOUNT
Create Your Free Account|Why?
To receive access to the full text of freely available articles, alerts, and more. You will be directed to acponline.org to complete your registration.
×