Improved Diagnostic Evaluation of Suspected Tuberculosis

Davinder P.S. Dosanjh; Timothy S.C. Hinks; John A. Innes; Jonathan J. Deeks; Geoffrey Pasvol; Sarah Hackforth; Hansa Varia; Kerry A. Millington; Rubamalar Gunatheesan; Valerie Guyot-Revol; Ajit Lalvani

doi:10.7326/0003-4819-148-5-200803040-00003

Articles |4 March 2008

Improved Diagnostic Evaluation of Suspected Tuberculosis Free

Davinder P.S. Dosanjh, DPhil; Timothy S.C. Hinks, MD; John A. Innes, MD; Jonathan J. Deeks, PhD; Geoffrey Pasvol, DPhil; Sarah Hackforth, RGN; Hansa Varia, RGN; Kerry A. Millington, DPhil; Rubamalar Gunatheesan, MD; Valerie Guyot-Revol, PhD; Ajit Lalvani, DM

Davinder P.S. Dosanjh, DPhil

From Tuberculosis Immunology Group, Imperial College London, London; University of Oxford, Oxford; Birmingham Heartlands Hospital and University of Birmingham, Birmingham; and Northwick Park Hospital, Harrow, United Kingdom.

Timothy S.C. Hinks, MD

John A. Innes, MD

Jonathan J. Deeks, PhD

Geoffrey Pasvol, DPhil

Sarah Hackforth, RGN

Hansa Varia, RGN

Kerry A. Millington, DPhil

Rubamalar Gunatheesan, MD

Valerie Guyot-Revol, PhD

Ajit Lalvani, DM

Article, Author, and Disclosure Information

From Tuberculosis Immunology Group, Imperial College London, London; University of Oxford, Oxford; Birmingham Heartlands Hospital and University of Birmingham, Birmingham; and Northwick Park Hospital, Harrow, United Kingdom.
Note: Drs. Dosanjh and Hinks contributed equally to this work.
Acknowledgment: The authors thank the study participants; Sarah Gooding, for collection and processing of some samples; and Muhunthan Thillai, for critical appraisal and revision of the final manuscript.
Grant Support: By the Wellcome Trust (Dr. Lalvani is a Wellcome Senior Research Fellow in Clinical Science), the Sir Halley Stewart Trust (Dr. Dosanjh's studentship), a Wellcome Trust PhD Prize Studentship (Dr. Millington), and a United Kingdom Department of Health Senior Fellowship in Evidence Synthesis (Dr. Deeks).
Potential Financial Conflicts of Interest:Consultancies: A. Lalvani (Oxford Immunotec Ltd. [nonexecutive director from 2003 to 2007]). Honoraria: G. Pasvol (Transactions of the Royal Society of Tropical Medicine). Stock ownership or options (other than mutual funds): D.P.S. Dosanjh (Oxford Immunotec Ltd.), A Lalvani (Oxford Immunotec Ltd.), University of Oxford (Oxford Immunotech Ltd.). Patents received: A. Lalvani (T-cell–based diagnosis of tuberculous infection), University of Oxford (T-cell–based diagnosis of tuberculous infection). Patents pending: D.P.S. Dosanjh (T-cell–based diagnosis of tuberculous infection), A. Lalvani (T-cell–based diagnosis of tuberculous infection, University of Oxford (T-cell–based diagnosis of tuberculous infection).
Reproducible Research Statement: The analytic data set of all participants' diagnoses, tuberculin skin test results, ELISpot results, and ELISpot^PLUS results can be made available to academic investigators on request by written agreement.
Requests for Single Reprints: Ajit Lalvani, DM, Tuberculosis Immunology Group, Department of Respiratory Medicine, Faculty of Medicine, Imperial College London, St. Mary's Campus, Norfolk Place, London W2 1PG, United Kingdom; e-mail, a.lalvani@imperial.ac.uk.
Current Author Addresses: Dr. Dosanjh: University of Oxford Medical School, William Osler House, John Radcliffe Hospital, Oxford OX3 9DU, United Kingdom.
Dr. Hinks: Allergy, Inflammation, and Repair Group, Level D, Southampton General Hospital, Southampton SO16 6YD, United Kingdom.
Dr. Innes and Ms. Hackforth: Department of Infection & Tropical Medicine, Birmingham Heartlands Hospital, Bordsley Green East, Birmingham B9 5SS, United Kingdom.
Dr. Deeks: Department of Public Health and Epidemiology, University of Birmingham, Edgbaston, Birmingham B15 2TT, United Kingdom.
Dr. Pasvol and Ms. Varia: Department of Infection and Tropical Medicine, Northwick Park Hospital, Imperial College London, Watford Road, Harrow HA1 3UJ, United Kingdom.
Drs. Millington and Lalvani: Department of Respiratory Medicine, Imperial College London, St. Mary's Campus, Norfolk Place, London W2 1PG, United Kingdom.
Dr. Gunatheesan: University of Melbourne Medical School, Melbourne, Australia.
Dr. Guyot-Revol: Genopoietic, 1390 rue Centrale-Beynost, 01708 Miribel Cedex, France.
Author Contributions: Conception and design: J.A. Innes, A. Lalvani. Analysis and interpretation of the data: D.P.S. Dosanjh, T.S.C. Hinks, J.J. Deeks, K.A. Millington, A. Lalvani.
Drafting of the article: D.P.S. Dosanjh, T.S.C. Hinks, G. Pasvol, A. Lalvani.
Critical revision of the article for important intellectual content: D.P.S. Dosanjh, T.S.C. Hinks, J.A. Innes, J.J. Deeks, G. Pasvol, K.A. Millington, A. Lalvani.
Final approval of the article: D.P.S. Dosanjh, J.J. Deeks, G. Pasvol, V. Guyot-Revol, A. Lalvani.
Provision of study materials or patients: J.A. Innes, G. Pasvol, S. Hackforth, H. Varia, A. Lalvani.
Statistical expertise: D.P.S. Dosanjh, J.J. Deeks.
Obtaining of funding: A Lalvani.
Administrative, technical, or logistic support: D.P.S. Dosanjh, G. Pasvol, S. Hackforth, K.A. Millington, A. Lalvani.
Collection and assembly of data: D.P.S. Dosanjh, T.S.C. Hinks, S. Hackforth, K.A. Millington, V. Guyot-Revol.

Abstract

Background:

The role of new T-cell–based blood tests for tuberculosis in the diagnosis of active tuberculosis is unclear.

Objective:

To compare the performance of 2 interferon-γ assays and tuberculin skin testing in adults with suspected tuberculosis.

Design:

Prospective study conducted in routine practice.

Setting:

2 urban hospitals in the United Kingdom.

Patients:

389 adults, predominantly of South Asian and black ethnicity, with moderate to high clinical suspicion of active tuberculosis.

Intervention:

Tuberculin skin testing, the enzyme-linked immunospot assay (ELISpot) incorporating early secretory antigenic target-6 and culture filtrate protein-10 (standard ELISpot), and ELISpot incorporating a novel antigen, Rv3879c (ELISpot^PLUS) were performed during diagnostic assessment by independent persons who were blinded to results of the other test.

Measurements:

Sensitivity, specificity, predictive values, and likelihood ratios.

Results:

194 patients had a final diagnosis of active tuberculosis, of which 79% were culture-confirmed. Sensitivity for culture confirmed and highly probable tuberculosis was 89% (95% CI, 84% to 93%) with ELISpot^PLUS, 85% (CI, 79% to 90%) with standard ELISpot, 79% (CI, 72% to 85%) with 15-mm threshold tuberculin skin testing, and 83% (CI, 77% to 89%) with stratified thresholds of 15 and 10 mm in vaccinated and unvaccinated patients, respectively. The ELISpot^PLUS assay was more sensitive than tuberculin skin testing with 15-mm cutoff points (P = 0.01) but not with stratified cutoff points (P = 0.10). The ELISpot^PLUS assay had 4% higher diagnostic sensitivity than standard ELISpot (P = 0.02). Combined sensitivity of ELISpot^PLUS and tuberculin skin testing was 99% (CI, 95% to 100%), conferring a negative likelihood ratio of 0.02 (CI, 0 to 0.06) when both test results were negative.

Limitations:

Local standards for tuberculin skin testing differed from others used internationally. The study sample included few immunosuppressed patients.

Conclusion:

The ELISpot^PLUS assay is more sensitive than standard ELISpot and, when used in combination with tuberculin skin testing, enables rapid exclusion of active infection in patients with moderate to high pretest probability of tuberculosis.

Editors’ Notes

Context

Can new T-cell–based blood tests rule out active tuberculosis?

Contribution

In this study involving 389 adults with moderate to high suspicion of active tuberculosis, the sensitivity of a new T-cell–based enzyme-linked immunoassay (ELISpot^PLUS) was higher than that of 15-mm threshold tuberculin skin testing (89% vs. 79%) and similar to that of 10-mm threshold skin testing (83%) in unvaccinated patients for identifying culture-confirmed and highly probable tuberculosis. Patients with negative results on both ELISpot^PLUS and skin tests had a very low likelihood of tuberculosis (negative likelihood ratio, 0.02).

Implication

The ELISpot^PLUS assay, particularly when used in combination with tuberculin skin testing, can help exclude a diagnosis of active tuberculosis.

—The Editors

Improved diagnosis of tuberculosis is necessary to contain and reverse the rising global burden of this disease (1). The poor speed and sensitivity of existing diagnostic tools (2–4) cause delays in diagnosis and treatment of active tuberculosis, and diagnosis of extrapulmonary and paucibacillary forms is often especially challenging. Given that Mycobacterium tuberculosis infection is a prerequisite for active tuberculosis, reliable determination of infection status could accelerate diagnostic assessment by enabling rapid exclusion of tuberculosis. Recently developed T-cell–based interferon-γ release assays for tuberculosis may overcome some of the limitations of the tuberculin skin test (5–10). These immunoassays detect interferon-γ secreted by T cells in response to antigens encoded in the region of difference 1 of M. tuberculosis complex, a genomic segment absent from bacille Calmette–Guérin and most environmental mycobacteria (11). Test results are therefore not confounded by previous bacille Calmette–Guérin vaccination, conferring higher specificity than the tuberculin skin test (7–10). Moreover, results are available the next day and are unaffected by the boosting phenomenon (12).

The 2 types of T-cell–based interferon-γ release assay are whole-blood enzyme-linked immunosorbent assay (ELISA) and enzyme-linked immunospot assay (ELISpot). The whole-blood ELISA is available commercially as QuantiFERON-TB Gold and an “in-tube” variant, QuantiFERON-TB Gold In-tube (Cellestis, Carnegie, Australia) (13, 14). The ELISpot, developed by Lalvani and colleagues (15, 16), is available commercially as T-SPOT.TB (Oxford Immunotec, Abingdon, United Kingdom) (15–18). Recent U.S. and United Kingdom national guidelines (19, 20) recommend T-cell–based interferon-γ release assays for diagnosis of latent tuberculosis, but their clinical utility in evaluation of patients with suspected active tuberculosis is poorly defined.

We compared the performance characteristics of 2 assays and tuberculin skin testing individually and in combination for the diagnostic work-up of patients with suspected active tuberculosis. The standard ELISpot assay uses early secretory antigenic target-6 and culture filtrate protein-10, the same peptides as the 2 region of difference 1–encoded antigens included in T-SPOT.TB. The ELISpot^PLUS assay incorporates a novel region of difference 1–encoded antigen, Rv3879c, alongside early secretory antigenic target-6 and culture filtrate protein-10 (21).

Methods

Participants

One day each week from 12 July 2002 to 29 June 2005, we prospectively enrolled adults who presented to Heartlands Hospital, Birmingham, and Northwick Park Hospital, London, United Kingdom, with suspected tuberculosis. We invited patients 16 years of age or older to participate and provide written informed consent if their attending physician considered tuberculosis to be part of the differential diagnosis. We used no exclusion criteria. The Birmingham Heartlands Hospital, Harrow, and Oxford Clinical Research Ethics Committees granted ethical approval. Because the background prevalence of HIV is low in this population (22), we tested patients for HIV antibodies during diagnostic work-up only on the basis of clinical suspicion. We identified only 20 patients who were HIV antibody–positive.

Tuberculin Skin Testing

Tuberculin skin testing was performed as part of routine care, and experienced nurses read the results by using the Mantoux method with 0.1 mL (10 tuberculin units) of purified protein derivative (PPD)–Siebert (Evans Vaccines, Liverpool, United Kingdom). Intradermal inoculation was confirmed by the cutaneous appearance of peau d'orange. Induration was measured after 72 hours with a ruler and recorded in millimeters. Because PPD for Mantoux testing was unavailable for 10 months during the study period, 104 patients were tested by using the Heaf method, with the standard multiple puncture 6-needle disposable-head Heaf gun (Bignall Surgical Instruments, Littlehampton, United Kingdom) and concentrated PPD (100 000 tuberculin units/mL; Evans Vaccines). Heaf tests were read 1 week later, as recommended, and graded from 0 to 4. The nurses who performed and read skin tests were blinded to ELISpot results. We considered induration of 15 mm or greater on the Mantoux test or grade 3 or 4 on the Heaf test (which is considered equivalent to the 15-mm threshold [23, 24]) to be a positive result. We assessed bacille Calmette–Guérin vaccination status by history and, where present, by scar. We also assessed tuberculin skin test performance by using stratified cutoff points of 15 mm and 10 mm (grade 2 to 4 on the Heaf test) in vaccinated and unvaccinated patients, respectively (“stratified 10-mm threshold”) (23, 24).

The ELISpot Assay

Before or within 1 week of initiating therapy, we obtained a sample of 30 mL of heparinized blood and used 7.5 × 10⁶ peripheral blood mononuclear cells for ELISpot assays. We seeded precoated interferon-γ ELISpot plates (Mabtech AB, Stockholm, Sweden) with 2.5 × 10⁵ peripheral blood mononuclear cells per well (17). Duplicate wells contained no antigen (negative control) or phytohemagglutinin (positive control) (ICN Biomedical, Aurora, Ohio) at 5 µg/mL. A further 13 pairs of duplicate wells each contained 1 of 13 peptide pools, which incorporated 5 to 7 overlapping 15-mer peptides. The assay on which T-SPOT.TB is based, defined as standard ELISpot in this study, comprises 35 such peptides assembled into 6 pools and spanning the length of early secretory antigenic target-6 and culture filtrate protein-10. Forty-five peptides from selected regions of Rv3873, Rv3878, and Rv3879c (Research Genetics, Huntsville, Alabama) were assembled into 7 pools (21). The ELISpot^PLUS assay was defined as the 35 early secretory antigenic target-6 and culture filtrate protein-10 peptides, with 17 peptides from Rv3879c, assembled into 3 additional pools. The final concentration of each peptide was 10 µg/mL. After overnight incubation at 37 °C in 5% carbon dioxide, the plates were developed with preconjugated detector antibody (Mabtech AB) followed by chromogenic substrate (Moss, Pasadena, Maryland) (17). Spot-forming cells were counted by using an automated ELISpot reader (AID-GmbH, Strassberg, Germany). We predefined settings for the intensity and size of a counted spot and used the same settings throughout. We transferred mean readings from duplicate wells to a spreadsheet electronically and scored them as positive or negative by using a customized software program, ELISTAT (AID-GmbH). We scored responses as positive if test wells contained a mean of at least 5 spot-forming cells more than the mean of the negative control wells and were at least twice the mean of the negative control wells. This predefined cutoff point is the standard threshold used with our assay format in 9 studies including a total of 2506 participants (15–17, 25–30). Operators performing and reading the assays were blinded to tuberculin skin test results and personal identifiers. The ELISpot results were checked and countersigned before data entry by a scientist who did not perform the assays.

Diagnosis

Attending physicians performed diagnostic work-up as part of routine clinical practice, which was directed on a case-by-case basis by the patient's clinical presentation. Two research nurses collected clinical, radiologic, and microbiological data on standardized forms at recruitment, during follow-up, and at final case notes review. Two physicians who were blinded to all ELISpot data assigned each patient to 1 of 4 predefined diagnostic categories (Table 1), which are similar to those used in other studies (25). Category 4 inevitably included some patients with inactive or latent tuberculosis. To compensate for heterogeneity, we further classified patients in this category into 4 predefined subgroups, analogous to American Thoracic Society classes 4, 2, 1, and 0 (31), in decreasing likelihood of latent tuberculosis (Table 1). We stratified by radiologic evidence or history of previous tuberculosis, risk factors for latent infection, and skin test results.

Table 1. Categorization of the Study Population

Statistical Analysis

We calculated the sensitivity, specificity, likelihood ratios, and predictive values for each test and for sequences of 2 tests used in combination. Because the primary clinical utility of immune-based testing is to rule out tuberculosis, our predefined analytical plan focused primarily on sensitivities, negative likelihood ratios, and negative predictive values. We compared proportions by using Pearson chi-square and Fisher exact tests where sample sizes differed substantially (because of missing results for 1 of the tests). We compared the data from the ELISpot and ELISpot^PLUS tests by using the McNemar chi-square test, treating the data as paired and dropping the 6 individuals who did not have an ELISpot^PLUS result. We assumed that missing data were missing completely at random for our analyses, but we provide sufficient information for other analyses to be performed with different assumptions about reasons for missing data. Two-tailed P values are reported.

We calculated primary analyses of sensitivity, specificity, likelihood ratios, and predictive values by using categories 1 (culture-confirmed), 2 (highly probable), and 4 (active tuberculosis excluded) (Table 1). Category 3 (clinically indeterminate) cases were not included in the calculation of test performances. To investigate whether the inclusion of category 2 cases affected sensitivity, we calculated performance by using only categories 1 and 4, and to investigate whether the inclusion of categories 4A, 4B, and 4C (which included patients with latent and inactive tuberculosis) affected specificity, we calculated performance by using only categories 1, 2, and 4D (no risk factors for tuberculosis exposure).

We assessed the performance of combinations of the 2 tests by using logistic regression models. For this analysis, we necessarily restricted the data set to patients with results from both tests. Logistic regression models can be constructed in the same form as Bayesian updating (posttest odds = pretest odds × likelihood ratio) by including the log of the pretest odds of prevalence (a constant term of known value) as an offset in the model. The linear predictor then estimates log likelihood ratios rather than log odds ratios, but bootstrap methods are required to obtain valid CIs (32). We used model parameterizations from Knottnerus (33) to compute likelihood ratios for the additional diagnostic value of each test in a testing sequence, whereas we followed the recommendations of Albert (34) to obtain estimates of likelihood ratios for combinations of tests. We computed nonparametric, bias-adjusted CIs for parameter estimates from 1000 bootstrap samples.

We computed predictors of false-negative test results by using chi-square or Fisher exact tests, using the Bonferroni correction for multiple comparisons. We performed our analyses by using GraphPad Prism 4 (GraphPad Software, San Diego, California) and Stata, version 9.0 (Stata, College Station, Texas).

Role of the Funding Source

The Wellcome Trust had no role in study design, data collection, data analysis, data interpretation, or writing of the report.

Results

We enrolled 389 consenting adult patients, whose demographic characteristics are shown in Table 2. Blood was unavailable from 3 patients, tuberculin skin test results were unavailable in 67 patients, and 15 ELISpot assays (4%) were indeterminate (Figure 1). The 67 patients without tuberculin skin test results were similar to those with skin test results in terms of age, sex, ethnicity, presence of tuberculosis, site of disease, and presence of comorbid conditions (data provided on request). We classified 154 patients (40%) as having culture-confirmed tuberculosis, 40 (10%) as having highly probable tuberculosis, and 39 (10%) as clinically indeterminate; we excluded active tuberculosis in 154 patients (40%) (Table 1 and Appendix Figure 1). Twenty-eight percent of tuberculosis cases were extrapulmonary; Table 3 shows the clinical subtypes of tuberculosis and alternative diagnoses for patients without tuberculosis.

Table 2. Participant Characteristics

Figure 1.

Study flow diagram.

ELISpot = enzyme-linked immunospot assay incorporating early secretory antigenic target-6 and culture filtrate protein-10; ELISpot^PLUS = enzyme-linked immunospot assay incorporating early secretory antigenic target-6, culture filtrate protein-10, and Rv3879c; TB = tuberculosis; TST= tuberculin skin testing. *Results were indeterminate because of no achievement of positive control (11 patients), high background (1 patient), peptide contamination (1 patient), inconclusive assay (1 patient), or defective ELISpot plate (1 patient). †Results were not available because of history of TB (clinically contraindicated) (45 patients), patient did not return for reading (8 patients), result not recorded (8 patients), reason unknown (3 patients), death (1 patient), test performed elsewhere (1 patient), or patient declined consent (1 patient). ‡Tuberculin skin test results were based on a 15-mm cutoff point and considered positive if induration was ≥15 mm on the Mantoux test or grade 3 to 4 on the Heaf test regardless of bacille Calmette–Guérin vaccination status.

Appendix Figure 1.

Study flow diagram, stratified by final diagnosis and then by test result.

These are the same data shown in Figure 1 but displayed in a different manner to allow scrutiny of the entire raw data set. ELISpot = enzyme-linked immunospot assay incorporating early secretory antigenic target-6 and culture filtrate protein-10; ELISpot^PLUS = enzyme-linked immunospot assay incorporating early secretory antigenic target-6, culture filtrate protein-10, and Rv3879c; TB = tuberculosis; TST= tuberculin skin testing. *Results were not available because of history of TB (clinically contraindicated) (45 patients), patient did not return for reading (8 patients), result not recorded (8 patients), reason unknown (3 patients), death (1 patient), test performed elsewhere (1 patient), or patient declined consent (1 patient). †Tuberculin skin test results were based on a 15-mm cutoff point and considered positive if induration was ≥15 mm on the Mantoux test or grade 3 to 4 on the Heaf test regardless of bacille Calmette–Guérin vaccination status. ‡Results were indeterminate because of no achievement of positive control (11 patients), high background (1 patient), peptide contamination (1 patient), inconclusive assay (1 patient), or defective ELISpot plate (1 patient).

Table 3. Final Diagnoses of Study Participants

For culture-confirmed and highly probable cases, diagnostic sensitivities were 89% (95% CI, 84% to 93%) with ELISpot^PLUS, 85% (CI, 79% to 90%) with standard ELISpot, 79% (CI, 72% to 85%) with 15-mm threshold tuberculin skin testing, and 83% (CI, 77% to 89%) with stratified 10-mm threshold tuberculin skin testing (Table 4). The ELISpot^PLUS assay was more sensitive than tuberculin skin testing with the 15-mm threshold (P = 0.01) but not with the stratified 10-mm threshold (P = 0.10). The ELISpot^PLUS assay was more sensitive than tuberculin skin testing with a 15-mm threshold in the 297 patients with results from both tests (89% [CI, 83% to 94%] versus 81% [CI, 73% to 87%]; P = 0.04), but not with stratified-10 mm threshold (85% [CI, 78% to 90%]; P = 0.2). The sensitivity of ELISpot^PLUS was 4.2% higher than that of standard ELISpot (P = 0.02). Seven patients with active tuberculosis had ELISpot responses to novel peptides but not to early secretory antigenic target-6 or culture filtrate protein-10, of whom 4 were positive to Rv3873, 3 to Rv3878, and all 7 to Rv3879c.

Table 4. Accuracy for the Diagnosis of Active Tuberculosis

In a sensitivity analysis to investigate whether inclusion of highly probable cases (category 2, which was biased in favor of the tuberculin skin test because a diagnosis of highly probable tuberculosis was based in part on skin test results) affected performance estimates, we reestimated sensitivity by using only culture-confirmed cases (category 1). Sensitivities were 91% (CI, 85% to 95%) with ELISpot^PLUS, 87% (CI, 80% to 92%) with standard ELISpot, 79% (CI, 71% to 86%) with tuberculin skin testing using the 15-mm threshold, and 82 % (CI, 74% to 89%) with the stratified 10-mm threshold. The ELISpot^PLUS assay was more sensitive than tuberculin skin testing using either the 15-mm (P = 0.005) or the stratified 10-mm threshold (P = 0.03) (Table 4).

Tuberculin skin testing and ELISpot had higher sensitivity when used in combination. For culture-confirmed or highly probable diagnoses of tuberculosis, sensitivity of ELISpot^PLUS with tuberculin skin testing was 99% (CI, 95% to 100%) and standard ELISpot with tuberculin skin testing was 97% (CI, 93% to 99%) (Figure 2). A negative result on both tests was associated with likelihood ratios of 0.02 (CI, 0 to 0.09) for ELISpot^PLUS with tuberculin skin testing and 0.04 (CI, 0.02 to 0.12) for standard ELISpot with tuberculin skin testing. Positive results from both tests provided likelihood ratios of 5.5 (CI, 3.2 to 9.5) for ELISpot^PLUS with tuberculin skin testing and 5.7 (CI, 3.2 to 9.9) for standard ELISpot with tuberculin skin testing, whereas discordant results (likelihood ratios, 0.93 to 1.56) had no diagnostic value. Figure 2 shows sequential likelihood ratios when ELISpot assays are followed by tuberculin skin testing, and Appendix Figure 2 shows corresponding results when tuberculin skin testing is used first.

Figure 2.

Likelihood ratios, sensitivities, and specificities of tests used in combination, using ELISpot or ELISpot^PLUS first.

Data are for patients in whom results on both tests were available (n = 265). Except where stated, values are likelihood ratios with 95% CIs. Tuberculin skin test thresholds for positivity were induration ≥15 mm on the Mantoux test or grade 3 to 4 on the Heaf test. ELISpot = enzyme-linked immunospot incorporating early secretory antigenic target-6 and culture filtrate protein-10; ELISpot^PLUS = enzyme-linked immunospot incorporating early secretory antigenic target-6, culture filtrate protein-10, and Rv3879c; TB = tuberculosis; TST = tuberculin skin testing. Top. ELISpot followed by TST. *Combined sensitivity of 1 or more positive results from tests used in combination, 97% (CI, 93% to 99%). †Combined specificity for a double-negative result from tests used in combination, 62% (CI, 53% to 71%). Bottom. ELISpot^PLUS followed by TST. ‡Combined sensitivity of 1 or more positive results from tests used in combination, 99% (CI, 95% to 100%). §Combined specificity for a double-negative result from tests used in combination, 61% (CI, 52% to 70%).

Appendix Figure 2.

Likelihood ratios, sensitivities, and specificities of tests used in combination for diagnostic evaluation, using tuberculin skin testing (TST) as the first test.

Data are for patients in whom results on both tests were available (n = 265). Except where stated, numbers are likelihood ratios with 95% CIs. Tuberculin skin test thresholds for positivity were induration ≥15 mm on the Mantoux test or grade 3 to 4 on the Heaf test. ELISpot = enzyme-linked immunospot incorporating early secretory antigenic target-6 and culture filtrate protein-10; ELISpot^PLUS = enzyme-linked immunospot incorporating early secretory antigenic target-6, culture filtrate protein-10, and Rv3879c; TB = tuberculosis. Top. TST followed by ELISpot. *Combined sensitivity of 1 or more positive results from tests used in combination, 97% (CI, 93% to 99%). †Combined specificity for a double-negative result from tests used in combination, 62% (CI, 53% to 71%). Bottom. TST followed by ELISpotPLUS. ‡Combined sensitivity of 1 or more positive results from tests used in combination, 99% (CI, 95% to 100%). §Combined specificity for a double-negative result from tests used in combination, 61% (CI, 52% to 70%).

The high sensitivity of the combined tests reflects the fact that false-negative tuberculin skin test results and false-negative ELISpot results occurred in different patient populations. In univariate analysis among culture-confirmed and highly probable cases, the presence of factors associated with cutaneous anergy (5) or risk for progression from latent infection to active tuberculosis (35) was associated with false-negative tuberculin skin test results (P = 0.001) but not with false-negative ELISpot results (P = 0.55). Specifically, 28% (CI, 11% to 44%) of patients with false-negative tuberculin skin test results had factors associated with cutaneous anergy (3 had diabetes and 3 were HIV-positive), compared with 5.0% (CI, 1.1% to 8.8%) of those with true-positive results. Eleven patients with tuberculosis were deemed immunocompromised on the basis of being HIV-positive (8 patients) or receiving long-term corticosteroid treatment (3 patients); 10 had positive ELISpot results and all 11 had positive ELISpot^PLUS results. Neither age nor presence of any comorbid condition was associated with false-negative tuberculin skin test or ELISpot results (P > 0.11 in all cases).

The sensitivity of culture was 79% (CI, 73% to 85%) for confirmed and highly probable tuberculosis, which was lower than that of both ELISpot assays; this difference was significant for ELISpot^PLUS (P = 0.005). Microscopy had a sensitivity of 39% (CI, 32% to 46%). Microbiological techniques had lower sensitivity in extrapulmonary disease than in pulmonary disease (culture, 53% [CI, 39% to 67%] vs. 89% [CI, 83% to 94%], respectively [P < 0.001]; microscopy, 14% (CI, 5.5% to 26%) vs. 49% (CI, 40% to 58%), respectively [P < 0.001]), whereas ELISpot^PLUS had nonsignificantly higher sensitivity in extrapulmonary disease (94% [CI, 84% to 99%]) than in pulmonary disease (88% [CI, 81% to 93%]) (P = 0.19). Among patients with suspected pulmonary tuberculosis, the sensitivity of sputum microscopy with ELISpot^PLUS was 94% (CI, 89% to 98%) for culture-confirmed and highly probable cases, generating a negative likelihood ratio of 0.10 and a negative predictive value of 90%, compared with a sensitivity of 78% (CI, 69% to 85%) for microscopy combined with tuberculin skin testing (P < 0.001).

Specificity of ELISpot^PLUS was 69% (CI, 61% to 77%) for active disease in all category 4 patients, which was lower than the specificity of tuberculin skin testing (81% [CI, 73% to 87%]; P = 0.03). Although ELISpot^PLUS gave more diagnostic negative likelihood ratios and negative predictive values than tuberculin skin testing, positive likelihood ratios and positive predictive values were somewhat lower, most likely because of detection of latent infection in category 4 patients; this finding is consistent with the 84% (CI, 60% to 97%) specificity of ELISpot^PLUS calculated by using category 4D patients (who were considered least likely to have latent infection). The specificity of standard ELISpot was similar to that of ELISpot^PLUS (Table 4). Three of 21 category 4D patients had false-positive results by standard ELISpot, and 3 of 19 had false-postive results by ELISpot^PLUS. All 3 individuals who had false-positive ELISpot^PLUS results were United Kingdom–born white persons with 0 mm of induration on the Mantoux test, and 2 were 75 years of age or older. Only 2 category 4D patients who were negative by standard ELISpot were positive to any of the new antigens; both responded to Rv3873 alone. Thus, inclusion of Rv3879c alone in ELISpot^PLUS enhanced diagnostic sensitivity without compromising specificity.

Our comparison of the Heaf test and the Mantoux test with a 15-mm induration threshold for patients with culture-confirmed and highly probable cases of tuberculosis revealed a nonsignificant increase in sensitivity for the Heaf test (86% [CI, 74% to 82%] for the Heaf test vs. 76% [CI, 66% to 84%] for the Mantoux test; P = 0.14) and a higher specificity for the Mantoux test (66% [CI, 46% to 82%]) for the Heaf test vs. 85% [CI, 77% to 92%] for the Mantoux test; P = 0.02) (subgroup data provided on request). Receiver-operator characteristic analysis indicated that the area under the curve for both skin test formats was identical at 0.84. Subgroup analysis of combined use of standard ELISpot or ELISpot^PLUS followed by Mantoux testing (for the 184 patients who received Mantoux testing) gave similar final likelihood ratios to those observed in the whole study population tested with Mantoux or Heaf methods (265 patients; subgroup data provided on request).

Overall, 4.7% of positive results on standard ELISpot or ELISpot^PLUS were dependent on a single peptide pool response of 5 to 10 spot-forming cells per well. These results might be considered borderline positive.

Discussion

This prospective study has defined a role for T-cell–based interferon-γ release assay testing in the diagnostic evaluation of patients with suspected tuberculosis. The 89% sensitivity of ELISpot^PLUS for a diagnosis of culture-confirmed or highly probable tuberculosis was higher than that of the standard ELISpot, tuberculin skin testing, and culture. The combined sensitivity of ELISpot^PLUS and tuberculin skin testing in confirmed and highly probable cases was 99%.

The negative likelihood ratio of 0.15 with ELISpot^PLUS means that a negative result would reduce the odds of tuberculosis by 6.5-fold, which allows it to be used as a rule-out test in patients with a moderate or low pretest probability of tuberculosis. Given the high pretest probability of tuberculosis (0.50) in our patient population (patients attending urban infectious disease units), the negative predictive value of ELISpot^PLUS alone was modest at 83%. However, the 99% combined sensitivity of tuberculin skin testing and ELISpot^PLUS and the corresponding negative likelihood ratio of 0.02 allow the combined use of these assays as a rule-out test for tuberculosis, even in populations with high pretest probabilities, such as our study sample. Pretest probabilities in other settings, such as general medical or primary care clinics in low-prevalence countries, will be much lower, and the negative predictive value of ELISpot^PLUS, alone or in combination with skin testing, will be correspondingly higher. The higher sensitivity of ELISpot^PLUS compared with standard ELISpot was entirely attributable to the addition of 1 antigen, Rv3879c (to which Rv3873 and Rv3878 provided no further incremental sensitivity), which supports inclusion of Rv3879c in T-cell–based interferon-γ release assays.

Analysis of tuberculin skin testing using the lower 10-mm induration threshold in patients not vaccinated with bacille Calmette–Guérin showed a nonsignificant increase in sensitivity and decrease in specificity. Whereas ELISpot^PLUS was not significantly more sensitive than skin testing with the stratified 10-mm threshold in patients with confirmed and highly probable tuberculosis, it was significantly more sensitive in the patients with culture-confirmed disease. This is probably because the diagnosis of highly probable tuberculosis was based in part on skin test results, which biases results in favor of the skin test.

Our results are probably generalizable to clinical units evaluating patients with suspected tuberculosis in other low-prevalence countries because we performed our study in routine clinical practice and included a wide spectrum of clinical cases and alternative diagnoses (36, 37). This may also account for the lower sensitivity of standard ELISpot in our study compared with earlier, smaller studies of more selected patient groups (16, 18, 38). Because our population comprised relatively few immunocompromised patients, our results cannot be generalized to populations with a higher prevalence of HIV co-infection, although previous studies of larger numbers of patients with tuberculosis who were co-infected with HIV suggest that ELISpot has high sensitivity in this group (25, 28). Our study population was predominantly South Asian and black; further studies are required in other ethnic groups. Results will be less generalizable outside low-prevalence countries, because the utility of ELISpot in endemic regions will be limited by higher background rates of latent tuberculosis (29, 39). This reduces the utility of a positive result; however, negative results (although proportionally fewer) would still be useful to rule out a diagnosis of tuberculosis (8, 25, 40).

Any T-cell–based test with a high sensitivity for M. tuberculosis infection will detect latent infection in patients who are suspected of having tuberculosis but in whom active tuberculosis has been excluded. Because our study population predominantly comprised patients with suspected tuberculosis from ethnic groups with a high prevalence of tuberculosis and latent tuberculosis, patients without active tuberculosis had a much higher risk for latent infection than would healthy control patients selected for very low risk for infection. This explains the 66% to 86% specificities of ELISpot and tuberculin skin testing when used as markers of active tuberculosis. Hence, when used to support a diagnosis of active tuberculosis, immune-based tests of infection should be interpreted in the context of the overall clinical picture and diagnostic work-up (40), as is recognized for tuberculin skin testing.

Given that culture remains the diagnostic gold standard and is required for identifying drug resistance, we believe our findings will have the following effects on clinical decision making. First, a negative ELISpot^PLUS result can assist in excluding tuberculosis when the pretest probability is low-to-moderate. When pretest probabilities are higher, combined use of ELISpot^PLUS and tuberculin skin testing excludes tuberculosis with a greater degree of certainty (Figure 2). The likelihood ratio of 0.02 to 0.04 refines a pretest probability of 50% to a posttest probability of approximately 2% (41) in patients with double-negative results, who constituted more than one quarter of those tested in our study. Conversely, a positive ELISpot^PLUS (or standard ELISpot) result with a corresponding likelihood ratio of 2.8 is of limited value. However, in patients with positive results on both ELISpot and the tuberculin skin test, who constituted nearly one half of those tested, the corresponding likelihood ratio of 5.5 increased the probability of active tuberculosis by approximately 30% (41). Thus, double-positive results may help guide decisions about early initiation of presumptive treatment in severe disease while awaiting culture results and in extrapulmonary disease, in which culture is frequently negative. Combined testing also generates some discordant results (Figure 2). In these cases, which amounted to one quarter of persons tested, the near-unity likelihood ratios do not alter pretest probabilities and do not contribute to the diagnostic work-up.

The rate of indeterminate ELISpot results in our study was similar to the 3% to 4% rates observed in other studies (42, 43) and less than the 11% to 21% rates observed with whole-blood ELISA in routine practice (42, 44). Indeterminate ELISA results are associated with immunosuppressive therapies or conditions (42, 44), but no such association was seen for ELISpot in this or other studies (25, 42, 43, 45, 46). Moreover, the proportion of patients with tuberculosis was no higher among those with indeterminate results. As expected, false-negative skin test results were associated with factors known to cause anergy or progression to active disease. These factors did not confound the ELISpot results, consistent with previous findings (10, 15, 42).

The 99% combined sensitivity of tuberculin skin testing and ELISpot reflects the fact that patients who had a false-negative result on one test were distinct from those who had a false-negative result on the other. This implies that distinct immunologic processes underlie failure of these different, yet complementary, immune-based tests.

The main weakness of our study arises from the problem of differing standards for tuberculin skin testing. Standards vary worldwide, differing by type of tuberculin, production standards, method of administration, dose, and skin test cutoff points (13, 23, 24, 31, 35, 47). Where possible, we used a 10–tuberculin unit PPD–Siebert Mantoux test (in accordance with the United Kingdom standard at the time) and corresponding cutoff points for induration. In one quarter of patients, a Heaf test was used for logistical reasons. When standard thresholds for Mantoux test equivalence were used (23, 24), the Heaf test showed a nonsignificant increase in diagnostic sensitivity and a significant decrease in specificity relative to the Mantoux test. Subgroup analysis of patients who had Mantoux testing showed that conclusions for combined testing with ELISpot or ELISpot^PLUS followed by Mantoux testing were similar to those for the study population as a whole. Parallel testing with the alternative whole-blood ELISA T-cell–based interferon-γ release assay would have been of interest, but neither this test nor the T-SPOT.TB (which is based on the standard ELISpot used here) was available when our study began. The modest sample size, limited number of immunocompromised patients, and lack of a definitive gold standard are also limitations of our study. Because many patients with tuberculosis are culture-negative (48), a microbiological gold standard used alone is too insensitive to evaluate new diagnostic tests. We therefore included highly probable cases in our composite reference standard, which better reflects the clinically relevant population, and our sensitivity analysis confirmed that estimates based on the composite reference standard were similar to those based on the microbiological reference standard. Finally, because this is only the second study to evaluate Rv3879c (21) and the first prospective study, further validation of its incremental sensitivity is required.

In summary, we found that ELISpot^PLUS was a sensitive and clinically useful diagnostic test for evaluation of patients with suspected tuberculosis. Incorporation of a novel antigen, Rv3879c, conferred improved sensitivity over standard ELISpot. Combined use of tuberculin skin testing with either ELISpot^PLUS or ELISpot enabled rapid exclusion of tuberculosis in patients with moderate to high probability of infection.