0
Articles |

The Risk for Myocardial Infarction with Cyclooxygenase-2 Inhibitors: A Population Study of Elderly Adults FREE

Linda E. Lévesque, BScPhm, MSc; James M. Brophy, MD, PhD; and Bin Zhang, MSc
[+] Article and Author Information

From McGill University Health Centre, McGill University, Montréal, Québec, Canada.


Disclaimer: This study is based on nonidentifiable data provided by several Québec Government agencies. The interpretation and conclusions contained herein do not necessarily represent those of the government of Québec or these agencies.

Grant Support: By a grant from the Canadian Institutes of Health Research (CIHR grant MOP62871). Dr. Brophy is a Physician-Scientist of the Fonds de la recherche en santé du Québec.

Potential Financial Conflicts of Interest: None disclosed.

Requests for Single Reprints: James Brophy, MD, PhD, Cardiology Division, Room M4.76, McGill University Health Centre, Royal Victoria Hospital, 687 Pine Avenue West, Montréal, Québec H3A 1A1, Canada; e-mail, james.brophy@mcgill.ca.

Current Author Addresses: Ms. Lévesque and Drs. Brophy and Zhang: McGill University Health Centre, Royal Victoria Hospital, 687 Pine Avenue West, Montréal, Québec H3A 1A1, Canada.

Author Contributions: Conception and design: L.E. Lévesque, J.M. Brophy.

Analysis and interpretation of the data: L.E. Lévesque, J.M. Brophy, B. Zhang.

Drafting of the article: L.E. Lévesque, J.M. Brophy.

Critical revision of the article for important intellectual content: L.E. Lévesque, J.M. Brophy.

Final approval of the article: L.E. Lévesque, J.M. Brophy.

Provision of study materials: J.M. Brophy.

Statistical expertise: L.E. Lévesque, J.M. Brophy, B. Zhang.

Obtaining of funding: J.M. Brophy.

Administrative, technical, or logistic support: L.E. Lévesque, J.M. Brophy.

Collection and assembly of data: L.E. Lévesque, J.M. Brophy.


Ann Intern Med. 2005;142(7):481-489. doi:10.7326/0003-4819-142-7-200504050-00113
Text Size: A A A
Editors' Notes
Context

Do risks for myocardial infarction (MI) differ among cyclooxygenase-2 (COX-2) selective inhibitors and nonselective nonsteroidal anti-inflammatory drugs (NSAIDs)?

Contribution

This retrospective study involving 113 927 people older than age 65 years used Québec's administrative health databases to examine associations between various NSAIDs and risk for a first MI. Compared with nonuse of NSAIDs, use of rofecoxib was associated with a 1.24 higher relative risk for MI (95% CI, 1.05 to 1.46), while neither celecoxib nor other NSAIDs were associated with statistically significant increased risks.

Cautions

Although analyses controlled for potential confounders, unmeasured factors such as over-the-counter use of aspirin and ibuprofen could have affected results.

–The Editors

Cyclooxygenase-2 (COX-2) selective inhibitors, with their improved gastrointestinal toxicity profile, have been marketed since 1999 as safer alternatives to traditional nonsteroidal anti-inflammatory drugs (NSAIDs) (13). Although these agents experienced unprecedented growth in market share, their use has not lacked controversy. Concerns regarding their potential cardiovascular toxicity were first raised in 2000 after the Vioxx Gastrointestinal Outcomes Research (VIGOR) study (2), and then again in 2001 by the U.S. Food and Drug Administration (4) and a pooled analysis (5). However, the results of the large Celecoxib Long-term Arthritis Safety Study (CLASS) did not support the cardiotoxicity hypothesis for all COX-2 inhibitors (6). Initially, it was unclear whether the use of different comparator groups, differences between rofecoxib and celecoxib, or differences in the use of concomitant aspirin explained these divergent results. Subsequent observational studies (710) and meta-analyses (1113) also reported conflicting results. Moreover, none of the studies published to date have had the power to adequately address the potentially risk-modifying effects of aspirin.

On 30 September 2004, Merck & Co., Inc., announced the worldwide voluntary withdrawal of rofecoxib after the data safety monitoring board overseeing the Adenomatous Polyp Prevention on Vioxx (APPROVe) trial of rofecoxib, 25 mg/d, in individuals at risk for developing colon cancer recommended that the study be halted prematurely (1415). An interim analysis found that after 18 months of use, rofecoxib increased the risk for confirmed cardiovascular events compared with placebo. The Food and Drug Administration has since indicated that they now intend to carefully review the safety of all marketed COX-2 inhibitors (16).

Considerable uncertainty remains regarding the clinical profile of persons at risk for COX-2–mediated cardiovascular events and whether celecoxib, as well as other COX-2 selective agents, poses a similar risk. We conducted a retrospective, population-based cohort study to address these unresolved issues. Using a large and relatively unselected population of elderly persons who had no history of myocardial infarction (MI) and were initiating treatment with an NSAID, we assessed 1) whether and to what extent the use of various NSAIDs changes the risk for a first MI compared with persons who did not use these agents in the year preceding the event date and 2) how dose, concomitant therapy with aspirin, and both factors simultaneously may modify this risk.

Study Sample and Data Source

We identified a cohort of individuals 66 years of age and older newly treated with an NSAID by using the computerized health insurance and vital statistics databases of the province of Québec, Canada. These administrative databases were developed as a result of the universal health care programs offered to residents and are now extensively used for research (1723). We used the following data sources for this study: 1) the beneficiary database, managed by the Régie de l'Assurance-Maladie du Québec (RAMQ), which provided information on sociodemographic characteristics and dates of coverage; 2) the prescription drug database, which provided information on all outpatient prescriptions dispensed to residents 65 years of age and older, including drug name, strength, quantity, days supplied, and dispensing date; 3) the medical services database, which provided information on all medical visits, including the date and nature of service, with diagnostic codes, location of service, and physician's specialty; 4) the hospitalization database, which provided information on all hospitalizations, including date of admission and discharge, primary diagnosis, and up to 15 secondary diagnoses codes, and an indicator of hospital mortality when applicable; and 5) the vital statistics database, which provided information on all deaths, including date and cause. Each resident is represented in these databases by an encrypted unique identifier that enables record linkage at the level of the individual. The ethics boards of Québec (Commission d'accès à l'information du Québec) and the Royal Victoria Hospital, McGill University, approved the study.

Study Design

We conducted a retrospective, population-based cohort study that was analyzed by using a time-matched, nested case–control approach. The cohort consisted of a random sample (n = 125 000) of all residents age 66 years and older who were dispensed an NSAID between 1 January 1999 and 30 June 2002; the date of the first prescription was taken as cohort entry. We excluded persons who had not been enrolled in the health plan for at least 1 year preceding cohort entry, had been dispensed a study drug within this 1-year baseline period (n = 1193), or had received prescriptions from 2 or more NSAID categories on the day of cohort entry (n = 153). We also excluded persons hospitalized for an MI (International Classification of Diseases, Ninth Revision, codes 410 [acute] and 412 [old], all diagnostic fields) any time before cohort entry (n = 8168). We followed the remaining individuals until the earlier of one of the following dates: first hospitalization for an acute MI, end of coverage (due to death or emigration from the province), death, or end of the study (31 December 2002).

Study End Point

The case-defining event was a first hospitalization with a diagnosis of acute MI (International Classification of Diseases, Ninth Revision, code 410), nonfatal or fatal, occurring any time after cohort entry. The date of admission was used as the index date. This diagnostic code has previously been validated (24). For the MI to be considered a valid study end point, the hospital length of stay had to be at least 3 days, unless the patient had been transferred to or from another institution or had undergone percutaneous coronary angioplasty.

NSAID Exposure

All NSAIDs covered by the prescription drug benefit program during the study period were identified and classified into the following mutually exclusive categories, determined prospectively on the basis of their differential inhibition of cyclooxygenase: 1) NSAIDs (nonselective, nonaspirin NSAIDs, excluding naproxen), 2) naproxen (partially selective), 3) celecoxib (COX-2 selective), 4) rofecoxib (COX-2 selective), and 5) meloxicam (preferentially selective COX-2 inhibitor). All of these agents were available without prescribing restrictions. Valdecoxib could not be included because it was not available in Canada when the study was initiated. The accuracy and completeness of the prescription drugs database have previously been demonstrated; less than 1% of the information is out of range or missing (25).

The exposure time window of primary interest, identified a priori, was current use. However, we also evaluated use in the year preceding the index date (ever use). Individuals were considered currently exposed if the duration of the last prescription dispensed overlapped with the index date. Past users had filled at least 1 NSAID prescription in the year preceding the index date but were not currently exposed, whereas ever users included both current and past users. Those who had not received any NSAIDs in the year preceding the index date were classified as nonusers in this time period.

We defined the following dosage categories for the COX inhibitors a priori: 200 mg/d or less (low-dose) or greater than 200 mg/d (high-dose) for celecoxib and 25 mg/d or less (low-dose) or greater than 25 mg/d (high-dose) for rofecoxib. To study the effects of aspirin on the relationship between NSAIDs and MI, we classified individuals as current users of aspirin if the duration of the last aspirin prescription dispensed before the event overlapped with the index date or ended within 30 days of this date. We used the 30-day grace period to account for aspirin's irreversible effect on platelet aggregation and the possibility of nonadherence (2627).

Statistical Analysis

To study exposure to NSAIDs in relation to the index date (the etiologically relevant exposure time window) while simultaneously controlling for the potentially confounding effects of calendar time, we used a time-matched, nested case–control analysis (2829). The index date of each case-patient was used to define the risk sets from which controls were chosen. For each case-patient, we randomly selected 20 controls matched on month and year of cohort entry and age (±1 year) and assigned them the case-patient's index date. Consequently, follow-up time was identical for case-patients and controls within each risk set. We compared the risk for acute MI associated with the current use of various NSAIDs with that of “nonusers” in the year preceding the index date. Thus, we could disentangle the independent effect of individual COX inhibitors from those of naproxen and other NSAIDs since all exposure groups were compared with nonusers. We estimated crude and adjusted rate ratios (RRs) for these associations using conditional logistic regression (3031). These measures of association are equal to the hazard ratios that would be estimated from the corresponding Cox proportional hazards regression. All rate ratios were adjusted for the potentially confounding effects of well-established conventional risk factors, including age; sex; hypertension; coronary artery disease; cerebrovascular disease; peripheral vascular disease; congestive heart failure; diabetes; and use of antilipemic agents, anticoagulants, and aspirin. In addition, the presence of respiratory illness, gastrointestinal ulcer disease, thyroid disorders, depression or psychiatric illness, use of oral corticosteroids, 3 measures of health care utilization (the number of hospitalizations, medical outpatient visits, and visits to a cardiologist), as well as 3 measures of comorbidity (the chronic disease score [32], the number of distinct drugs dispensed [33], and the Charlson index [34]), were evaluated as possible confounders using the change-in-estimate method (35). Covariates were retained in the final model if the risk estimate changed by 10% or more. We report risk estimates adjusted for all aforementioned covariates, including nonconfounders, because a parsimonious modeling approach provided no important gain in precision. With the exception of health care utilization and indices of comorbidity, which were assessed in the year preceding the index date, all other covariates were assessed in the year before cohort entry (at baseline). We identified medications using the prescription drug database and identified comorbid conditions using both discharge diagnosis codes and specific corresponding drug treatments.

Since aspirin use is an important determinant of MI (3637) and may modify the association between NSAIDs and MI, we included an interaction term for the current use of aspirin in subsequent models.

Role of the Funding Source

The Canadian Institutes of Health Research funded this study and had no role in the design, conduct, or reporting of the study or the decision to submit the manuscript for publication.

A total of 302 964 elderly persons initiated treatment with an NSAID during the study period (Figure). Because the provincial ethics review board considered this cohort too large, the RAMQ selected a random sample of 125 000 individuals before data transfer. After we applied the exclusion criteria, the study cohort consisted of 113 927 persons with a mean age (±SD) of 75.2 ± 5.5 years at cohort entry. This cohort was followed for an average (±SD) of 2.4 ± 0.98 years. A previous MI was the primary source of exclusions. During follow-up, 2844 individuals were hospitalized for a first MI; 561 of these patients (20%) had a fatal MI.

Grahic Jump Location
Figure.
Flow of study cohort.

AMI = acute myocardial infarction; ICD-9 = International Classification of Diseases, Ninth Revision; NSAID = nonsteroidal anti-inflammatory drug.

Grahic Jump Location

In the year preceding the index date, 70.7% of case-patients and controls received at least 1 NSAID prescription (ever use), of which 51.8% were past users and 18.9% were current users. Therefore, 29.3% of individuals were classified as nonusers (reference category) during this time period. Among those currently exposed, the mean (±SD) number of prescriptions dispensed in the year preceding the index date was 3.8 ± 3.3 for traditional NSAIDs, 3.0 ± 3.5 for naproxen, 6.2 ± 6.1 for celecoxib, 5.3 ± 5.7 for rofecoxib, and 4.3 ± 4.0 for meloxicam. More than 95% of persons dispensed aspirin received a daily dose of 325 mg or less.

Table 1 describes the characteristics of case-patients and controls. As expected, case-patients were more likely to be male, have traditional risk factors, have other manifestations of atherosclerosis, and be using aspirin before cohort entry. In the year preceding the index date, case-patients were also more likely to have been hospitalized and have consulted physicians, and they appeared generally sicker than controls.

Table Jump PlaceholderTable 1.  Characteristics of Case-Patients and Controls

After adjustment for multiple risk factors, individuals exposed to rofecoxib on the index date (current users) were at an increased risk for MI compared with those who had not used an NSAID in the year preceding the index date (RR, 1.24 [95% CI, 1.05 to 1.46]) (Table 2). No evidence suggested an elevated risk associated with the current use of celecoxib (RR, 0.99 [CI, 0.85 to 1.16]). Similarly, traditional NSAIDs (RR, 1.00 [CI, 0.73 to 1.37]), naproxen (RR, 1.17 [CI, 0.75 to 1.84]), and meloxicam (RR, 1.06 [CI, 0.49 to 2.30]) were not associated with a higher risk for MI. Users of NSAIDs any time in the year preceding the index date were not at increased risk for MI, including those who had taken rofecoxib (RR, 0.97 [CI, 0.85 to 1.10]) or celecoxib (RR, 1.00 [CI, 0.88 to 1.13]).

Table Jump PlaceholderTable 2.  Crude and Adjusted Rate Ratios of Acute Myocardial Infarction for Use of Various Anti-Inflammatory Agents

The magnitude of the risk observed for current users of rofecoxib compared with those who had not used an NSAID in the year preceding the index date appeared to be higher for individuals prescribed a dosage greater than 25 mg/d (RR, 1.73 [CI, 1.09 to 2.76]), although even low doses of rofecoxib were associated with an elevated risk (RR, 1.21 [CI, 1.02 to 1.43]) (Table 3). We observed no dose–response effect among users of celecoxib (RR, 0.98 [CI, 0.83 to 1.17] for ≤200 mg/d; RR, 1.00 [CI, 0.78 to 1.29] for >200 mg/d). We could not assess the influence of meloxicam dose because there were too few current users of this drug.

Table Jump PlaceholderTable 3.  Crude and Adjusted Rate Ratios of Acute Myocardial Infarction for Current Use of Celecoxib and Rofecoxib according to Dose

The coadministration of aspirin did not modify the association for users of traditional NSAIDs (Table 4). Current users of naproxen combined with aspirin appeared to have a lower risk for MI (RR, 0.60 [CI, 0.24 to 1.50]) than those not receiving concomitant aspirin therapy (RR, 1.59 [CI, 0.95 to 2.65]). The association between celecoxib use, at any dose, and MI was not materially changed by aspirin. However, aspirin decreased the overall excess risk for MI associated with the current use of rofecoxib from 37% (RR, 1.37 [CI, 1.12 to 1.68]) to 7% (RR, 1.07 [CI, 0.84 to 1.36]). In addition, aspirin eliminated the excess risk for MI in persons receiving low doses of rofecoxib (RR, 1.00 [CI, 0.77 to 1.28]) but did not reduce the risk in individuals prescribed high doses of this agent (RR, 2.36 [CI, 1.27 to 4.39]). We could not evaluate the effect of aspirin on risk for MI in meloxicam users because too few persons were current users.

Table Jump PlaceholderTable 4.  Crude and Adjusted Rate Ratios of Acute Myocardial Infarction for Current Use of Anti-Inflammatory Agents according to Concomitant Use of Aspirin and Dose of Cyclooxygenase-2 Selective Inhibitors

Our study, with nearly 5 times as many rofecoxib-exposed case-patients with MI as reported in the recent cumulative meta-analysis (38), provides additional evidence that the use of rofecoxib is associated with an increased risk for acute MI. Our data also suggest that the risk is higher at dosages exceeding 25 mg/d. Of note, individuals who had used rofecoxib any time in the year preceding the index date did not experience an increased risk; this finding shows the need for contemporaneous exposure. In addition, the mean number of rofecoxib prescriptions dispensed in the year preceding the MI was only 5.3 ± 5.7, implying that long-term exposure may not be necessary. We have also shown that the cardiotoxic effect of rofecoxib previously observed in older and sicker populations (7, 9) extends to a healthier elderly population.

An important limitation of previously published studies has been the lack of information on the effects of concomitant aspirin use. A recent prospective, case–control study of COX inhibitor users (10) was the first to report MI risk stratified by aspirin use. Our study, with 10 times the sample size of that study, allows a more precise estimation of this interaction and suggests that concomitant aspirin use attenuates the nefarious cardiovascular effects of low-dose rofecoxib. A possible interaction between naproxen and aspirin requires confirmation in a larger study. However, this interaction could partly reconcile the conflicting findings of previous naproxen studies (17, 3942) because different population mixes of these drugs may have produced results varying from a protective effect in populations with high use of concomitant aspirin to no protection in populations with low use. Reassuringly, we, like others (7, 9), found no increased risk among users of celecoxib, regardless of the dose prescribed. It is important to recognize that only 25% of current users of celecoxib received dosages greater than 200 mg/d, of which less than 0.1% received 800 mg/d or more. In addition, the confidence intervals do not rule out the possibility of a small risk or benefit with this agent. Our study also provides preliminary data on the cardiovascular safety of meloxicam. Traditional NSAIDs and naproxen were not associated with an increased cardiovascular risk or benefit.

Our findings are consistent with the results of the VIGOR study (2, 4), a cumulative meta-analysis of all randomized rofecoxib trials (38), and the APPROVe results (1416). Indeed, our adjusted risk estimate of 2.36 (CI, 1.27 to 4.39) for high-dose rofecoxib combined with aspirin is almost identical to that reported for VIGOR participants randomly assigned to rofecoxib, 50 mg/d (RR, 2.38 [CI, 1.39 to 4.00]) (5). Since 36% of our case-patients were taking aspirin at cohort entry, our findings contradict the hypothesis that the increased risk in the VIGOR trial was due to the protocol prohibition of aspirin. In addition, our results are similar to those of 2 recent observational studies that found an increased risk for myocardial infarction among users of high-dose rofecoxib (7, 9) and confirm that this risk extends to users of low doses.

The observed pattern of risk is consistent with the pharmacologic effects of COX-2 selective inhibitors, as well as with known pharmacodynamic differences among these agents (1, 4346). Selective COX-2–mediated inhibition of prostacyclin, a potent inhibitor of platelet aggregation, is believed to lead to a prothrombic state secondary to the unopposed activity of COX-1–mediated thromboxane A2(26, 4748). Thromboxane A2 is proatherothrombotic because it favors the triad of platelet aggregation, vasoconstriction, and smooth-muscle proliferation. In contrast, prostacyclin counters these effects, raising the possibility that COX-2 selective inhibitors may tip this homeostatic balance in favor of atherothrombosis. This hypothesis could also explain why rofecoxib, at least at low doses, appears to be susceptible to the cardioprotective effects of aspirin, a potent and irreversible inhibitor of thromboxane A2. The COX-2 inhibiting potency of rofecoxib is nearly 10 times greater than that of celecoxib or meloxicam, thereby possibly explaining the observed differences in risk between these COX inhibitors (4445). The unopposed prothrombic activity of thromboxane A2 associated with rofecoxib is likely to be considerably greater than that of celecoxib or meloxicam because of these differences in COX-2 selectivity. Finally, the absence of an increased risk with ever use of rofecoxib, in contrast to the elevated risk in current users, is consistent with the reversible nature of COX-2 inhibition exhibited by this agent (27).

Our study had some limitations. First, while we did not observe any increased risk with the use of meloxicam, traditional NSAIDs, or naproxen, our power to detect meaningful differences was limited by the unexpectedly low use of these agents. Second, only case-patients admitted to the hospital were included in our analysis. Missing events due to silent myocardial infarctions and sudden death could have resulted in incomplete case ascertainment. In addition, the intermittent use that occasionally accompanies NSAID therapy may have lead to misclassification of exposure. However, there is no reason to believe that ascertainment or exposure errors would have occurred differentially across drug groups. Consequently, any resulting bias would be toward the null. Third, we did not have information on smoking status, obesity, physical activity, family history, and socioeconomic status. If the distribution of these risk factors varied significantly across exposure groups, our results could be biased because of confounding by indication. Several studies have evaluated the potential for and magnitude of such bias and have demonstrated that any resulting bias would be negligible and directed toward the null (9, 42, 4950).

While a major strength of this study has been our accounting of the risk-modifying effects of aspirin, concern may exist about the possibility of misclassification due to missing information on over-the-counter use of aspirin, as well as ibuprofen (the only NSAID available over-the-counter in Canada). However, we expect the frequency of aspirin misclassification to be low because 1) a systematic campaign in Québec has been conducted to assure that all cardioprotective use of aspirin be formalized with written prescriptions (51), 2) low-dose aspirin is covered by the universal drug program, and 3) procurement of over-the-counter NSAIDs would be costlier. In addition, studies in similar populations but different jurisdictions have reported that self-medication with aspirin is low (≤10%) (9, 42, 4950). Finally, previous research conducted in Québec has shown that this prescription drug database captures almost all secondary cardioprotective aspirin use (18). Nevertheless, even if we accept that some degree of misclassification of aspirin use is possible, our data indicate that it would be nondifferential across the groups in comparison to the reference group (Table 4). The resulting bias would therefore be toward the null, meaning that our findings represent an underestimate of the true risk. Similar reasoning applies to over-the-counter use of ibuprofen.

It is important to consider the potential public health impact of our findings given the high prevalence of COX inhibitor use. A baseline rate of 10.6 MIs per 1000 person-years was observed in this cohort of elderly adults with no history of MI. This rate increased to 12.8 and 18.3 per 1000 persons per year among those receiving low and high doses of rofecoxib, respectively. Assuming causality, this corresponds to an excess rate attributable to rofecoxib of 2.2 and 7.7 MIs per 1000 exposed elderly adults per year.

In conclusion, our results provide evidence of an increased risk for myocardial infarction, nonfatal and fatal, with current use of rofecoxib, even in individuals with no history of myocardial infarction. The concomitant use of aspirin in persons using low-dose rofecoxib appears to mitigate this risk. Although the observational nature of our study limits the ability to assign causality, the totality of the current evidence confirms the increased cardiovascular risk associated with rofecoxib and the sagacity of its withdrawal. Of equal importance, we provide evidence against a broad class effect for COX-2–mediated cardiotoxicity when used at usual doses. Nevertheless, given the widespread use of these agents and the increased risk seen in a recent cancer trial of high-dose celecoxib, further research should be undertaken. Until evidence to the contrary is available, new agents with COX-2 inhibitory potency similar to or greater than that of rofecoxib should be used only with extreme caution, even in populations at relatively low risk for cardiovascular events.

Vane JR, Bakhle YS, Botting RM.  Cyclooxygenases 1 and 2. Annu Rev Pharmacol Toxicol. 1998; 38:97-120. PubMed
 
Bombardier C, Laine L, Reicin A, Shapiro D, Burgos-Vargas R, Davis B, et al.  Comparison of upper gastrointestinal toxicity of rofecoxib and naproxen in patients with rheumatoid arthritis. VIGOR Study Group. N Engl J Med. 2000;343:1520-8, 2 p following 1528. [PMID: 11087881]
 
Singh G.  Recent considerations in nonsteroidal anti-inflammatory drug gastropathy. Am J Med. 1998; 105:31S-38S. PubMed
 
FDA Advisory Committee.  Cardiovascular Safety Review of Rofecoxib. Rockville, MD: Food and Drug Administration; 2001.
 
Mukherjee D, Nissen SE, Topol EJ.  Risk of cardiovascular events associated with selective COX-2 inhibitors. JAMA. 2001; 286:954-9. PubMed
 
Silverstein FE, Faich G, Goldstein JL, Simon LS, Pincus T, Whelton A. et al.  Gastrointestinal toxicity with celecoxib vs nonsteroidal anti-inflammatory drugs for osteoarthritis and rheumatoid arthritis: the CLASS study: A randomized controlled trial. Celecoxib Long-term Arthritis Safety Study. JAMA. 2000; 284:1247-55. PubMed
 
Ray WA, Stein CM, Daugherty JR, Hall K, Arbogast PG, Griffin MR.  COX-2 selective non-steroidal anti-inflammatory drugs and risk of serious coronary heart disease. Lancet. 2002; 360:1071-3. PubMed
 
Mamdani M, Rochon P, Juurlink DN, Anderson GM, Kopp A, Naglie G. et al.  Effect of selective cyclooxygenase 2 inhibitors and naproxen on short-term risk of acute myocardial infarction in the elderly. Arch Intern Med. 2003; 163:481-6. PubMed
 
Solomon DH, Schneeweiss S, Glynn RJ, Kiyota Y, Levin R, Mogun H. et al.  Relationship between selective cyclooxygenase-2 inhibitors and acute myocardial infarction in older adults. Circulation. 2004; 109:2068-73. PubMed
 
Kimmel SE, Berlin JA, Reilly M, Jaskowiak J, Kishel L, Chittams J. et al.  Patients exposed to rofecoxib and celecoxib have different odds of nonfatal myocardial infarction. Ann Intern Med. 2005; 142:157-64.
 
Konstam MA, Weir MR, Reicin A, Shapiro D, Sperling RS, Barr E. et al.  Cardiovascular thrombotic events in controlled, clinical trials of rofecoxib. Circulation. 2001; 104:2280-8. PubMed
 
Reicin AS, Shapiro D, Sperling RS, Barr E, Yu Q.  Comparison of cardiovascular thrombotic events in patients with osteoarthritis treated with rofecoxib versus nonselective nonsteroidal anti-inflammatory drugs (ibuprofen, diclofenac, and nabumetone). Am J Cardiol. 2002; 89:204-9. PubMed
 
White WB, Faich G, Borer JS, Makuch RW.  Cardiovascular thrombotic events in arthritis trials of the cyclooxygenase-2 inhibitor celecoxib. Am J Cardiol. 2003; 92:411-8. PubMed
 
Neilan T.  Merck pulls Vioxx painkiller from market, and stock plunges. The New York Times. 30 September 2004.
 
Abraham C.  Death of a wonder drug—Vioxx, the ‘super aspirin,’ is yanked over heart risk. The Globe and Mail. 1 October 2004:A1.
 
U.S. Food and Drug Administration.  FDA Public Health Advisory: safety of Vioxx. Accessed athttp://www.fda.gov/cder/drug/infopage/vioxx/PHA_vioxx.htmon 30 September 2004.
 
Rahme E, Pilote L, LeLorier J.  Association between naproxen use and protection against acute myocardial infarction. Arch Intern Med. 2002; 162:1111-5. PubMed
 
Brophy JM, Bourgault C, Brassard P.  The use of cholesterol-lowering medications after coronary revascularization. CMAJ. 2003; 169:1153-7. PubMed
 
Brassard P, Bourgault C, Brophy J, Kezouh A, Suissa S.  Antibiotics in primary prevention of stroke in the elderly. Stroke. 2003; 34:163-6. PubMed
 
Brassard P, Bourgault C, Brophy J, Kezouh A, Rainville B, Xhignesse M. et al.  Antibiotics in primary prevention of myocardial infarction among elderly patients with hypertension. Am Heart J. 2003; 145:20. PubMed
 
Rahme E, Joseph L, Kong SX, Watson DJ, LeLorier J.  Gastrointestinal health care resource use and costs associated with nonsteroidal antiinflammatory drugs versus acetaminophen: retrospective cohort study of an elderly population. Arthritis Rheum. 2000; 43:917-24. PubMed
 
Garbe E, LeLorier J, Boivin JF, Suissa S.  Inhaled and nasal glucocorticoids and the risks of ocular hypertension or open-angle glaucoma. JAMA. 1997; 277:722-7. PubMed
 
Lévesque L, Brophy JM, Zhang B, Bourgault C.  Cox-2 selective inhibitors and cardiovascular outcomes in an elderly population [Abstract]. Pharmacoepidemiology and Drug Safety. 2004; 13:Suppl 1S49.
 
Levy AR, Tamblyn RM, Fitchett D, McLeod PJ, Hanley JA.  Coding accuracy of hospital discharge data for elderly survivors of myocardial infarction. Can J Cardiol. 1999; 15:1277-82. PubMed
 
Tamblyn R, Lavoie G, Petrella L, Monette J.  The use of prescription claims databases in pharmacoepidemiological research: the accuracy and comprehensiveness of the prescription claims database in Quebec. J Clin Epidemiol. 1995; 48:999-1009. PubMed
 
Morrow JD, Roberts LJ Jr.  Lipid-derived autocoids: eicosanoids and platelet activating factor. Hardman JG, Limbird LE Goodman and Gilman's the Pharmacological Basis of Therapeutics. 10th ed. New York: McGraw-Hill; 2001.
 
Roberts LJ Jr, Morrow JD.  Analgesic-antipyretic and antiinflammatory agents and drugs employed in the treatment of gout. Hardman JG, Limbird LE Goodman and Gilman's The Pharmacological Basis of Therapeutics. 10th ed. New York: McGraw-Hill; 2001.
 
Breslow NE, Day NE.  Fitting models to continuous data. Breslow NE, Day NE Statistical Methods in Cancer Research. Vol. 2: The Design and Analysis of Cohort Studies. IARC Scientific Publications No. 82 ed. Lyon, France: International Agency of Research on Cancer; 1987; 178-229.
 
Suissa S.  Novel approaches to pharmacoepidemiology study design and statistical analysis. Strom BL Pharmacoepidemiology. 3rd ed. Chichester, United Kingdom: J Wiley; 2000; 785-805.
 
Hosmer DW, Lemeshow S.  Applied Logistic Regression. New York: J Wiley; 1989.
 
Collet D.  Modelling data from epidemiological studies. Collet D Modelling Binary Data. New York: Chapman & Hall/CRC; 1999; 223-76.
 
Von Korff M, Wagner EH, Saunders K.  A chronic disease score from automated pharmacy data. J Clin Epidemiol. 1992; 45:197-203. PubMed
 
Schneeweiss S, Seeger JD, Maclure M, Wang PS, Avorn J, Glynn RJ.  Performance of comorbidity scores to control for confounding in epidemiologic studies using claims data. Am J Epidemiol. 2001; 154:854-64. PubMed
 
Charlson ME, Pompei P, Ales KL, MacKenzie CR.  A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987; 40:373-83. PubMed
 
Greenland S.  Modeling and variable selection in epidemiologic analysis. Am J Public Health. 1989; 79:340-9. PubMed
 
.  Collaborative meta-analysis of randomised trials of antiplatelet therapy for prevention of death, myocardial infarction, and stroke in high risk patients. BMJ. 2002; 324:71-86. PubMed
 
Patrono C.  Aspirin: new cardiovascular uses for an old drug. Am J Med. 2001; 110:62S-65S. PubMed
 
Juni P, Nartey L, Reichenbach S, Sterchi R, Dieppe PA, Egger M.  Risk of cardiovascular events and rofecoxib: cumulative meta-analysis. Lancet. 2004; 364:2021-9. PubMed
 
Solomon DH, Glynn RJ, Levin R, Avorn J.  Nonsteroidal anti-inflammatory drug use and acute myocardial infarction. Arch Intern Med. 2002; 162:1099-104. PubMed
 
Watson DJ, Rhodes T, Cai B, Guess HA.  Lower risk of thromboembolic cardiovascular events with naproxen among patients with rheumatoid arthritis. Arch Intern Med. 2002; 162:1105-10. PubMed
 
Jick SS.  The risk of gastrointestinal bleed, myocardial infarction, and newly diagnosed hypertension in users of meloxicam, diclofenac, naproxen, and piroxicam. Pharmacotherapy. 2000; 20:741-4. PubMed
 
Ray WA, Stein CM, Hall K, Daugherty JR, Griffin MR.  Non-steroidal anti-inflammatory drugs and risk of serious coronary heart disease: an observational cohort study. Lancet. 2002; 359:118-23. PubMed
 
Cryer B, Feldman M.  Cyclooxygenase-1 and cyclooxygenase-2 selectivity of widely used nonsteroidal anti-inflammatory drugs. Am J Med. 1998; 104:413-21. PubMed
 
Warner TD, Giuliano F, Vojnovic I, Bukasa A, Mitchell JA, Vane JR.  Nonsteroid drug selectivities for cyclo-oxygenase-1 rather than cyclo-oxygenase-2 are associated with human gastrointestinal toxicity: a full in vitro analysis. Proc Natl Acad Sci U S A. 1999; 96:7563-8. PubMed
 
Wright JM.  The double-edged sword of COX-2 selective NSAIDs. CMAJ. 2002; 167:1131-7. PubMed
 
Marnett LJ, Rowlinson SW, Goodwin DC, Kalgutkar AS, Lanzo CA.  Arachidonic acid oxygenation by COX-1 and COX-2. Mechanisms of catalysis and inhibition. J Biol Chem. 1999; 274:22903-6. PubMed
 
Cheng Y, Austin SC, Rocca B, Koller BH, Coffman TM, Grosser T. et al.  Role of prostacyclin in the cardiovascular response to thromboxane A2. Science. 2002; 296:539-41. PubMed
 
FitzGerald GA, Cheng Y, Austin S.  COX-2 inhibitors and the cardiovascular system. Clin Exp Rheumatol. 2001; 19:S31-6. PubMed
 
Velentgas P, Cali C, Diedrick G, Heinen J, Walker AM, Dreyer NA, Vergurg KM.  A survey of aspirin use, non-prescription NSAID use, and cigarette smoking among users and non users of prescription NSAIDs: estimates of the effect of unmeasured confounding by the factors on studies of NSAIDs use and risk of MI [Abstract]. Pharmacoepidemiology and Drug Safety. 2001; 10:Suppl 1S103.
 
Graham DJ, Campen D, Cheetham C, Hui R, Spence M, Ray WA.  Risk of acute cardiac events among patients treated with cyclooxygenase-2 selective and non-selective nonsteroidal antiinflammatory drugs [Abstract]. Pharmacoepidemiology and Drug Safety. 2004; 13:Suppl 1S287.
 
Beaulieu MD, Brophy J, Jacques A, Blais R, Battista R, Lebeau R.  Drug treatment of stable angina pectoris and mass dissemination of therapeutic guidelines: a randomized controlled trial. QJM. 2004; 97:21-31. PubMed
 

Figures

Grahic Jump Location
Figure.
Flow of study cohort.

AMI = acute myocardial infarction; ICD-9 = International Classification of Diseases, Ninth Revision; NSAID = nonsteroidal anti-inflammatory drug.

Grahic Jump Location

Tables

Table Jump PlaceholderTable 1.  Characteristics of Case-Patients and Controls
Table Jump PlaceholderTable 2.  Crude and Adjusted Rate Ratios of Acute Myocardial Infarction for Use of Various Anti-Inflammatory Agents
Table Jump PlaceholderTable 3.  Crude and Adjusted Rate Ratios of Acute Myocardial Infarction for Current Use of Celecoxib and Rofecoxib according to Dose
Table Jump PlaceholderTable 4.  Crude and Adjusted Rate Ratios of Acute Myocardial Infarction for Current Use of Anti-Inflammatory Agents according to Concomitant Use of Aspirin and Dose of Cyclooxygenase-2 Selective Inhibitors

References

Vane JR, Bakhle YS, Botting RM.  Cyclooxygenases 1 and 2. Annu Rev Pharmacol Toxicol. 1998; 38:97-120. PubMed
 
Bombardier C, Laine L, Reicin A, Shapiro D, Burgos-Vargas R, Davis B, et al.  Comparison of upper gastrointestinal toxicity of rofecoxib and naproxen in patients with rheumatoid arthritis. VIGOR Study Group. N Engl J Med. 2000;343:1520-8, 2 p following 1528. [PMID: 11087881]
 
Singh G.  Recent considerations in nonsteroidal anti-inflammatory drug gastropathy. Am J Med. 1998; 105:31S-38S. PubMed
 
FDA Advisory Committee.  Cardiovascular Safety Review of Rofecoxib. Rockville, MD: Food and Drug Administration; 2001.
 
Mukherjee D, Nissen SE, Topol EJ.  Risk of cardiovascular events associated with selective COX-2 inhibitors. JAMA. 2001; 286:954-9. PubMed
 
Silverstein FE, Faich G, Goldstein JL, Simon LS, Pincus T, Whelton A. et al.  Gastrointestinal toxicity with celecoxib vs nonsteroidal anti-inflammatory drugs for osteoarthritis and rheumatoid arthritis: the CLASS study: A randomized controlled trial. Celecoxib Long-term Arthritis Safety Study. JAMA. 2000; 284:1247-55. PubMed
 
Ray WA, Stein CM, Daugherty JR, Hall K, Arbogast PG, Griffin MR.  COX-2 selective non-steroidal anti-inflammatory drugs and risk of serious coronary heart disease. Lancet. 2002; 360:1071-3. PubMed
 
Mamdani M, Rochon P, Juurlink DN, Anderson GM, Kopp A, Naglie G. et al.  Effect of selective cyclooxygenase 2 inhibitors and naproxen on short-term risk of acute myocardial infarction in the elderly. Arch Intern Med. 2003; 163:481-6. PubMed
 
Solomon DH, Schneeweiss S, Glynn RJ, Kiyota Y, Levin R, Mogun H. et al.  Relationship between selective cyclooxygenase-2 inhibitors and acute myocardial infarction in older adults. Circulation. 2004; 109:2068-73. PubMed
 
Kimmel SE, Berlin JA, Reilly M, Jaskowiak J, Kishel L, Chittams J. et al.  Patients exposed to rofecoxib and celecoxib have different odds of nonfatal myocardial infarction. Ann Intern Med. 2005; 142:157-64.
 
Konstam MA, Weir MR, Reicin A, Shapiro D, Sperling RS, Barr E. et al.  Cardiovascular thrombotic events in controlled, clinical trials of rofecoxib. Circulation. 2001; 104:2280-8. PubMed
 
Reicin AS, Shapiro D, Sperling RS, Barr E, Yu Q.  Comparison of cardiovascular thrombotic events in patients with osteoarthritis treated with rofecoxib versus nonselective nonsteroidal anti-inflammatory drugs (ibuprofen, diclofenac, and nabumetone). Am J Cardiol. 2002; 89:204-9. PubMed
 
White WB, Faich G, Borer JS, Makuch RW.  Cardiovascular thrombotic events in arthritis trials of the cyclooxygenase-2 inhibitor celecoxib. Am J Cardiol. 2003; 92:411-8. PubMed
 
Neilan T.  Merck pulls Vioxx painkiller from market, and stock plunges. The New York Times. 30 September 2004.
 
Abraham C.  Death of a wonder drug—Vioxx, the ‘super aspirin,’ is yanked over heart risk. The Globe and Mail. 1 October 2004:A1.
 
U.S. Food and Drug Administration.  FDA Public Health Advisory: safety of Vioxx. Accessed athttp://www.fda.gov/cder/drug/infopage/vioxx/PHA_vioxx.htmon 30 September 2004.
 
Rahme E, Pilote L, LeLorier J.  Association between naproxen use and protection against acute myocardial infarction. Arch Intern Med. 2002; 162:1111-5. PubMed
 
Brophy JM, Bourgault C, Brassard P.  The use of cholesterol-lowering medications after coronary revascularization. CMAJ. 2003; 169:1153-7. PubMed
 
Brassard P, Bourgault C, Brophy J, Kezouh A, Suissa S.  Antibiotics in primary prevention of stroke in the elderly. Stroke. 2003; 34:163-6. PubMed
 
Brassard P, Bourgault C, Brophy J, Kezouh A, Rainville B, Xhignesse M. et al.  Antibiotics in primary prevention of myocardial infarction among elderly patients with hypertension. Am Heart J. 2003; 145:20. PubMed
 
Rahme E, Joseph L, Kong SX, Watson DJ, LeLorier J.  Gastrointestinal health care resource use and costs associated with nonsteroidal antiinflammatory drugs versus acetaminophen: retrospective cohort study of an elderly population. Arthritis Rheum. 2000; 43:917-24. PubMed
 
Garbe E, LeLorier J, Boivin JF, Suissa S.  Inhaled and nasal glucocorticoids and the risks of ocular hypertension or open-angle glaucoma. JAMA. 1997; 277:722-7. PubMed
 
Lévesque L, Brophy JM, Zhang B, Bourgault C.  Cox-2 selective inhibitors and cardiovascular outcomes in an elderly population [Abstract]. Pharmacoepidemiology and Drug Safety. 2004; 13:Suppl 1S49.
 
Levy AR, Tamblyn RM, Fitchett D, McLeod PJ, Hanley JA.  Coding accuracy of hospital discharge data for elderly survivors of myocardial infarction. Can J Cardiol. 1999; 15:1277-82. PubMed
 
Tamblyn R, Lavoie G, Petrella L, Monette J.  The use of prescription claims databases in pharmacoepidemiological research: the accuracy and comprehensiveness of the prescription claims database in Quebec. J Clin Epidemiol. 1995; 48:999-1009. PubMed
 
Morrow JD, Roberts LJ Jr.  Lipid-derived autocoids: eicosanoids and platelet activating factor. Hardman JG, Limbird LE Goodman and Gilman's the Pharmacological Basis of Therapeutics. 10th ed. New York: McGraw-Hill; 2001.
 
Roberts LJ Jr, Morrow JD.  Analgesic-antipyretic and antiinflammatory agents and drugs employed in the treatment of gout. Hardman JG, Limbird LE Goodman and Gilman's The Pharmacological Basis of Therapeutics. 10th ed. New York: McGraw-Hill; 2001.
 
Breslow NE, Day NE.  Fitting models to continuous data. Breslow NE, Day NE Statistical Methods in Cancer Research. Vol. 2: The Design and Analysis of Cohort Studies. IARC Scientific Publications No. 82 ed. Lyon, France: International Agency of Research on Cancer; 1987; 178-229.
 
Suissa S.  Novel approaches to pharmacoepidemiology study design and statistical analysis. Strom BL Pharmacoepidemiology. 3rd ed. Chichester, United Kingdom: J Wiley; 2000; 785-805.
 
Hosmer DW, Lemeshow S.  Applied Logistic Regression. New York: J Wiley; 1989.
 
Collet D.  Modelling data from epidemiological studies. Collet D Modelling Binary Data. New York: Chapman & Hall/CRC; 1999; 223-76.
 
Von Korff M, Wagner EH, Saunders K.  A chronic disease score from automated pharmacy data. J Clin Epidemiol. 1992; 45:197-203. PubMed
 
Schneeweiss S, Seeger JD, Maclure M, Wang PS, Avorn J, Glynn RJ.  Performance of comorbidity scores to control for confounding in epidemiologic studies using claims data. Am J Epidemiol. 2001; 154:854-64. PubMed
 
Charlson ME, Pompei P, Ales KL, MacKenzie CR.  A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987; 40:373-83. PubMed
 
Greenland S.  Modeling and variable selection in epidemiologic analysis. Am J Public Health. 1989; 79:340-9. PubMed
 
.  Collaborative meta-analysis of randomised trials of antiplatelet therapy for prevention of death, myocardial infarction, and stroke in high risk patients. BMJ. 2002; 324:71-86. PubMed
 
Patrono C.  Aspirin: new cardiovascular uses for an old drug. Am J Med. 2001; 110:62S-65S. PubMed
 
Juni P, Nartey L, Reichenbach S, Sterchi R, Dieppe PA, Egger M.  Risk of cardiovascular events and rofecoxib: cumulative meta-analysis. Lancet. 2004; 364:2021-9. PubMed
 
Solomon DH, Glynn RJ, Levin R, Avorn J.  Nonsteroidal anti-inflammatory drug use and acute myocardial infarction. Arch Intern Med. 2002; 162:1099-104. PubMed
 
Watson DJ, Rhodes T, Cai B, Guess HA.  Lower risk of thromboembolic cardiovascular events with naproxen among patients with rheumatoid arthritis. Arch Intern Med. 2002; 162:1105-10. PubMed
 
Jick SS.  The risk of gastrointestinal bleed, myocardial infarction, and newly diagnosed hypertension in users of meloxicam, diclofenac, naproxen, and piroxicam. Pharmacotherapy. 2000; 20:741-4. PubMed
 
Ray WA, Stein CM, Hall K, Daugherty JR, Griffin MR.  Non-steroidal anti-inflammatory drugs and risk of serious coronary heart disease: an observational cohort study. Lancet. 2002; 359:118-23. PubMed
 
Cryer B, Feldman M.  Cyclooxygenase-1 and cyclooxygenase-2 selectivity of widely used nonsteroidal anti-inflammatory drugs. Am J Med. 1998; 104:413-21. PubMed
 
Warner TD, Giuliano F, Vojnovic I, Bukasa A, Mitchell JA, Vane JR.  Nonsteroid drug selectivities for cyclo-oxygenase-1 rather than cyclo-oxygenase-2 are associated with human gastrointestinal toxicity: a full in vitro analysis. Proc Natl Acad Sci U S A. 1999; 96:7563-8. PubMed
 
Wright JM.  The double-edged sword of COX-2 selective NSAIDs. CMAJ. 2002; 167:1131-7. PubMed
 
Marnett LJ, Rowlinson SW, Goodwin DC, Kalgutkar AS, Lanzo CA.  Arachidonic acid oxygenation by COX-1 and COX-2. Mechanisms of catalysis and inhibition. J Biol Chem. 1999; 274:22903-6. PubMed
 
Cheng Y, Austin SC, Rocca B, Koller BH, Coffman TM, Grosser T. et al.  Role of prostacyclin in the cardiovascular response to thromboxane A2. Science. 2002; 296:539-41. PubMed
 
FitzGerald GA, Cheng Y, Austin S.  COX-2 inhibitors and the cardiovascular system. Clin Exp Rheumatol. 2001; 19:S31-6. PubMed
 
Velentgas P, Cali C, Diedrick G, Heinen J, Walker AM, Dreyer NA, Vergurg KM.  A survey of aspirin use, non-prescription NSAID use, and cigarette smoking among users and non users of prescription NSAIDs: estimates of the effect of unmeasured confounding by the factors on studies of NSAIDs use and risk of MI [Abstract]. Pharmacoepidemiology and Drug Safety. 2001; 10:Suppl 1S103.
 
Graham DJ, Campen D, Cheetham C, Hui R, Spence M, Ray WA.  Risk of acute cardiac events among patients treated with cyclooxygenase-2 selective and non-selective nonsteroidal antiinflammatory drugs [Abstract]. Pharmacoepidemiology and Drug Safety. 2004; 13:Suppl 1S287.
 
Beaulieu MD, Brophy J, Jacques A, Blais R, Battista R, Lebeau R.  Drug treatment of stable angina pectoris and mass dissemination of therapeutic guidelines: a randomized controlled trial. QJM. 2004; 97:21-31. PubMed
 

Letters

NOTE:
Citing articles are presented as examples only. In non-demo SCM6 implementation, integration with CrossRef’s "Cited By" API will populate this tab (http://www.crossref.org/citedby.html).

Comments

Submit a Comment
Submit a Comment

Summary for Patients

Risk for Heart Attacks with Different NSAIDs

The summary below is from the full report titled “The Risk for Myocardial Infarction with Cyclooxygenase-2 Inhibitors: A Population Study of Elderly Adults.” It is in the 5 April 2005 issue of Annals of Internal Medicine (volume 142, pages 481-489). The authors are L.E. Lévesque, J.M. Brophy, and B. Zhang.

Read More...

Clinical Slide Sets

Terms of Use

The In the Clinic® slide sets are owned and copyrighted by the American College of Physicians (ACP). All text, graphics, trademarks, and other intellectual property incorporated into the slide sets remain the sole and exclusive property of the ACP. The slide sets may be used only by the person who downloads or purchases them and only for the purpose of presenting them during not-for-profit educational activities. Users may incorporate the entire slide set or selected individual slides into their own teaching presentations but may not alter the content of the slides in any way or remove the ACP copyright notice. Users may make print copies for use as hand-outs for the audience the user is personally addressing but may not otherwise reproduce or distribute the slides by any means or media, including but not limited to sending them as e-mail attachments, posting them on Internet or Intranet sites, publishing them in meeting proceedings, or making them available for sale or distribution in any unauthorized form, without the express written permission of the ACP. Unauthorized use of the In the Clinic slide sets will constitute copyright infringement.

Toolkit

Want to Subscribe?

Learn more about subscription options

Advertisement
Related Articles
Related Point of Care
Topic Collections
PubMed Articles

Want to Subscribe?

Learn more about subscription options

Forgot your password?
Enter your username and email address. We'll send you a reminder to the email address on record.
(Required)
(Required)