Abstract
Background
Hydroxychloroquine has been widely administered to patients with Covid-19 without robust evidence supporting its use.
Methods
We examined the association between hydroxychloroquine use and intubation or death at a large medical center in New York City. Data were obtained regarding consecutive patients hospitalized with Covid-19, excluding those who were intubated, died, or discharged within 24 hours after presentation to the emergency department (study baseline). The primary end point was a composite of intubation or death in a time-to-event analysis. We compared outcomes in patients who received hydroxychloroquine with those in patients who did not, using a multivariable Cox model with inverse probability weighting according to the propensity score.
Results
Of 1446 consecutive patients, 70 patients were intubated, died, or discharged within 24 hours after presentation and were excluded from the analysis. Of the remaining 1376 patients, during a median follow-up of 22.5 days, 811 (58.9%) received hydroxychloroquine (600 mg twice on day 1, then 400 mg daily for a median of 5 days); 45.8% of the patients were treated within 24 hours after presentation to the emergency department, and 85.9% within 48 hours. Hydroxychloroquine-treated patients were more severely ill at baseline than those who did not receive hydroxychloroquine (median ratio of partial pressure of arterial oxygen to the fraction of inspired oxygen, 223 vs. 360). Overall, 346 patients (25.1%) had a primary end-point event (180 patients were intubated, of whom 66 subsequently died, and 166 died without intubation). In the main analysis, there was no significant association between hydroxychloroquine use and intubation or death (hazard ratio, 1.04, 95% confidence interval, 0.82 to 1.32). Results were similar in multiple sensitivity analyses.
Conclusions
In this observational study involving patients with Covid-19 who had been admitted to the hospital, hydroxychloroquine administration was not associated with either a greatly lowered or an increased risk of the composite end point of intubation or death. Randomized, controlled trials of hydroxychloroquine in patients with Covid-19 are needed. (Funded by the National Institutes of Health.)
Introduction
The aminoquinolines chloroquine and hydroxychloroquine are widely used in the treatment of malaria and rheumatic diseases, and they have been suggested as effective treatments for coronavirus disease 2019 (Covid-19) on the grounds of both antiinflammatory and antiviral effects.1-4 In the United States, the Food and Drug Administration issued an Emergency Use Authorization on March 30, 2020, that allowed the use of these drugs in patients with Covid-19 who were not enrolled in clinical trials. Guidelines suggested that these drugs be administered to hospitalized patients who had evidence of pneumonia,5 and to date, they have been used in many thousands of patients with acute Covid-19 around the world. However, to date, there have been no robust clinical trials that have shown efficacy of these agents for this illness, and the data that are available come from small studies that have either been uncontrolled or underpowered to detect meaningful clinical effects.
The original report of hydroxychloroquine as a treatment for Covid-19 described 26 patients who had been treated in an open-label, single-group study that involved contemporaneous, but nonrandomized controls in hospitals in France.6 Patients were treated with hydroxychloroquine at a dose of 200 mg three times daily for 10 days. Data from this study were reported as showing the effectiveness of hydroxychloroquine in reducing the viral burden in treated patients (65.0% clearance by day 5, vs. 18.8% clearance by day 5 in untreated patients). However, data from 6 patients who received hydroxychloroquine were excluded from the analysis because of clinical worsening or loss to follow-up, which makes it difficult to interpret the findings.
Recent work suggests that hydroxychloroquine has more potent antiviral properties than chloroquine, as well as a better safety profile.7 In accordance with clinical guidelines developed at our medical center, hydroxychloroquine was suggested as treatment for hospitalized patients with Covid-19 and respiratory difficulty, as indicated by a low resting oxygen saturation, during the period in which patients in this report were admitted.
We examined the association between hydroxychloroquine use and respiratory failure at a large medical center providing care to a substantial number of patients with Covid-19 in New York City. We hypothesized that hydroxychloroquine use would be associated with a lower risk of a composite end point of intubation or death in analyses that were adjusted for major predictors of respiratory failure and weighted according to propensity scores assessing the probability of hydroxychloroquine use.
Methods
Setting
We conducted this study at New York–Presbyterian Hospital (NYP)–Columbia University Irving Medical Center (CUIMC), a quaternary, acute care hospital in northern Manhattan. We obtained samples from all admitted adults who had a positive test result for the virus SARS-CoV-2 from analysis of nasopharyngeal or oropharyngeal swab specimens obtained at any point during their hospitalization from March 7 to April 8, 2020. Follow-up continued through April 25, 2020. These tests were conducted by the New York State Department of Health until the NYP–CUIMC laboratory developed internal testing capability with a reverse-transcriptase–polymerase-chain-reaction assay on March 11, 2020. Patients who were intubated, who died, or who were transferred to another facility within 24 hours after presentation to the emergency department were excluded from the analysis. The institutional review board at CUIMC approved this analysis under an expedited review.
A guidance developed by the Department of Medicine and distributed to all the house staff and attending staff at our medical center suggested hydroxychloroquine as a therapeutic option for patients with Covid-19 who presented with moderate-to-severe respiratory illness, which was defined as a resting oxygen saturation of less than 94% while they were breathing ambient air. The suggested hydroxychloroquine regimen was a loading dose of 600 mg twice on day 1, followed by 400 mg daily for 4 additional days. Azithromycin at a dose of 500 mg on day 1 and then 250 mg daily for 4 more days in combination with hydroxychloroquine was an additional suggested therapeutic option. The azithromycin suggestion was removed on April 12, 2020, and the hydroxychloroquine suggestion was removed on April 29, 2020. The decision to prescribe either or both medications was left to the discretion of the treating team for each individual patient.
Patients receiving sarilumab were allowed to continue hydroxychloroquine. Patients receiving remdesivir as part of a randomized trial either did not receive or had completed a course of treatment with hydroxychloroquine.
Data Sources
We obtained data from the NYP–CUIMC clinical data warehouse. This warehouse contains all the clinical data available on all inpatient and outpatient visits to one of the CUIMC facilities (see the Data Extraction section in the Supplementary Appendix, available with the full text of this article at NEJM.org). No data were manually abstracted from the electronic medical record or charts. The data obtained included patients’ demographic details, insurance status, vital signs, laboratory test results, medication administration data, historical and current medication lists, historical and current diagnoses, clinical notes, historical discharge disposition for previous inpatient hospitalizations, and ventilator use data.
Variables Assessed
From the clinical data warehouse, we obtained the following data elements for each patient: age; sex; patient-reported race and ethnic group; current insurance carrier; the first recorded vital signs on presentation; the ratio of the partial pressure of arterial oxygen to the fraction of inspired oxygen (Pao2:Fio2) at admission, estimated with the use of methods developed by Brown and colleagues8,9 (see the Data Extraction section in the Supplementary Appendix); the first recorded body-mass index as calculated for measured height and weight (the body-mass index is the weight in kilograms divided by the square of the height in meters), grouped on the basis of the Centers for Disease Control and Prevention guidelines for adults; the first recorded inpatient laboratory tests; past and current diagnoses; patient-reported smoking status; and medication administration at baseline. Details of the variables assessed are provided in the Supplementary Appendix.
Hydroxychloroquine Exposure
Patients were defined as receiving hydroxychloroquine if they were receiving it at study baseline or received it during the follow-up period before intubation or death. Study baseline was defined as 24 hours after arrival at the emergency department.
End Point
The primary end point was the time from study baseline to intubation or death. For patients who died after intubation, the timing of the primary end point was defined as the time of intubation.
Statistical Analysis
We calculated bivariate frequencies to examine the associations among the preadmission variables described above. Patients without a primary end-point event had their data censored on April 25, 2020.
Cox proportional-hazards regression models were used to estimate the association between hydroxychloroquine use and the composite end point of intubation or death. An initial multivariable Cox regression model included demographic factors, clinical factors, laboratory tests, and medications. In addition, to help account for the nonrandomized treatment administration of hydroxychloroquine, we used propensity-score methods to reduce the effects of confounding. The individual propensities for receipt of hydroxychloroquine treatment were estimated with the use of a multivariable logistic-regression model that included the same covariates as the Cox regression model. Associations between hydroxychloroquine use and respiratory failure were then estimated by multivariable Cox regression models with the use of three propensity-score methods.
The primary analysis used inverse probability weighting. In the inverse-probability-weighted analysis, the predicted probabilities from the propensity-score model were used to calculate the stabilized inverse-probability-weighting weight.10 Kaplan–Meier curves and Cox models that used the inverse-probability-weighting weights were reported.
We conducted a secondary analysis that used propensity-score matching and another that included the propensity score as an additional covariate. In the propensity-score matching analysis, the nearest-neighbor method was applied to create a matched control sample. Additional sensitivity analyses included the same set of analyses with the use of a different study baseline of 48 hours after arrival to the emergency department as well as analyses that defined the exposure as receipt of the first dose of hydroxychloroquine before study baseline only. Multiple imputation was used to handle missing data, and model estimates and standard errors were calculated with Rubin’s rules.11 The nonparametric bootstrap method was used to obtain 95% pointwise confidence intervals for the inverse-probability-weighted Kaplan–Meier curves. The statistical analyses were performed with the use of R software, version 3.6.1 (R Project for Statistical Computing).
Results
Characteristics of the Cohort
Figure 1.
Study baseline was defined as 24 hours after arrival at the emergency department. Covid-19 denotes coronavirus disease 2019.
Of 1446 consecutive patients with Covid-19 who were admitted to the hospital between March 7 and April 8, 2020, a total of 70 patients were excluded from this study because they had already had intubation or death, were discharged after inpatient admission, or were directly admitted to alternative facilities within 24 hours after presentation to the emergency department. Thus, 1376 patients were included in the analysis (Figure 1).
Over a median follow-up of 22.5 days, 346 patients (25.1%) had a primary end-point event (166 patients died without being intubated, and 180 were intubated). At the time of data cutoff on April 25, a total of 232 patients had died (66 after intubation), 1025 had survived to hospital discharge, and 119 were still hospitalized (only 24 of whom were not intubated) (Table S1 in the Supplementary Appendix).
Table 1.
Of the 1376 patients, 811 (58.9%) received hydroxychloroquine (median duration of treatment, 5 days) and 565 (41.1%) did not. Among the patients who received hydroxychloroquine, 45.8% received it in the 24 hours between their presentation to the emergency department and the start of study follow-up, and 85.9% received it within 48 hours after presentation to the emergency department. The timing of the first dose of hydroxychloroquine after presentation to the medical center is shown in Figure S3. The distribution of the patients’ baseline characteristics according to hydroxychloroquine exposure is shown in Table 1, both in the unmatched and propensity-score–matched analytic samples. In the unmatched sample, hydroxychloroquine exposure differed according to age group, sex, race and ethnic group, body-mass index, insurance, smoking status, and current use of other medications. Hydroxychloroquine-treated patients had a lower Pao2:Fio2 at baseline than did patients who did not receive hydroxychloroquine (median, 233 vs. 360 mm Hg). In addition to the 27 patients listed in Table 1 who received remdesivir according to compassionate use, 30 patients in the study cohort were enrolled in randomized, blinded, placebo-controlled trials of that investigational agent or of sarilumab.
Table 2.
The distribution of the estimated propensity scores for receipt of hydroxychloroquine among patients who did and did not receive hydroxychloroquine is shown in Figure S1. The odds ratios (with 95% confidence intervals) for receipt of hydroxychloroquine according to all the variables included in the propensity-score model are shown in Table S2. The C-statistic of the propensity-score model was 0.81. In the matched analytic sample, 811 patients were exposed to hydroxychloroquine and 274 were not exposed. The differences between hydroxychloroquine and pretreatment variables were attenuated in the propensity-score–matched samples as compared with the unmatched samples (Table 2 and Fig. S2).
Study End Points
Figure 2.
The shaded areas represent pointwise 95% confidence intervals.
Among the 1376 patients included in the analysis, the primary end point of respiratory failure developed in 346 patients (25.1%); a total of 180 patients were intubated, and 166 died without intubation. In the crude, unadjusted analysis, patients who had received hydroxychloroquine were more likely to have had a primary end-point event than were patients who did not (hazard ratio, 2.37; 95% CI, 1.84 to 3.02) (Table 2). In the primary multivariable analysis with inverse probability weighting according to the propensity score, there was no significant association between hydroxychloroquine use and the composite primary end point (hazard ratio, 1.04; 95% CI, 0.82 to 1.32) (Figure 2). There was also no significant association between treatment with azithromycin and the composite end point (hazard ratio, 1.03; 95% CI, 0.81 to 1.31).
Additional multivariable propensity-score analyses yielded similar results (Table 2). Multiple additional sensitivity analyses, including analyses that used a different baseline at 48 hours after presentation and analyses with treatment defined as receipt of the first dose of hydroxychloroquine before study baseline, showed similar results (Table S3).
Discussion
In this analysis involving a large sample of consecutive patients who had been hospitalized with Covid-19, the risk of intubation or death was not significantly higher or lower among patients who received hydroxychloroquine than among those who did not (hazard ratio, 1.04; 95% CI, 0.82 to 1.32). Given the observational design and the relatively wide confidence interval, the study should not be taken to rule out either benefit or harm of hydroxychloroquine treatment. However, our findings do not support the use of hydroxychloroquine at present, outside randomized clinical trials testing its efficacy.
As we noted in the introduction, the findings from an early study showing a benefit of hydroxychloroquine in 26 patients who had been treated in French hospitals are difficult to interpret, given the small size of that study, the lack of a randomized control group, and the omission of 6 patients from the analysis.6 A clinical trial testing two doses of chloroquine in patients with Covid-19 planned to include 440 patients but was halted after 81 patients had been enrolled because of excessive QTc prolongation and an indication of higher mortality in the high-dose group (in which patients received 600 mg twice daily for 10 days) than in the low-dose group (in which patients received 450 mg daily for 4 days after an initial dose of 450 mg administered twice on the first day).12
Two small, randomized trials from China have been reported. Physicians in Wuhan randomly assigned 62 patients with mild illness to either the control group (in which patients could receive supplemental oxygen, unspecified antiviral agents, antibiotic agents, and immune globulin, with or without glucocorticoids) or the experimental group (in which patients also received 400 mg of hydroxychloroquine daily). This report has not yet been fully peer-reviewed, but results were posted to the MedRxiv website for public comment.13 Investigators reported a faster mean time to clinical recovery (resolution of fever and cough and improvement on chest radiography) in the experimental group than in the control group. Four patients (all in the control group) had progression to severe infection. A small, randomized trial involving 30 patients in Shanghai reported on outcomes in patients treated with 400 mg of hydroxychloroquine daily for 5 days, as compared with a control group in which patients received “conventional treatment only.”14 This trial showed that by day 7, a total of 86% of the patients in the hydroxychloroquine-treated group and 93% of those in the control group had negative results on viral throat swabs. All the patients in this trial also received aerosolized interferon alfa by nebulizer.
A randomized clinical trial is the best approach to determine whether benefit can be ascribed to any given therapeutic intervention because this trial design minimizes the two major problems inherent in observational studies: unmeasured confounding and bias. With the analytic approaches we used in this examination of our observational cohort, we have tried to minimize possible confounding in a variety of ways.
In the main analysis, a multivariable regression model with inverse probability weighting according to the propensity score, there was no significant association between hydroxychloroquine use and the risk of intubation or death. We also performed a series of analyses using several propensity-score approaches. Findings were similar in multiple sensitivity analyses. The consistency of the results across these analyses is reassuring. In our analysis, we adjusted for likely confounders, including age, race and ethnic group, body-mass index, diabetes, underlying kidney disease, chronic lung disease, hypertension, baseline vital signs, Pao2:Fio2, and inflammatory markers of the severity of illness. Despite this extensive adjustment, it is still possible that some amount of unmeasured confounding remains. Additional limitations of our study include missing data for some variables and potential for inaccuracies in the electronic health records, such as lack of documentation of smoking and coexisting illness for some patients. Nonetheless, we used contemporary methods to deal with missing data to minimize bias. Finally, the single-center design may limit the generalizability of these results.
Clinical guidance at our medical center has been updated to remove the suggestion that patients with Covid-19 be treated with hydroxychloroquine. In our analysis involving a large sample of consecutive patients who had been hospitalized with Covid-19, hydroxychloroquine use was not associated with a significantly higher or lower risk of intubation or death (hazard ratio, 1.04; 95% CI, 0.82 to 1.32). The study results should not be taken to rule out either benefit or harm of hydroxychloroquine treatment, given the observational design and the 95% confidence interval, but the results do not support the use of hydroxychloroquine at present, outside randomized clinical trials testing its efficacy.
Funding and Disclosures
Supported in part by grants (RO1-LM006910, RO1-HL077612, RO1-HL093081, and RO1-HL121270) from the
Disclosure forms provided by the authors are available with the full text of this article at NEJM.org.
This article was published on May 7, 2020, at NEJM.org.
We acknowledge the dedication, commitment, and sacrifice of the staff, providers, and personnel in our institution through the Covid-19 crisis and the suffering and loss of our patients as well as in their families and our community.
Supplementary Material
References (14)
-
1. Biot C, Daher W, Chavain N, et al. Design and synthesis of hydroxyferroquine derivatives with antimalarial and antiviral activities. J Med Chem 2006;49:2845–2849.
-
2. Fox RI. Mechanism of action of hydroxychloroquine as an antirheumatic drug. Semin Arthritis Rheum 1993;23:Suppl 1:82–91.
-
3. Devaux CA, Rolain JM, Colson P, Raoult D. New insights on the antiviral effects of chloroquine against coronavirus: what to expect for COVID-19? Int J Antimicrob Agents 2020 March 12 (Epub ahead of print).
-
4. Fantini J, Di Scala C, Chahinian H, Yahi N. Structural and molecular modelling studies reveal a new mechanism of action of chloroquine and hydroxychloroquine against SARS-CoV-2 infection. Int J Antimicrob Agents 2020 April 3 (Epub ahead of print).
-
5. Wilson KC, Chotirmall SH, Bai C, Rello J. COVID-19: interim guidance on management pending empirical evidence. April 3, 2020 (https://www.thoracic.org/covid/covid-19-guidance.pdf).
-
6. Gautret P, Lagier JC, Parola P, et al. Hydroxychloroquine and azithromycin as a treatment of COVID-19: results of an open-label non-randomized clinical trial. Int J Antimicrob Agents 2020 March 20 (Epub ahead of print).
-
7. Yao X, Ye F, Zhang M, et al. In vitro antiviral activity and projection of optimized dosing design of hydroxychloroquine for the treatment of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Clin Infect Dis 2020 March 9 (Epub ahead of print).
-
8. Brown SM, Duggal A, Hou PC, et al. Nonlinear imputation of PaO2/FIO2 from SpO2/FIO2 among mechanically ventilated patients in the ICU: a prospective, observational study. Crit Care Med 2017;45:1317–1324.
-
9. Brown SM, Grissom CK, Moss M, et al. Nonlinear imputation of Pao2/Fio2 from Spo2/Fio2 among patients with acute respiratory distress syndrome. Chest 2016;150:307–313.
-
10. Robins JM. Marginal structural models. 1998 (https://cdn1.sph.harvard.edu/wp-content/uploads/sites/343/2013/03/msm-web.pdf).
-
11. Rubin DB. Multiple imputation for nonresponse in surveys. New York: John Wiley, 1987.
-
12. Borba MGS, Val FFA, Sampaio VS, et al. Effect of high vs low doses of chloroquine diphosphate as adjunctive therapy for patients hospitalized with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection: a randomized clinical trial. JAMA Netw Open 2020;3(4):e208857–e208857.
-
13. Chen Z, Hu J, Zhang Z, et al. Efficacy of hydroxychloroquine in patients with COVID-19: results of a randomized clinical trial. MedRxiv. 2020 (https://www.medrxiv.org/content/10.1101/2020.03.22.20040758v3) (preprint).
-
14. Chen J, Liu D, Liu L, et al. A pilot study of hydroxychloroquine in treatment of patients with common coronavirus disease-19 (COVID-19). J Zhejiang Univ (Med Sci) 2020 (http://www.zjujournals.com/med/EN/10.3785/j.issn.1008-9292.2020.03.03).