I’m sure you’ve all heard that President Trump has pushed chloroquine for coronavirus treatment. He claims that there is good evidence supporting it, but if we actually look at that evidence, is there anything there?
Once again, here’s a spoiler alert – the evidence supporting chloroquine for coronavirus is extremely weak. And there seem to be some risks in taking it, so the actual risks may far outweigh the actual benefits.
Let’s take a look.
What is chloroquine?
Chloroquine was approved in October 1949 for treating malaria, and it was the anti-malarial drug of choice for many years. It was replaced by newer and safer anti-malarial drugs such as pyrimethamine, artemisinin, and mefloquine.
Although it is no longer used as an anti-malarial, chloroquine and its derivative hydroxychloroquine have found a new life for the treatment of a number of other conditions. Since the drug mildly suppresses the immune system, chloroquine is used in some autoimmune disorders, such as rheumatoid arthritis and systemic lupus erythematosus. It is unclear how chloroquine works for autoimmune diseases.
In addition, chloroquine is used to control the aquarium fish parasite Amyloodinium ocellatum, so many people have the drug nearby.
Chloroquine has numerous side effects from not-too-serious to dangerous. Common, and not too dangerous, side effects include muscle problems, loss of appetite, diarrhea, and skin rash. Unfortunately, there are more serious and dangerous side effects that include vision problems, muscle weakness, seizures, and low blood cell levels.
Importantly, the overdose of chloroquine is very dangerous and can cause death.
Here’s one of the myriads of problems with the US President pushing chloroquine for coronavirus – we don’t know if it works, and because it’s so easily accessed (you can buy chloroquine phosphate for your aquarium without a prescription), results can be disastrous.
An Arizona couple listened to the nonsense from Trump and died from taking the aquarium form of the drug. How many other people will do the same scares me.
The claims about chloroquine for coronavirus started with an article published in the International Journal of Antimicrobial Agents, a moderately low impact factor journal. It is my opinion, shared by many, that something of this importance should have been published in a major biomedical journal as a rapid communication. It’s not that we should dismiss it because of where it’s published, but it is somewhat suspicious.
Basically, the authors examined the viral load of the patients after they received hydroxychloroquine and an antibiotic. They determined viral loads using a PCR assay.
There are two scientists whom I trust that have ripped this study into little pieces, which I will discuss below. But I have several problems with the study from my point of view.
First, the experimental design is bad. I mean so bad, that I can’t believe anyone would ever consider this paper publishable. Here’s how they set up study:
- 20 patients from the medical center (IHU-Méditerranée Infection, Marseille, France) who received hydroxychloroquine.
- 3 patients who receive hydroxychloroquine and the antibiotic azithromycin
- 16 so-called control patients from another center.
This is not what I would call a robust, powerful clinical trial. It’s small. There was no randomization. It was not double-blinded. The “controls” were not patients who were in the same medical center, who would, presumably, receive the same kinds of treatment. And let’s not forget that in all clinical trials, the control group is blinded to both the patient and the treating physician.
Randomized, double-blinded clinical trials are the “gold standards” of medical research because they try to remove biases like confirmation bias and selection bias. They are the foundation of science-based medicine.
Furthermore, the authors seem to have violated one of the basic tenets of clinical research – intention to treat. The researchers did not include anyone who died or who was transferred to the ICU.
According to a thorough analysis of this study by Skepchick:
That means that you analyze everyone enrolled in the study, regardless of whether they complete the trial or not. This allows the effects of death, non-compliance, cessation of treatment because the side effects are intolerable, etc, to be included and for the impacts of a treatment to be fully considered beyond a narrow group. It gives you more of the drug’s true effect, not simply the effect in the best, most compliant patients.
In the H (hydroxychloroquine) group, participants who stopped taking the drug, died, or went to the ICU were not included. This is hugely problematic because the criteria were not applied uniformly and the outcome in the H group may be the result of only including very robust participants. Patients that are dead or in the ICU and not monitored may have higher viral loads that would not be reflected in the data if these participants are eliminated.
I wish I could show you a photo of me hitting my head on the desk. Why on earth was this study even published? Is it because journals want to get anything they can about coronavirus?
That is irresponsible.
Other scientists give their opinions
A respected scientist I know, who has extensive experience in using PCR assays for scientific research took a look at the viral load data from this paper. She focused on this chart:
First of all, you see all of those “ND” highlighted in pink? Well, when most scientists see “ND,” it usually means “not detected.” That sounds good. Except for Gautret et al., it means “not done.” In other words, there is a boatload of missing data that is more support for my belief that this study should not have been published.
My researcher friend wrote:
The outcome of drug treatment, and therefore success, was measured as changes to viral load. The researchers measured viral load in controls and treated patients by qRT-PCR.
Except when they didn’t, as indicated by the pink highlights on the screenshot. D = days after treatment regime began and the numbers (although not explained) are probably the signal of the viral RNA (ie, the Ct for the sample).
ND = the PCR was NOT DONE.
So, the researchers didn’t do PCR on many of the samples from the control patients AND concluded that the controls had less virus by the end of the trial. This is because they didn’t even measure it. This is why there are no error bars on the graphs. This is why they should have done a blinded trial.
PS: I can’t find what “POS” means in the screenshot. It has been suggested that they did a qualitative analysis of the PCR product (ie ran it on a gel) but this is not in the methods that I can see.
Tl;dr this is BAD science and, as a reviewer, I would not have accepted this study for publication.
Well, I know what POS means, but that would be rude. Anyway, a real scientist who does PCR analyses as her career thinks this is BAD science. I agree.
The paper was submitted on March 16, and accepted on March 17. This seems impossibly fast. As obvious from the long lists of comments on the preprint version, a thorough peer review process might have been able to find several important concerns with this paper. Thorough peer review is simply not possible within 24h. Indeed, the paper appears to have been published virtually unchanged from the preprint version.
One of the authors on this paper is also the Editor in Chief of the journal in which the paper was accepted, i.e. the International Journal of Antimicrobial Agents. This might be perceived as a huge conflict of interest, in particular in combination with the peer review process of less than 24h.
She also wrote:
So 4 of the 26 treated patients were actually not recovering well. It seems a bit strange to leave these 4 patients who got worse or who died out of the study, just on the basis that they stopped taking the medication (which is pretty difficult once the patient is dead).
This also goes with what I wrote above about the “intent to treat,” but this is bad. They keep excluding patients that don’t support their conclusion – this is why we do double-blinded randomized clinical trials.
Another PubPeer reviewer wrote:
Only qPCR from a nasal swab has been taken here as an endpoint, not clinical endpoint (which was worse), not infectious virus (cpe from nose swabs was only observed from 19/25 patients (where is 26?), not tested in controls). A PCR positive patient does not necessary mean a virus shedding patient or an ill patient.
I want to make a basic point – anyone who calls this a “clinical trial” is wrong.
Update 16 April 2020
In the ensuing three weeks since I first posted this article, there has been a lot of discussion about chloroquine and COVID-19. And little of it has been good.
The respectful and insolent Orac has written several articles about this nonsense. Let’s just say it’s not good. In a conversation with his alter ego, he stated that “if there are any benefits, they are probably modest.” In a recent article, Orac criticized Dr. Didier Raoult who was the lead researcher on the French study that started this equine feces of COVID-19 treatment.
The evidence is definitely trending in the direction of the conclusion that these drugs don’t work and have more toxicity than benefit. Indeed, I’m now 95% sure that these drugs don’t work against COVID-19. Could I be wrong? Sure? Do I think I’m wrong? No, but I actually would like to be wrong about this. In any event, thanks to “brave mavericks” like Didier Raoult, Dr. Mehmet Oz, Dr. Drew Pinsky, Dr. Vladimir Zelenko, and sadly numerous others, bolstered by
President Trump and his sycophants, toadies, and lackeys, hydroxychloroquine became the de facto standard of care without evidence. When they bypass rigorous science and rely on anecdotes and poor quality science, “brave maverick doctors” like Dr. Raoult do real harm not just to science, but to (the) patient. It’s not Dr. Barraud who should be subject to lawsuits and criminal proceedings. It’s Dr. Raoult. Unfortunately, France being France, there’s no guarantee that it won’t be the other way around. The powerful bullshit artist might just win.
One of my many rules about pseudoscience in medicine is that when Dr. Oz supports it, it’s a scam.
A recent systematic review focused on both clinical and preclinical data concluded that:
Although pre-clinical results are promising, till date, there is dearth of evidence to support the efficacy of CQ or HCQ in preventing COVID-19. Considering potential safety issues and the likelihood of imparting a false sense of security, prophylaxis with CQ or HCQ against COVID-19 needs to be thoroughly evaluated in observational studies or high quality randomized controlled studies.
I know some of the bad medicine types will jump on that first line about preclinical results, but only a tiny percent of drugs that show promise in preclinical studies ever show clinical utility. That’s why we do clinical trials and not rely on anecdotes, pseudoscience, or claims from a bully French “researcher.”
Another recent review of hydroxychloroquine and COVID-19 stated that:
We sorely need an effective treatment for covid-19, but prevention by a vaccine or treatment with drugs that target specific structures in the virus are more likely to succeed than old drugs that may work in the laboratory but lack data supporting clinical use. No intervention should be assumed to be efficacious. Even drugs initially supported by evidence of effectiveness may later prove to be more harmful than beneficial.
Too many medicines have been withdrawn because of adverse reactions after showing clinical promise. We need better, properly powered, randomised controlled trials of chloroquine or hydroxychloroquine. For now, except for supportive measures, infection with SARS-CoV-2 is “essentially untreatable.”
Update 22 April 2020
See this article for a recent study that showed no effect.
Despite this terrible study design and the criticism from several scientists, Gautret et al. concluded:
Despite its small sample size our survey shows that hydroxychloroquine treatment is significantly associated with viral load reduction/disappearance in COVID-19 patients and its effect is reinforced by azithromycin.
President Trump must have read just this one sentence and decided that hydroxychloroquine is THE cure for COVID-19. Despite his beliefs or wishes, this study’s results are not supporting evidence that we should use chloroquine for coronavirus.
But his comments (and from other pseudoscientists) have consequences:
- It gives false hope for a drug that probably doesn’t work based on this study.
- It makes people, because of fear, to buy up the supply of chloroquine keeping it from people who need it for their health.
- It may cause harm, serious harm, even death.
- It may cause people to take the drug and think they can ignore public health strategies for the disease.
Yes, COVID-19 is scary. Yes, we lack vaccines or effective treatments. But we have no evidence that chloroquine for coronavirus works. And it’s dangerous for the President or anyone to make that claim.
- Ferner RE, Aronson JK. Chloroquine and hydroxychloroquine in covid-19. BMJ. 2020 Apr 8;369:m1432. doi: 10.1136/bmj.m1432. PubMed PMID: 32269046.
- Gautret P, Lagier JC, Parola P, Hoang VT, Meddeb L, Mailhe M, Doudier B, Courjon J, Giordanengo V, Vieira VE, Dupont HT, Honoré S, Colson P, Chabrière E, La Scola B, Rolain JM, Brouqui P, Raoult D. Hydroxychloroquine and azithromycin as a treatment of COVID-19: results of an open-label non-randomized clinical trial. Int J Antimicrob Agents. 2020 Mar 20;:105949. doi: 10.1016/j.ijantimicag.2020.105949.
- Gupta SK. Intention-to-treat concept: A review. Perspect Clin Res. 2011 Jul;2(3):109-12. doi: 10.4103/2229-3485.83221. PubMed PMID: 21897887; PubMed Central PMCID: PMC3159210.
- Shah S, Das S, Jain A, Misra DP, Negi VS. A systematic review of the prophylactic role of chloroquine and hydroxychloroquine in Coronavirus Disease-19 (COVID-19). Int J Rheum Dis. 2020 Apr 13;. doi: 10.1111/1756-185X.13842. [Epub ahead of print] PubMed PMID: 32281213.
Please help me out by sharing this article. Also, please comment below, whether it's positive or negative. Of course, if you find spelling errors, tell me!
There are two ways you can help support this blog. First, you can use Patreon by clicking on the link below. It allows you to set up a monthly donation, which will go a long way to supporting the Skeptical Raptor.
Finally, you can also purchase anything on Amazon, and a small portion of each purchase goes to this website. Just click HERE, and shop for everything.