Rethinking COVID-19 test sensitivity-a strategy for improving the detection limit
Mohammed Kalim Akhtar, Ross Ka-Kit Leung, Gulfaraz Khan
Received: 02 Jun 2021 - Accepted: 07 Aug 2021 - Published: 16 Aug 2021
Domain: Laboratory medicine,Infectious disease
Keywords: SARS-CoV-2, false negatives, diagnostic workflow, real-time polymerase chain reaction
©Mohammed Kalim Akhtar et al. Pan African Medical Journal (ISSN: 1937-8688). This is an Open Access article distributed under the terms of the Creative Commons Attribution International 4.0 License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Cite this article: Mohammed Kalim Akhtar et al. Rethinking COVID-19 test sensitivity-a strategy for improving the detection limit. Pan African Medical Journal. 2021;39:244. [doi: 10.11604/pamj.2021.39.244.30131]
Available online at: https://www.panafrican-med-journal.com/content/article/39/244/full
Rethinking COVID-19 test sensitivity-a strategy for improving the detection limit
Numerous genetic tests for the detection of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) virus, including those based on the ever-popular real-time polymerase chain reaction (RT-qPCR) technique, have been reported. These diagnostic tests give false negatives particularly during the early and late stages of COVID-19 clearly indicating inadequate test sensitivity. The entire COVID-19 diagnostic workflow is often overlooked and given very little attention. Herein, we propose that volumetric modifications to COVID-19 workflows would significantly improve detection limits. We would therefore encourage researchers to adopt a holistic approach, in which all the steps of a COVID-19 diagnostic workflow, are carefully scrutinised, particularly those upstream factors at the viral sampling and pre-analytical stages.
Since the onset of the COVID-19 pandemic, a variety of diagnostics tests for detecting the SARS-CoV-2 genome have been reported . Due to the urgent need to adopt approaches that permit rapid identification of infected members of the population, current COVID-19 diagnostic workflows are configured with speed in mind . Protocols have therefore been devised to shorten the sample-to-answer time of the workflow and maximise sample throughput [3,4]. An important aspect of diagnostic testing is the limit of detection. This is the lowest analytical signal that can be detected, one that is distinguishable from an established baseline. Given that COVID-19 patient samples with low viral ribonucleic acid (RNA) loads still yield cultivable SARS-CoV-2 virus, one cannot entirely exclude the possibility that viral transmission could still occur at very early stages of the infection, possibly even below the detection limits of current commercial kits for COVID-19 testing [5-8]. Not only do cost-cutting measures that cheapen test kits or the adoption of test kits that offer poor limits of detection undermine test sensitivity but more importantly, increase the frequency of false negatives, which have in turn markedly hindered our efforts in controlling the spread of SARS-CoV-2 [9,10]. Every 10-fold decrease in diagnostic sensitivity is estimated to result in a miss of one in eight infected patients . Inappropriate healthcare and containment responses due to misdiagnosed individuals will only lead to further spread of SARS-CoV-2.
COVID-19 diagnostic workflow: to gain a better understanding of how test sensitivities could be improved, we need to first consider the entire COVID-19 diagnostic workflow which typically consists of three stages: i) sample collection, ii) RNA extraction, and iii) nucleic acid detection .
Stage 1-sample collection: the nasopharyngeal swab is the most common sampling technique for COVID-19 testing as it attains the highest sensitivity . This technique, which is carried out by a trained health care professional, involves the insertion of a long flexible swab into the nostril along the floor of the nasal cavity and into the nasopharynx. The swab content is then mixed with a viral transport medium (VTM), usually ranging in volume from 1 to 3ml, to preserve the virus and its RNA content. The composition of the medium helps to maintain the integrity of sampled cells, as well as reduce the possibility of contamination from bacteria and fungi.
Stage 2-RNA extraction: to ensure the best sensitivities for nucleic acid detection, extraction of the viral RNA is an important pre-analytical step of COVID-19 workflows [14-16]. With the aid of commercial RNA isolation kits, this step essentially removes contaminants and improves the signal-to-noise ratio of the signal generated during stage 3 of the workflow. These kits contain chaotropic agents to precipitate and remove unwanted materials such as RNases that can compromise sample integrity and/or interfere with downstream detection. The viral RNA is bound to a proprietary resin and subsequently eluted in a small volume of buffer. Consequently, this step results in several-fold concentration of the viral RNA.
Stage 3-nucleic acid detection: in the final stage of the workflow, the presence of the viral RNA needs to be coupled to a signal output. For diagnostic purposes, fluorescence is generally preferred for ease of probe synthesis and coupling with common experimental steps, as well as allowing detection with the naked eye. For COVID-19 testing, the favoured method for signal amplification is RT-qPCR . The RNA is converted to DNA, via a reverse transcriptase step, followed by up to 40 cycles of temperature-dependent reactions for DNA replication. Each cycle of replication results in an incremental increase of fluorescence over time which can be used to quantitate the amount of RNA in the sample. The run-time for an RT-qPCR analysis can vary from 1 to 2 hours. Though RT-qPCR remains the gold standard for COVID-19 testing, other techniques such as RT-LAMP (loop-mediated isothermal amplification) , real-time reverse-transcription recombinase polymerase amplification assay (RT-RPA) , and NEAR (Nicking enzyme-assisted reaction) , as well as CRISPR-based detection systems are currently being developed .
What is the limit of detection? when it comes to test sensitivity, much of the focus and attention is given to the underlying technology at the detection stage of the workflow [21,22]. This is understandable considering that important conclusions need to be drawn on diagnostic specificity, a critical parameter that determines whether the RNA in a patient sample truly emanates from the SARS-CoV-2 genome. But from a detection standpoint, how well do the various technologies hold up for COVID-19 diagnostics? As part of an external quality assessment, the Foundation for Innovative New Diagnostics (FIND) tested serval commercial kits, mainly those based on RT-qPCR, under standardized conditions using clinical samples . They found that the majority of commercial RT-qPCR kits offered a detection limit of 0.05-0.1 copy per μl of reaction . Isothermal techniques such as RT-LAMP and CRISPR, on the other hand, have lower detection limits of around 1 copy per 1 μl reaction [15,17]. There is still enormous room for improving the test sensitivity of any COVID-19 diagnostic workflow when one considers the workflow in its entirety rather than just the end point. To understand how this might be achieved, the limit of detection needs to be redefined in relation to the volume of the original patient sample, in other words, the RNA copy number per ml of viral transport medium . Current state-of-the-art workflows, those based on RT-qPCR, are capable of achieving detection limits as low as 100 copies of viral RNA per ml of viral transport medium .
How the diagnostic sensitivity of COVID-19 workflows can be improved: by taking into account all the steps of a workflow, the test sensitivity can be vastly improved by considering volumetric factors, which do not require any changes to the hardware, software, or chemistry underpinning the diagnostic protocols (Figure 1). The most obvious volumetric adjustment within a COVID-19 workflow would be to simply reduce the volume of the viral transport medium. Lower volumes (< 1ml) would not only ease the logistics of sample handling, transportation and storage of clinical samples, but also increase the working concentration of the viral RNA. There is no clear precedence within the literature, nor a strong scientific case, for the use of 1 to 3ml of viral transport medium during COVID-19 testing. A higher working RNA concentration would mean that smaller sample volumes could be carried forward to stage 2 or even directly to stage 3 which, in turn, would reduce the amount of reagent required for both stages.
A 200 μl volume of the patient sample is typically taken at stage 1 and used for RNA isolation during stage 2. Sensitivity could be boosted further by increasing the volume of patient sample. Greater carry-over of RNA into the later stages of the workflow would increase the likelihood of nucleic acid detection. For elution of the viral RNA, the final volume is usually 50 μl. Decreasing the elution volume would increase the RNA concentration and, in turn, allow a greater quantity of RNA to be carried over into the final stage of the workflow.
For the final stage, the use of highly concentrated master mixes would help to maximise the amount of RNA material that is analysed. A typical RT-qPCR reaction is performed in a 10 μl or 20 μl volume using a 1.6-fold master mix. A more concentrated master mix, say at 5-fold, would increase the amount of RNA material by at least 1.5-fold. Consequently, a concentrated master mix would also permit smaller reaction volumes to be set-up in the case of RT-qPCR which would greatly speed up run-times. The simple, yet subtle volumetric changes proposed at each stage of the workflow may at first seem insignificant but taken together the overall improvement in detection limits (RNA copies per ml) over the entire workflow could be enhanced by at least one order of magnitude.
The issue of test sensitivity is particularly relevant in the early and late stages of the COVID-19 disease when viral RNA loads are poor . Even simple volumetric adjustments, as highlighted within this article, have the potential to vastly improve the detection limit of diagnostic tests. Thus, we would encourage researchers to adopt a holistic approach, in which all the steps of a COVID-19 diagnostic workflow, are carefully scrutinised, particularly those upstream factors at the viral sampling and pre-analytical stages.
The authors declare no competing interests.
The perspective article was conceptualized by MKA and GK. MKA drafted and wrote the manuscript. MKA, RK-KL, GK edited the manuscripts. All the authors have read and agreed to the final manuscript.
This work was support by the UAEU Program for Advanced Research Fund (12S011) awarded to MKA and Zayed Center-based Grants (31R135 and 12R001) awarded to GK.
Figure 1: improving the detection limits of COVID-19 diagnostic workflows
- Touma M. COVID-19: molecular diagnostics overview. Journal of Molecular Medicine. 2020;98(7):947-954. PubMed | Google Scholar
- Nimmo C, Agbetile J, Bhowmik A, Capocci S, Rajakulasingam RK. Implementing rapid diagnostics for COVID-19. The Lancet Respiratory Medicine. 2021;9(1):e7. PubMed | Google Scholar
- Panpradist N, Wang Q, Ruth PS, Kotnik JH, Oreskovic AK, Miller A et al. Simpler and faster COVID-19 testing: strategies to streamline SARS-CoV-2 molecular assays. EBioMedicine. 2021;64:103236. PubMed | Google Scholar
- Smyrlaki I, Ekman M, Lentini A, Rufino de Sousa N, Papanicolaou N, Vondracek M et al. Massive and rapid COVID-19 testing is feasible by extraction-free SARS-CoV-2 RT-PCR. Nat Commun. 2020;11(1):4812. PubMed | Google Scholar
- Singanayagam A, Patel M, Charlett A, Bernal JL, Saliba V, Ellis J et al. Duration of infectiousness and correlation with RT-PCR cycle threshold values in cases of COVID-19, England, January to May 2020. Eurosurveillance. 2020;25(32):2001483. PubMed | Google Scholar
- Bullard J, Dust K, Funk D, Strong JE, Alexander D, Garnett L et al. Predicting infectious severe acute respiratory syndrome coronavirus 2 from diagnostic samples. Clin Infect Dis. 2020;71(10):2663-2666. PubMed | Google Scholar
- La Scola B, Le Bideau M, Andreani J, Hoang VT, Grimaldier C, Colson P et al. Viral RNA load as determined by cell culture as a management tool for discharge of SARS-CoV-2 patients from infectious disease wards. Eur J Clin Microbiol Infect Dis. 2020;39(6):1059-1061. PubMed | Google Scholar
- Salvatore PP, Dawson P, Wadhwa A, Rabold EM, Buono S, Dietrich EA et al. Epidemiological correlates of polymerase chain reaction cycle threshold values in the detection of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Clin Infect Dis. 2021 Jun 1;72(11):e761-e767. PubMed | Google Scholar
- Fitzpatrick MC, Pandey A, Wells CR, Sah P, Galvani AP. Buyer beware: inflated claims of sensitivity for rapid COVID-19 tests. The Lancet. 2021;397(10268):24-25. PubMed | Google Scholar
- Woloshin S, Patel N, Kesselheim AS. False negative tests for SARS-CoV-2 infection-challenges and implications. N Engl J Med. 2020;383(6):e38. PubMed | Google Scholar
- Arnaout R, Lee RA, Lee GR, Callahan C, Cheng A, Yen CF et al. The limit of detection matters: the case for benchmarking severe acute respiratory syndrome coronavirus 2 testing. Clin Infect Dis. 2021;ciaa1382. PubMed | Google Scholar
- Jayamohan H, Lambert CJ, Sant HJ, Jafek A, Patel D, Feng H et al. SARS-CoV-2 pandemic: a review of molecular diagnostic tools including sample collection and commercial response with associated advantages and limitations. Analytical and Bioanalytical Chemistry. 2021;413(1):49-71. PubMed | Google Scholar
- Lee RA, Herigon JC, Benedetti A, Pollock NR, Denkinger CM. Performance of saliva, oropharyngeal swabs, and nasal swabs for SARS-CoV-2 molecular detection: a systematic review and meta-analysis. J Clin Microbiol. 2021;59(5):e02881-20. PubMed | Google Scholar
- Corman VM, Landt O, Kaiser M, Molenkamp R, Meijer A, Chu DKW et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Eurosurveillance. 2020;25(3):2000045. PubMed | Google Scholar
- Broughton JP, Deng X, Yu G, Fasching CL, Servellita V, Singh J et al. CRISPR-Cas12-based detection of SARS-CoV-2. Nat Biotechnol. 2020;38(7):870-874. PubMed | Google Scholar
- Rabe BA, Cepko C. SARS-CoV-2 detection using isothermal amplification and a rapid, inexpensive protocol for sample inactivation and purification. Proc Natl Acad Sci U S A. 2020;117(39):24450-24458. PubMed | Google Scholar
- Yan C, Cui J, Huang L, Du B, Chen L, Xue G et al. Rapid and visual detection of 2019 novel coronavirus (SARS-CoV-2) by a reverse transcription loop-mediated isothermal amplification assay. Clin Microbiol Infect. 2020;26(6):773-779. PubMed | Google Scholar
- Behrmann O, Bachmann I, Spiegel M, Schramm M, Abd El Wahed A, Dobler G et al. Rapid detection of SARS-CoV-2 by low vvolume real-time single tube reverse transcription recombinase polymerase amplification using an exo probe with an internally linked quencher (Exo-IQ). Clin Chem. 2020;66(8):1047-1054. PubMed | Google Scholar
- Qian C, Wang R, Wu H, Ji F, Wu J. Nicking enzyme-assisted amplification (NEAA) technology and its applications: A review. Analytica Chimica Acta. 2019;1050:1-15. PubMed | Google Scholar
- Leung RKK, Cheng QX, Wu Z Le, Khan G, Liu Y, Xia HY et al. CRISPR-Cas12-based nucleic acids detection systems. Methods. 2021 Mar 2;S1046-2023(21)00063-3. PubMed | Google Scholar
- Vogels CBF, Brito AF, Wyllie AL, Fauver JR, Ott IM, Kalinich CC et al. Analytical sensitivity and efficiency comparisons of SARS-CoV-2 RT-qPCR primer-probe sets. Nat Microbiol. 2020;5(10):1299-1305. PubMed | Google Scholar
- van Kasteren PB, van der Veer B, van den Brink S, Wijsman L, de Jonge J, van den Brandt A et al. Comparison of seven commercial RT-PCR diagnostic kits for COVID-19. J Clin Virol. 2020;128:104412. PubMed | Google Scholar
- FIND. SARS-CoV-2 diagnostics: performance data for molecular assays. 2020.
- To KKW, Tsang OTY, Leung WS, Tam AR, Wu TC, Lung DC et al. Temporal profiles of viral load in posterior oropharyngeal saliva samples and serum antibody responses during infection by SARS-CoV-2: an observational cohort study. Lancet Infect Dis. 2020;20(5):565-574. PubMed | Google Scholar
- Sethuraman N, Jeremiah SS, Ryo A. Interpreting diagnostic tests for SARS-CoV-2. Journal of the American Medical Association. 2020;323(22):2249-2251. PubMed | Google Scholar