Studybox Research

Studybox Research Emergency Use Authorization · Infectious disease

Point-of-Care Molecular SARS-CoV-2 Test

A point-of-care RT-PCR test with a visual lateral-flow readout for qualitative detection of SARS-CoV-2 RNA received Emergency Use Authorization, and its authorization was later revised to cover nasal swabs tested in patient care settings operating under a CLIA Certificate of Waiver.

Case study

Emergency Use Authorization · Infectious disease

EUA Clinical Study for a Point-of-Care Molecular SARS-CoV-2 Test

Key facts

Outcome
FDA emergency use authorization
Subjects enrolled
about 350
Evaluable specimens
about 300
Sites
Several CLIA-waived sites
PPA
about 90%
NPA
100%
Retrospective PPA
about 95%
Run by
The Studybox team, as Toolbox Medical Innovations

01 How the study ran

  • Contrived-sample evaluation: about 30 negative samples (a throat swab and a nasal swab from each healthy volunteer, eluted together) and about 30 positives made by spiking SARS-CoV-2 RNA into those negatives, most at 2x LoD and the rest at higher concentrations (5x to 50x). Samples were randomized, de-identified and blinded to the operator.
  • Retrospective study: about 50 clinical specimens previously tested with an EUA-authorized real-time RT-PCR assay were retested with the candidate test. Each specimen was diluted in the test buffer, because viral transport media can inhibit the assay.
  • Prospective clinical study at several CLIA-waived sites, with testing by non-laboratory personnel. Subjects had SARS-CoV-2-like symptoms or known exposure to people infected with SARS-CoV-2, and anterior nasal swabs were collected.
  • For each subject, the candidate-test sample was eluted in the test's proprietary buffer, and the comparator sample was eluted in 3 mL of viral transport media and tested with a comparator molecular assay.
  • All specimens with discrepant results were tested on a second FDA-cleared molecular assay.
  • Of about 350 subjects enrolled, about 300 specimens were evaluable.

02 Takeaways for sponsors

  • Under emergency conditions, evidence can be built in stages: contrived samples for an initial authorization, then retrospective natural specimens, then a prospective study in the intended setting. Each later revision of the intended use needs data that meets the standard current at that time.
  • For a point-of-care molecular claim, plan the prospective study at the waived sites themselves, with non-laboratory operators and a paired comparator swab in transport media.
  • Enroll enough positives to keep the PPA lower bound informative. With only about 40 positives, even a 90% PPA carries a lower bound well below the point estimate.
  • Plan the labeling consequence of a PPA below 95% in advance. In this case it was a presumptive-negative claim with laboratory confirmation of negatives when clinically indicated.
  • Check that the specimen handling the test was designed for still holds for the evidence you use. Transport-media specimens needed dilution to avoid inhibition, which limits how far retrospective data can stand in for direct swabs.
Full results

In the contrived-sample evaluation, agreement with expected results was 100% at every concentration and for negatives. In the retrospective study of about 50 specimens, PPA was about 95% and NPA 100%. The single discordant specimen, negative by the candidate test and positive by the comparator, was negative on re-test with the comparator and on a second EUA RT-PCR test.

In the prospective study at CLIA-waived sites, PPA was about 90% and NPA was 100%. SARS-CoV-2 was not detected by a second FDA-cleared molecular assay in one of the few false negative specimens.

FDA first issued the Emergency Use Authorization, then amended and reissued it several times. The final reissuance added new clinical performance data and a presumptive-negative claim to the intended use. Negative results are to be treated as presumptive and, if inconsistent with clinical signs and symptoms or necessary for patient management, confirmed with a different authorized or cleared molecular test in a CLIA-certified laboratory that meets the requirements for high or moderate complexity testing. The test was authorized for point-of-care use in patient care settings operating under a CLIA Certificate of Waiver, Certificate of Compliance or Certificate of Accreditation. The EUA was later revoked.

The contrived-sample results meet the policy's acceptance criteria of 95% agreement at 1x-2x LoD and 100% elsewhere. The prospective study is read differently. FDA's molecular EUA template, in its current form, recommends at least 95% positive and negative agreement for a molecular point-of-care test, but says positive agreement of at least 80% may be considered with limitations such as treating negatives as presumptive. The prospective PPA of about 90% falls between those two figures. The authorized labeling matches that framework: the reissuance added a presumptive-negative claim based on newly provided clinical performance data, and negatives are to be confirmed with a laboratory molecular test when clinically indicated. NPA of 100% meets the 95% recommendation.

With only about 40 comparator positives, the PPA interval is wide. Each additional false negative would have moved the point estimate by more than two percentage points, which is why the template's minimum of 30 positives is a floor, not a target. The discordant result (one of the few false negatives was negative on a second FDA-cleared assay) suggests at least one false negative may have been a comparator-only detection. Following the template, it was not used to adjust PPA. The retrospective PPA of about 95% came from diluted laboratory specimens and is not directly comparable to the direct-swab prospective result.

The challenge and regulatory background

The test detects SARS-CoV-2 nucleic acid visually on a lateral-flow strip after RT-PCR on a small dock. As finally authorized, it was intended for clinician-collected anterior nasal or nasal mid-turbinate swabs, or clinician-instructed anterior nasal swabs self-collected on site, from individuals suspected of COVID-19 by their healthcare provider. Testing was authorized in CLIA-certified laboratories and at the point of care, in patient care settings operating under a CLIA Certificate of Waiver, Certificate of Compliance or Certificate of Accreditation.

The original authorization covered combined throat and nasal swabs, in high- and moderate-complexity laboratories and in patient care settings using the dock. Its intended use changed several times over the following years: to nasal swab alone, then adding mid-turbinate swabs, then on-site self-collection, then 'anterior nasal' wording. The clinical evidence behind the test grew over the same period.

Showing performance in waived point-of-care settings required evidence from where the test would actually be used. That meant CLIA-waived sites, non-laboratory operators and anterior nasal swabs from symptomatic or exposed patients, compared against a laboratory molecular method run on a paired swab in viral transport media.

Emergency Use Authorization for COVID-19 diagnostics rests on section 564 of the Federal Food, Drug, and Cosmetic Act and the HHS determination of a public health emergency (85 FR 7316). Under an EUA, FDA does not decide substantial equivalence. It assesses whether, based on the totality of scientific evidence, it is reasonable to believe the test may be effective and its known and potential benefits outweigh its known and potential risks. FDA's first COVID-19 test policy covered high-complexity laboratories. A revision extended it to commercial manufacturers distributing test kits to laboratories or to healthcare workers for point-of-care testing.

Clinical evidence expectations in those first weeks were minimal because positive patient specimens were scarce. The policy recommended that, in the absence of known positive samples, developers test at least 30 contrived reactive and 30 non-reactive specimens, with twenty spiked at 1x-2x the LoD and the rest spanning the assay range. The acceptance criteria were 95% agreement at 1x-2x LoD and 100% at all other concentrations and for negatives.

As natural specimens became available, FDA's molecular EUA template raised the bar. In its current form, the template states that contrived samples are inadequate to support clinical performance and recommends at least 30 positive and 30 negative natural clinical samples, with a pre-planned discordant analysis whose results are not included in PPA/NPA. For a point-of-care claim, it asks for a clinical evaluation at non-laboratory sites with intended healthcare operators, at least 30 prospectively collected positives and 30 negatives, testing for at least two weeks, near-LoD samples tested by minimally trained operators, and flex studies. A molecular POC test should show positive and negative agreement of at least 95%, although positive agreement of at least 80% 'may be considered with appropriate limitations', for example treating negatives as presumptive.

Why the study was designed this way
  • The contrived panel of about 30 positives (most near the LoD) and about 30 negatives followed the structure of FDA's policy almost exactly. That was the fastest defensible route to an authorization when positive patient specimens were scarce.
  • Diluting retrospective transport-media specimens in the test buffer was needed because viral transport media can inhibit the assay. It allowed archived positives to be used, at the cost of making the retrospective data less representative of direct-swab testing.
  • Running the prospective study at CLIA-waived sites with non-laboratory personnel produced evidence in the setting and in the hands named in the point-of-care authorization, instead of extrapolating from laboratory data.
  • Pairing an anterior nasal swab in the test's own buffer with a second swab in transport media for the comparator kept the candidate test in its intended workflow while giving the laboratory method a standard specimen.
  • Testing all discrepant specimens on a second FDA-cleared molecular assay matches the template's recommendation of a pre-planned discordant analysis reported alongside, not inside, the PPA/NPA calculation.

Regulatory references: FDA guidance: Policy for Coronavirus Disease-2019 Tests (Revised); first issued February 29, 2020 · FDA guidance as issued March 16, 2020: Policy for Diagnostic Tests for Coronavirus Disease-2019 during the Public Health Emergency (archived copy) · FDA EUA template: Template for Developers of Molecular Diagnostic Tests (SARS-CoV-2) · FDA: In Vitro Diagnostics EUAs · FDA: CLIA Categorizations

Study design and results as reported in the FDA-authorized instructions for use and EUA documents. Sponsor and device names withheld. This study was run by the Studybox leadership and clinical team while operating as Toolbox Medical Innovations, the company Studybox grew out of.

← All case studies

FAQ

01 What clinical data did FDA ask for in the earliest COVID-19 EUA requests?

FDA's policy recommended, in the absence of known positive samples, at least 30 contrived reactive and 30 non-reactive specimens, with twenty at 1x-2x LoD, and acceptance criteria of 95% agreement at 1x-2x LoD and 100% at other concentrations and for negatives. This test's contrived evaluation followed that structure, with most positives at 2x LoD, the rest at higher concentrations and a matching set of negatives, and showed 100% agreement.

02 What PPA does FDA expect for a point-of-care molecular SARS-CoV-2 test?

FDA's molecular EUA template recommends at least 95% positive and negative agreement for a molecular POC test, and says positive agreement of at least 80% may be considered with limitations, for example treating negatives as presumptive. This test's prospective PPA was about 90% with NPA of 100%, and its authorization included a presumptive-negative claim.

03 How was point-of-care performance demonstrated for this SARS-CoV-2 test?

Through a prospective study at several CLIA-waived sites where non-laboratory personnel tested anterior nasal swabs from symptomatic or exposed subjects, compared with a comparator molecular assay run on a paired swab in viral transport media. About 300 of about 350 enrolled subjects' specimens were evaluable.

04 Is this EUA still in effect?

No. FDA later revoked the authorization.

Let's talk IVD research

Have a study like this?

Tell us the intended use, the setting, and the deadline. We'll come back with a site plan and a realistic timeline.