Impact of small sample sizes on the internal quality control: statistical uncertainties in the determination of root mean square deviations with respect to the sample mean (RMSD) or to a target value (RMSTD)

Christian Beier

doi:10.1101/2020.12.10.20247148

Abstract

Insufficient statistics due to small considered sample sizes can cause distinct problems in internal quality control (IQC) approaches. This issue concerns most of the currently applied IQC concepts either directly (if a root-mean-square-deviation metric is evaluated) or indirectly (if the IQC concept facilitates a standard deviation that was self-evaluated based on a very limited number (n≤30) of control measures). In clinical chemistry a famous example for the latter case is the common implementation of the Westgard Sigma Rules approach.

This study quantifies the statistical uncertainties in the determination of root mean square (total) deviations related to the sample mean (RMSD) or to a target value (RMSTD). It is clearly shown that RMS(T)D values based on small data sets with n<50 samples are accompanied by a significant statistical uncertainty that needs to be considered in adequate IQC limit definitions. Two mathematical models are derived to reliably estimate an optimal adaptation function to adjust IQC limits to short charts of control measures.

This article provides the theoretical background for the novel IQC method “Statistical Monitoring by Adaptive RMSTD Tests” (SMART) intended to monitor limited available numbers of recent control measures (usually n<20). The study also addresses a general problem in specificity of an IQC resulting from too small sample sizes during the evaluation period of the applied in-control standard deviation.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

The author received no specific funding for this work.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

This study did not require IRB approval.

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

All data sources are mentioned in the reference list.

Abbreviations

ANOVA: analysis of variance
CI: confidence interval
CI_Δ^up: upper limit of the confidence interval of the RMSTD metric
Δ: the “true” RMSTD value determined using sufficient amounts of data
GEP: Gaussian error propagation
GPD: Gaussian probability density
IQC: internal quality control
MDCI: multidimensional confidence interval
RA: retrospective (statistical) analysis of SMC data
RMSD: root mean square deviation (aka empirical standard deviation)
RMSTD: root mean square total (or target) deviation with respect to a known target value (aka entire analytical measuring uncertainty)
SMART: Statistical Monitoring by Adaptive RMSTD Tests
SMC: single measurement of a control sample

The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.