Multiple method comparison: A statistical model using percentage similarity.
Ms Lesley E. Scott, Prof Jacky S. Galpin*, Dr Deborah K. Glencross
Department of Molecular Medicine and Hematology, Faculty of Health Sciences, University of the Witwatersrand. *Department of Statistics and Actuarial Science, University of the Witwatersrand. Johannesburg, South Africa
Corresponding Author:
Ms Lesley E. Scott
P.O Box 3441
Northcliff
2115
South Africa
+27-11-489-8555 (tel)
+27-11-484-5812 (fax) e-mail: lesleys@mighty.co.za
Key words:
Method comparison, Bland-Altman plot, histogram, percentage similarity
Abstract
Background: Method comparison typically determines how well two methods agree. This is usually performed using the difference plot model, which measures absolute differences between two methods. This is often not applicable to data with wide ranges of absolute values. An alternative model is introduced that simplifies comparisons specifically for multiple methods compared to a gold standard.
Methods: The average between a new method and the gold standard is represented as a percentage of the gold standard. This is interpreted as a percentage similarity value and accommodates wide ranges of data. The representation of the percentage similarity values in a histogram format highlights the accuracy and precision of several compared methods to a gold standard. The calculation of a coefficient of variation further defines agreement between methods.
Results: Percentage similarity histograms of several new methods can be compared to a gold standard simultaneously, and the comparison easily visualized through use of a single 100% similarity reference line drawn common to all plots.
Conclusion: This simple method of comparison would be particularly useful for multiple method comparison and is especially applicable for centers collating for external quality assessment or assurance programs to demonstrate differences in results between