Page:NIOSH Manual of Analytical Methods - Chapter E.pdf/9

 4. DOCUMENTATION

Development and evaluation research on a sampling and analytical method should be documented in a final report. The report should describe what was determined about the method. If the results of the statistical analysis of the data indicate there is not 95% confidence that the accuracy of the method is less than or equal to ±25%, the report should state this fact. In some instances, the method may actually have an accuracy of less than 25%, but a larger sample size must be used to prove this statistically (See Appendix 1 of Reference 1).

The final report can be either a technical report or a failure report. The technical report (acceptable method developed) documents the successful development of the method. This report may be prepared in a format appropriate for submission to a peer-reviewed journal for publication. The failure report (no acceptable method developed) documents the research performed on an attempted method development for an analyte or analytes. The report should describe the failure of the method, as well as other areas of the method research that were successful. Recommendations to solve the failure of the method may be included.

If an acceptable method is developed, a sampling and analytical method should be prepared in appropriate format. The format of the resulting method should provide clear instructions for the use of the method. Sampling, sample workup, and analysis procedures should be clearly described. The necessary equipment and supplies for the method should be listed clearly in the method. A summary of the evaluation of the method should be included, as well as a discussion of method applicability and lists of interferences and related references. As a check on the clarity and performance, new methods should be reviewed and submitted to a user check (i.e., the method is used to analyze spiked or generated samples of known concentration by someone other than the researcher who developed it) and to a collaborative test, if feasible.

5. APPENDIX - ACCURACY AND ITS EVALUATION

In the development of a sampling and analytical method, one of the goals is to minimize the measurement error to the lowest feasible and practical levels. It is assumed that all feasible corrections to reduce error have been made in the laboratory experimentation process. Method evaluation requires adequate characterization of the magnitude and distribution of the uncorrectable error that cannot be prevented. One might consider a hypothetical experiment in which a method is used repeatedly to measure the same concentration, T, under the same conditions. These measurements would tend to exhibit a pattern or statistical distribution, here assumed to be normal, with a mean, µ, and standard deviation,. The distribution can be characterized in terms of two components: its location relative to T, which is the systematic error termed bias (B), is given by (µ-T)/T; and its spread, which is the random error termed imprecision (Sπ), is given by /µ. The bias and imprecision are used to determine the inaccuracy of the method but they are also important characteristics of the error in and of themselves as will be discussed below.

Accuracy refers to the closeness of the measurements to T but it is defined in terms of the discrepancy of the measurements from T. Inaccuracy (I) is defined as the maximum error, regardless of sign, expressed as a percentage of T that occurs with a probability of 0.95. Thus, an inaccuracy (or accuracy) of 20% means that on the average 95 of every 100 measurements will differ from T by no more than 0.2T. The accuracy criterion for single measurements mentioned at the beginning of this chapter, often termed the “NIOSH Accuracy Criterion,” requires I to be less than or equal to 25%. 1/15/98