Beruflich Dokumente
Kultur Dokumente
A summary is given of the main strategies that can be on the basis of a well designed and carefully performed method
used to obtain high quality results in the determination of validation study, as described by, e.g., Wernimont3 and
metals in clinical chemistry. The trends in quality Christensen et al.4 Biased measurement results have to be
assurance of metal analyses are discussed. corrected on the basis of a method evaluation study, and
inappropriate procedures may be improved resulting in reduced
Keywords: Quality assurance; metals; clinical chemistry;
Published on 01 January 1998. Downloaded on 28/10/2014 14:17:14.
quality of the results produced by the laboratory. However, as the BCR guide)15 could be implemented in PC-programs which
the needs of society are changing, so are the demands on the may be valuable tools in the certification process, in particular
laboratories and so must the demands on quality control for small certifying bodies.26 A PC-program specific for
procedures. statistical evaluation of certified values and uncertainties on the
basis of data from interlaboratory studies have been developed
for that purpose. The program will generate standardized
Metrological trend
reports with full documentation of the evaluation procedure in
The most noteworthy trend in quality assurance within the field accordance with the BCR guide.26
of analytical chemistry is the ongoing activities aiming at
establishing a sound metrological basis for analytical measure-
Uncertainty
ments. This trend includes introduction of new concepts, such
as traceability and uncertainty. Quality requirements for the It is impossible to talk about traceability without referring to
production, certification and use of certified reference materials uncertainty, and vice versa. Uncertainty (of measurement) is
are examples of practical implementation of this strategy.15,16 defined as parameter, associated with the result of a measure-
Another example is the International Measurement Evaluation ment that characterized the dispersion of the values that could
Programme (IMEP) promoted by the Institute for Reference reasonably be attributed to the measurand.18 In analytical
Published on 01 January 1998. Downloaded on 28/10/2014 14:17:14.
Materials and Measurements.17 chemistry, the measurand typically is the molar (or mass)
concentration of a substance in a given sample. The wording
dispersion of values that could reasonably be attributed to the
Traceability and certified reference materials
measurand implies that a standard deviation based on repeated
Traceability means that the result of a measurement (or a value measurements does not, in general, satisfy the definition of
of a calibrator) can be related to a stated reference, usually a uncertainty. A standard deviation, e.g., derived under repeata-
national or international standard, through an unbroken chain of bility or reproducibility conditions, is a measure of the
comparisons all having stated uncertainties.18 In analytical laboratory (or a group of laboratories) ability to repeat the
chemistry, the preferred standard of reference would be the SI measurement. However, because the result of the measurement
base unit mole or alternatively, the SI base unit kilogram. Each may be influenced by effects beyond the control of the
step in the comparison chain involves a measurement procedure laboratory (or a group of laboratories), a standard deviation is,
which contributes some uncertainty. Hence, the total un- in general, an underestimate of the uncertainty. In evaluating the
certainty is a quantitative indication of the strength of the uncertainty, the laboratory must assign a value to all relevant
traceability chain . uncertainty components and combine the uncertainty compo-
Certified reference materials (CRMs) play an important role nents to yield an estimate of the uncertainty of the result.27 The
in the practical establishment of traceability. The definition of a principle is illustrated in Fig. 1, where Laboratory A does not
CRM as stated in the international vocabulary of basic and consider the quality of the calibrators purchased from Company
general terms in metrology (VIM)18 implies that CRMs in the A or the systematic effects associated with the measurement
context of traceability are valid standards of reference. The
problems involved in application of CRMs such as the
availability and representativity with respect to matrix and
reference value are well known. Production of well defined
CRMs with expected long-term stability often puts severe
restrictions on the physical form of the material. The necessary
processing of the material runs against the demand for CRMs
with representative matrix and analyte form. For example, solid
materials are often ground and filtered to assure homogeneity,
while liquid materials sometimes are lyophilized to improve the
stability. Sterile filtration is a possible alternative method to
preserve biological fluids, and a CRM for trace elements in
sterile filtered liquid serum is under production.19
The representativity of the CRM is not the only area for
improvement. The database COMAR contains information of
more than 9000 certified reference materials.20 A recent
REMCO status report shows that about 1500 reference
materials are under certification.21 At present, there are no
general requirements to CRM producers to demonstrate their
competence, and therefore it cannot be guaranteed that all
CRMs in the COMAR register warrant the definition of a CRM
and to the demands for strict documentation, as required by,
e.g., the ISO guides 31,22 3423 and 35.24 Guidelines for
production and certification of reference material issued by,
e.g., the Standards, Measurement and Testing Programme
(SM&T, formerly the BCR)15 and the National Institute of
Standards and Technology (NIST)25 may serve as a practical
reference for other minor certifying bodies. The process of
certifying a BCR CRM includes strict adherence to these
guidelines and scrutiny of the certification report by a
certification committee consisting of a panel of expert scien- Fig. 1 Uncertainty estimation. Laboratory A ignores uncertainty asso-
tists. This procedure ensures that CRMs issued by BCR are of ciated to the calibrator and the measurement principle and produces
high quality with respect to documentation and with respect to analytical results far from the true value. Laboratory B takes the uncertainty
metrological quality, i.e., traceability and uncertainty. It has into account and, therefore, the true value is included in the confidence
been suggested that the ISO guides and other guidelines (e.g., interval associated with the analytical result.
View Article Online
principle used by the laboratory when evaluating the un- quantified with the same scientific objectivity as the result itself.
certainty. As shown in the figure, the laboratory produces This situation may be acceptable as long as the evaluation of
results far from the given reference value, and the deviation uncertainty is clearly documented. In the discussion of
from the reference value is not accounted for by the reproduci- uncertainty it must be remembered that the measurement result
bility standard deviation reported by the laboratory. Moreover, is the primary outcome of a measurement and the uncertainty is
the low reproducibility standard deviation may give the a secondary (but not insignificant) outcome.
laboratorys customers a false impression of the laboratorys
performance. On the other hand, Laboratory B is concerned
with all aspects of the measurement. The laboratory concludes International measurement evaluation programme
that the values assigned to the calibrators purchased from
Demonstrating the need for reference measurements, the
Company A are exact, and that bias from the measurement
Institute for Reference Materials and Measurement (IRMM) in
principle is absent. As no corrections are introduced, Laboratory
1988 set up the International Measurement Evaluation Pro-
B arrives at the same result of measurement as Laboratory A.
gramme (IMEP). In IMEP the results from the participating
However, Laboratory B estimated the calibrators values to be
laboratories are compared with a reference range that contains a
exact and the measurement principle to be free of bias with
value that is traceable to SI system of measurements in order to
some uncertainty. These uncertainty components are combined
give an objective picture of the state-of-the-art practice of
Published on 01 January 1998. Downloaded on 28/10/2014 14:17:14.
for members and other interested parties, to establish working among participants. The consensus mean value (if necessary
groups related to specific scientific matters and to issue after exclusion of outliers) may be deemed very reliable if the
scientific publications. Only organizations or regional EQA EQA scheme involves many laboratories and with representa-
schemes with more than 100 participants can become full tion of many different methods including definitive methods.
members.34 However, the use of an assigned value obtained from concurrent
Serious errors may occur at the state of sampling. Therefore, results from a number of expert laboratories is preferable. Only
sample collection guidelines (technical report) for trace ele- few schemes offer traceability together with the assigned value.
ments in blood and urine have been issued by IUPAC.35 The This problem should not be solved by using CRMs as control
guidelines include the most important elements measured in samples in EQA schemes as stocks of the CRMs soon would run
occupational and clinical chemistry and embraces harmonized out. However, the concept of the IMEP programme is a valuable
procedures for collection, preparation, analysis and quality possibility for obtaining traceability in a EQA scheme and
control. further initiatives must be encouraged.
Recently, it has been decided that the coming revison of ISO/ The expression of the uncertainty of a result allows
IEC Guide 25 will be upgraded to international standard and, in comparison of results with reference values given in specifica-
addition to this, the coming revision of EN 45001 will be in tions and standards. The accreditation standard EN 45001 and
concordance with the revised ISO/IEC Guide 25.36 However, the ISO Guide 25 call for uncertainty to be reported for
Published on 01 January 1998. Downloaded on 28/10/2014 14:17:14.
standardization by itself will not result in improvements of the measurement results. Although this demand represents a
quality of output. The classical quality management is focused significant progress because it recognizes that the quality of
on corrective actions to be made in order to secure continuous measurement results is important for the use of the data, this
conformity to the proper standards. A new trend is gradually progress is not reflected, in general, in the design of external
introduced in the field of analytical chemistry: total quality quality control schemes or in the guidelines for holding
management (TQM) which focuses on continuous quality interlaboratory studies. In other words, the performance of a
improvements. The motivation for improvements will not arise laboratory is still judged on the basis of the distance between the
from standard-regulated activities. Improvements occur when result reported by the laboratory and the target value (calculated
the analysts are constantly on the lookout for problems, and by the scheme organizer). The distance may be deemed
have sufficient energy and vitality to improve the quality of acceptable or not acceptable according to some limits common
their work. In this context, TQM puts greater weight on attitudes to all laboratories. However, these limits do not reflect the
towards quality than does classical quality management. individual uncertainties of the laboratories and it may happen
As a consequence of the increasing use of laboratory that a result is denoted unacceptable although it is satisfactory
management systems (LIMS) the U.S. Environmental Protec- viewed from the perspective of the laboratory (see Fig. 3).
tion Agency, EPA, has developed Good Automated Laboratory Introduction of measurement uncertainty in EQA schemes will
Practices (GALP) which provide the users with principles and allow a more harmonized and up-to-date comparison of the test
guidance for regulations to assure data integrity in automated result obtained by the laboratories with the target values and
laboratory operations.37 The document includes a guidance for acceptability limits: if the confidence interval of the laboratory
implementation. The GALPs are developed to assure the result overlaps the acceptance interval in the EQA evaluation,
reliability of data prepared by laboratories using LIMS to the performance should be considered as acceptable. On the
acquire, record, manipulate, store and archive data. other hand, if the interval is not overlapping, a discrepancy
exists which must be investigated and explained by the
laboratory.
The benefit gained from interlaboratory studies like EQA
Discussion
schemes depends on the design of the scheme. Critical subjects
The reliability and usefulness of any test result depends are estimation of the target value, sample distribution, commu-
critically on the competence of the laboratory carrying out the nication and feedback among participants and scheme organizer
test. Laboratory accreditation provides the laboratory with an and the internal politics of the participating laboratory (Are the
independent evaluation and recognition of technical compe- results reviewed and discussed? If necessary, are improvements
tence to perform specific tests. The evaluation covers all aspects initiated?).40 Participation of the laboratories in EQA schemes
of the laboratory operations and is made by technical experts is required by the accreditation bodies. In this context, it is
and quality professionals. important that scoring results from participation on EQA
In the near future, accreditation will provide users of test schemes are transparent to the laboratories and the accreditation
results with a network of serious and well recognized clinical bodies. Poor performance must be subject to a careful
laboratories where quality control is a matter of daily routine.
Furthermore, accreditation will increasingly become a demand
from legal authorities as a great advantage from accreditation is
the mutual recognition of test results. ISO 900138 or ISO 900239
certification of A laboratories and certification of personnel are
not expected to attract laboratories performing routine analyses,
but it may be an interesting alternative for laboratories working
with research (ISO 9001). Nomination and accreditation of
national reference laboratories in the field of clinical chemistry
may serve as an enforcing factor to introduce a greater extent of
traceability. Reference laboratories can provide traceability by
participation in international EQA schemes, the IMEP pro-
gramme and by production of CRMs with matrices relevant for
clinical laboratories. The production of speciation CRMs may
Fig. 3 Performance evaluation in external quality assessment. When the
be another challenge for the national reference laboratories. laboratory result is outside the acceptance range (shaded area) the
Today most EQA schemes covering metal analyses are not laboratory performance will traditionally be deemed unacceptable.
operated on a metrological basis. Most of the schemes provide However, if the EQA evaluation takes notice of the uncertainty of the
the participants with an evaluation based on consensus values, laboratory result (illustrated by the normal distribution) the laboratory
trimmed means, etc., which can be sensitive to group bias performance should rightfully be deemed acceptable.
View Article Online
examination by the laboratory in order to explain what caused 6 International Standards Organisation, Control Charts - General
the bad result. The importance of harmonization of existing Guide and Introduction, ISO 7870, ISO, Geneva, 1993.
schemes with respect to performance score must be stressed as 7 International Standards Organisation, Control Charts for Arithmetic
this factor imposes a major instigation for improvement of Means and Warning Limits, ISO 7873, ISO, Geneva, 1993.
8 International Standards Organisation, Acceptance Control Charts,
laboratory performance. Further steps in the harmonization of ISO 7966, ISO, Geneva, 1993.
EQA schemes covering trace elements in clinical chemistry 9 International Standards Organisation, Shewhart Control Charts, ISO
should involve harmonization of acceptability limits for results 8258, Geneva, 1991.
and expected standard deviation for analytes of major concern, 10 Thompson, M., and Wood, R., Pure Appl. Chem., 1995, 67, 649.
i.e., those for which biological exposure indices have been 11 International Standards Organisation, Uses of Certified Reference
established. In view of the importance of EQA schemes in Materials, ISO Guide 33, ISO, Geneva, 1989.
relation to the accreditation process, the need for organizers of 12 Cornelis, R., Mikrochim. Acta, 1991, III, 37.
EQA schemes to adhere to an internationally accepted protocol 13 General criteria for the operation of testing laboratories, Committe
and to become either accredited or certified will be adressed in Europeen de Normalisation/Committe Europeen de Normalisation
the future. Electrotechnique, Brussels, EN 45001, 1989.
14 Christensen, J. M., and Olsen, E., Ann. Ist. Super. Sanit`a, 1996, 32,
Today numerous national EQA schemes exist covering e.g., 285.
the parameter lead in blood.41 Collaboration among EQA 15 European Commission, Guidelines for the Production and Certifica-
Published on 01 January 1998. Downloaded on 28/10/2014 14:17:14.
scheme organizers would possibly reduce the number of EQA tion of BCR Reference Materials, Doc. BCR/48/93, Commission of
schemes with a small number of participants leaving resources the European Community, Brussels, 1994.
for EQA schemes to cover less common parameters like 16 Taylor, B. N., and Kuyatt, C. E., Guidelines for evaluating and
different element species. expressing the uncertainty of NIST measurement results. NIST
The visible effect of the quality work applied to analytical Technical Note 1297, 1994 edn., United States Department of
chemistry is unfortunately affected by the unacceptable high Commerce, National Institute of Standards and Metrology, Gaithers-
number of human errors. In a recent interlaboratory study we burg, MD.
experienced that approximately 5% out of 2462 reported results 17 Lamberty, A., Van Nevel, L., Moody, J. R., and De Bievre, P.,
Accred. Qual. Assur., 1996, 1, 71.
were affected by human errors, mostly simple calculation errors 18 Bureau International des Poids et Mesures, International Electro-
and reporting of wrong units of measurement. Blunders were chemical Commision, International Federation of Clinical Chemistry,
reported by 25% of the participating laboratories. In this International Organization for Standardization, International Organi-
context, the underlying philosophy of continuous quality zation for Pure and Applied Chemistry, International Organization
improvement from TQM seems to be a valuable step forward. It for Pure and Applied Physics and International Organization of Legal
may be expected that the number of blunders occurring in Metrology, International Vocabulary of Basic and General Terms in
analytical measurements will decrease if the analytical laborato- Metrology, ISO, Geneva, 1993.
ries implement TQM 19 Christensen, J. M., Kristiansen, J., Heydorn, K., Damsgaard, E., and
Cornelis, R., IAEA meeting report, in the press.
20 Klich, H., in Quality Assurance and TQM for Analytical Laborato-
ries, ed. Parkany, M., The Royal Society of Chemistry, Cambridge,
Conclusion 1995, pp. 8085.
21 Rasberry, S., ISO/REMCO, ISO, Geneva, 1995.
Future demands of laboratories working in the field of clinical 22 International Standards Organisation, Contents of Certificates of
chemistry are implementation of traceability and uncertainty, Reference Materials, ISO Guide 31, ISO, Geneva, 1981.
the two indispensable concepts in metrology. Measurement 23 International Standards Organisation, International Organization for
results are no longer acceptable without a statement of a Standardization, ISO Guide 34, ISO, Geneva, 1996.
24 International Standards Organisation, Certification of Reference
standard uncertainty.
MaterialsGeneral and Statistical Principles, ISO Guide 35, ISO,
Participation in EQA is required in accreditation and, Geneva, 1989.
therefore, EQA scheme organizers should adhere to an 25 Taylor, J. K., Handbook for SRM Users, ed. Trahey, N. M, United
internationally recognized and harmonized protocol thus pro- States Department of Commerce, National Institute of Standards and
viding more transparency in the results to the laboratories and Metrology, Gaithersburg, MD, 1993.
accreditation bodies. With the implementation of traceability 26 Kristiansen, J., Christensen, J. M., Lillemark, L., Linde, S. A., Merry,
and uncertainty and with revised evaluation of laboratory J., Nyeland, B., and Petersen, O., Fresenius J. Anal. Chem., 1995,
performance in EQA schemes, the field of clinical chemistry 352, 157.
will be entering a new era based on sound metrology rather than 27 Bureau International des Poids et Mesures, International Electro-
just comparability. chemical Commission, International Federation of Clinical Chem-
istry, International Organization of Standardization, International
Union of Pure and Applied Chemistry, International Union of Pure
and Applied Physics and International Organization of Legal
Metrology, Guide to the Expression of Uncertainty in Measurement,
References ISO, Geneva, 1993.
1 International Standards Organisation, Accuracy (Trueness and Preci- 28 Kristiansen, J., Christensen, J. M., and Nielsen, J. L., Mikrochim.
sion) of Measurement Methods and Results. Part 1: General Acta, 1996, 123, 241.
Principles and Definitions, ISO Standard 5725-1, ISO, Geneva, 29 Kristiansen, J., and Christensen, J. M., Ann. Clin. Biochem., in the
1994. press.
2 Broderick, B. E., Cofino, W. P., Cornelis, R., Heydorn, K., Horwitz, 30 European cooperation for Accreditation of Laboratories, European
W., Hunt, D. T. E., Hutton, R. C., Kongston, H. M., Muntau, H., Confederation of Laboratory Medicine, Publication EAL-G25,
Baudo, R., Rossi, D., vaan Raaphorst, J. G., Lub, T. T., Schramel, P., Accreditation for Medical Laboratories, EAL/ECLM, 1997.
Smyth, F. T., Wells, D. E., and Kelly, A. G., Mikrochim. Acta, 1991, 31 International Standards Organisastion, General Requirements for the
II, 523. Competence of Testing and Calibration laboratories, ISO/IEC Guide
3 Wernimont, G. T., Use of Statistics to Develop and Evaluate 25, ISO, Geneva, 1990.
Analytical Methods, ed. Spindley, W., Association of Official 32 Proficiency Testing by Interlaboratory IntercomparisonsPart 1:
Analytical Chemists, Arlington, VA, 1985. Development and Operation of Proficiency Testing SchemesPart
4 Christensen, J. M., Poulsen, O. M., and Anglov, T., in Handbook on 2: Selection and Use of Proficiency Testing Schemes by Laboratory
Metals in Clinical and Analytical Chemistry, ed. Seiler, H. G., Sigel, Accreditation Bodies, ISO, Geneva, 1996.
A., and Sigel, H., Marcel Dekker, New York, 1994, pp. 4546. 33 Thompson, M., and Wood, R., Pure Appl. Chem., 1993, 65, 2123.
5 Christensen, J. M., Mikrochim. Acta, 1996, 123, 231. 34 Uldall, A., EQAnews, 1996, 8, 3.
View Article Online
35 Cornelis, R., Heinzow, B., Herber, R. F. M., Molin Christensen, J., 39 International Standards Organisation, Quality SystemsModel for
Poulsen, O. M., Sabbioni, E., Templeton, D. M., Thomassen, Y., Quality Assurance in Production, Installation and Servicing, ISO
Vahter, M., and Vesterberg, O., Pure Appl. Chem., 1995, 67, 1575. 9002, ISO, Geneva, 1994.
36 van de Leemput, P. J. H. A. M., Accred. Qual. Assur., 1997, 2, 40 Taylor, A., Mikrochim. Acta, 1996, 123, 251.
263. 41 Taylor, A., Patriarca, M., Menditto, A., and Morisi, G., Ann. Ist.
37 Good Automated Laboratory Practices, U.S. Environmental Protec- Super Sanit`a, 1996, 32, 295.
tion Agency, North Carolina, 1995.
38 International Standards Organisation, Quality SystemsModel for Paper 7/06358J
Quality Assurance in Design, Development, Production, Installation Received September 1, 1997
and Servicing, ISO 9001, ISO, Geneva, 1994. Accepted October 29, 1997
Published on 01 January 1998. Downloaded on 28/10/2014 14:17:14.