Eligibility Statement for qs-STAT® | solara.MP® | destra® | Version 10/11/12
Standards for Quality Management concretely require a confirmation for the eligibility of the applied soft-ware for the intended application, before initial use as well as for a continuous use. IATF 16949:2016 provides the following information in chapter 18.104.22.168.1:
” ... The organization shall have a documented process for managing calibration/verification records. (…) The organization shall ensure that calibration/verification activities and records shall include the following details: … i) production-related software verification used for product and process control …”
In this context, ISO 10012:2003 mentions the testing or validation of the software: ”... Software, and any revisions to it, shall be tested and/or validated prior to initial use, approved for use, and archived. Testing shall be to the extent necessary to ensure valid measurement results. “
With this statement, we want to support our customers in this task. Various company guidelines, reference manuals and specifications define procedures and approaches for statistical evalua-tions. These methods are available in qs-STAT®, solara.MP® and destra® in the form of evaluation strategies. This document shall confirm, in all conscience, the evaluation and calculation of statistics according to the respective evaluation strategy. Evidence is given by the comparison of the calculated values with the values that have been documented in the company guidelines, reference manuals or specifications.
The provided eligibility verification is limited to a specific selection of statistics. This selection is based on the scope of the documented reference results in literature, and on mandatory values demanded to validate the evaluation. Please consider that the testing cannot consider all kinds of hardware and software environments which can indeed have an influence on computational accuracy.
Some decimal places of the calculated results may deviate from the references of some statistics due to improved numerical procedures. Please also consider that computer-assisted evaluations generally provide more decimal places than “manual” evaluations. Interim or final results might deviate due to rounding.
Basically, we want to indicate that the test data sets cover a wide range of applications but they cannot guarantee a complete consideration of all possible constellations. If you know of further documented reference data, we would be glad to include them into this eligibility statement.
All test data sets have been taken out of literature. The test procedures have been created by assigning the data sets to the evaluation configurations and the definition of the statistics. Loading and evaluating data as well as comparing them to specified reference values was an automated process.
The test data sets are available on the program CD for your own accomplishment of the eligibility verification. The provided evaluation strategies are write-protected and they can be protected against any kind of intervention by setting appropriate user rights, so that, under these conditions, you can always refer to defined requirements.
All the statistics considered in the eligibility verification show no or no significant deviation from reference values. As already mentioned under “Boundary conditions”, deviations in decimal places are usually caused by different rounding. The following example shows this issue based on a reference from the Measurement System Analysis manual.
The fact that qs-STAT®, solara.MP® or destra® internally calculate significantly more decimal places, of course, affects the interim and final results. This, of course, causes a “deviation” from the reference but does not restrict the eligibility of the software at all!
|File name*.dfq||Test purpose and data source|
|Test_14||Type 1, tolerance-related, |
|Test_15||Type 1, process-related, |
|Test_16||Type 2 (ARM), |
|Bosch_V1_ARM||Type 1, tolerance-related, |
|Bosch_V2_ARM||Type 2, |
|Bosch_V3_ARM||Type 3, |
|Bosch_Attributiv||Attribute, signal detection, |
|QDAS_1BD||Type 1, tolerance-related, |
|QDAS_2AD||Type 2, ARM, |
|QDAS2ADV||Type 2, ARM, |
|GC_AIAG1||Type 2, ANOVA, |
|GC_AIAGV||Type 2, ANOVA, |
|QDAS3ADM||Type 3, ARM, |
|QDAS_3BD||Type 3, ARM, |
|QDAS3ADN||Type 3, ANOVA, |
|QDAS_3AD||Type 3, ANOVA, |
|FORD_1||Type 1, tolerance-related, |
|FORD_2||Type 2, ARM, |
|FORD_3||Type 3, ARM, |
|FORD_4||Type 4, ARM, |
|FORD_5||Type 5, ARM, |
|VDA5_Beispiel1||Measurement uncertainty, |
|VDA5_Beispiel2||Measurement uncertainty, |
|MSA_4th_Edition_Linearity_Study||Linearity, MSA, |
|MSA_4th_Edition_Signal_Detection||Attribute, signal detection, |
|MSA_4th_Edition_Type_2_Study||Type 2 (ARM, ANOVA), |
|CNOMO||Phases 1 and 2, |
|Test_01||Stability conditions, |
|Test_02||Computational accuracy, |
|Test_03||Control charts/capability indices, |
|Test_04||Control charts/capability indices, |
|Test_05||Control charts/capability indices, |
|Test_06||Control charts/capability indices, |
|Test_07||Control charts/capability indices, |
|Test_08||Control charts/capability indices, |
|Test_09||Control charts/capability indices, |
|Test_10||Control charts/capability indices, |
|Test_11||Control charts/capability indices, |
|Test_12||Control charts/capability indices, |
|Test_13||Control charts/capability indices, |
“Measurement System Capability” Reference Manual
|||Ford EU 1880 "Guideline for the Capability of. Measurement Systems and Gages" (1997)|
|||“Quality Management in the Bosch Group – Technical Statistics” series|
Booklet 10 ”Capability of Measurement and Test Processes“ (2003)
|||CNOMO E41.36.110.N |
“Moyens de production, agrément capabilité des moyens de mesure, moyens de contrôle spécifique“ (1991)
|||Ford EU 883 B “Evaluation of SPC software“ (1991)|
|||VDA Volume 5 – Capability of Measurement Processes (2nd edition 2010)|
|||MSA Measurement Systems Analysis, Reference Manual, Fourth Edition (2010)|