Methodology for Z-Factor solution validation / evaluation

• Methodology for the types of evaluation activities, timeframe and expected results per activity, instruments to be used (e.g. users’ acceptance questionnaires, impact check-lists and data collection forms) to assist the different types of evaluation exercise. • Technical indicators for performance assessment (KPIs). Indicative e.g. number of correctly detected defects per time interval, precision and recall (where precision will capture positive defect-detection values, and recall will capture sensitivity), F-Measure, False Alarm Rate, Min Time Between Failures, System Up Time, etc. • User/stakeholder acceptance indicators based on 9241/10, 9241/11 and 9241/110 standards. Ergonomics, user-friendliness, usability and plant stakeholders’ satisfaction will be also measured in that respect. E.g. (a) Ful-filment of requirements: “The solution fulfils the trial requirements”, (b) Learnability: “It is easy to start to use the solution and learn functionalities”, (c) Understandability: “The solution is easy and self-clear to understand and the concepts and terminology are understandable”, (d) Efficiency: “The time and resources required to achieve the objectives of the solution are reasonable, the solution is fast enough and does not require too many steps”. • Indicators for assessing the impact of Z-Factor on the factories. Indicative e.g: a) Improvement in the number of production facilities breakdown and amount of idle time, b) machinery deterioration rate and achieved im-provement, c) reduction of production costs, of waste and scrap, d) production output quality (qualified output / total output produced), e) % of products/workpieces successfully repaired, f) improvement in prediction and prevention efficiency, improvement in detection efficiency, g) improvement in production cost, h) improvement in single-stage production defect rate, average multistage production defect rate (goal for zero-defects), i) im-provement in defect propagation to downstream stages.