TY - JOUR
T1 - Anomaly detection for noisy data with the mahalanobis–taguchi system
AU - Ohkubo, Masato
AU - Nagata, Yasushi
N1 - Funding Information:
This work was supported by the Scientific Research Committee (KBN), Grant No. 8T11B 071 08.
Publisher Copyright:
© 2020 by the authors.
PY - 2020
Y1 - 2020
N2 - Purpose: Condition-based maintenance requires an accurate detection of unknown yet-to-have-occurred anomalies and the establishment of anomaly detection procedure for sensor data is urgently needed. Sensor data are noisy, and a conventional analysis cannot always be conducted appropriately. An anomaly detection procedure for noisy data was therefore developed. Methodology/Approach: In a conventional Mahalanobis–Taguchi method, appropriate anomaly detection is difficult with noisy data. Herein, the following is applied: 1) estimation of a statistical model considering noise, 2) its application to anomaly detection, and 3) development of a corresponding analysis framework. Findings: Engineers can conduct anomaly detection through the measurement and accumulation, analysis, and feedback of data. Especially, the two-step estimation of the statistical model in the analysis stage helps because it bridges technical knowledge and advanced anomaly detection. Research Limitation/implication: A novel data-utilisation design regarding the acquired quality is provided. Sensor-collected big data are generally noisy. By contrast, data targeted through conventional statistical quality control are small but the noise is controlled. Thus various findings for quality acquisition can be obtained. A framework for data analysis using big and small data is provided. Originality/Value of paper: The proposed statistical anomaly detection procedure for noisy data will improve of the feasibility of new services such as condition-based maintenance of equipment using sensor data.
AB - Purpose: Condition-based maintenance requires an accurate detection of unknown yet-to-have-occurred anomalies and the establishment of anomaly detection procedure for sensor data is urgently needed. Sensor data are noisy, and a conventional analysis cannot always be conducted appropriately. An anomaly detection procedure for noisy data was therefore developed. Methodology/Approach: In a conventional Mahalanobis–Taguchi method, appropriate anomaly detection is difficult with noisy data. Herein, the following is applied: 1) estimation of a statistical model considering noise, 2) its application to anomaly detection, and 3) development of a corresponding analysis framework. Findings: Engineers can conduct anomaly detection through the measurement and accumulation, analysis, and feedback of data. Especially, the two-step estimation of the statistical model in the analysis stage helps because it bridges technical knowledge and advanced anomaly detection. Research Limitation/implication: A novel data-utilisation design regarding the acquired quality is provided. Sensor-collected big data are generally noisy. By contrast, data targeted through conventional statistical quality control are small but the noise is controlled. Thus various findings for quality acquisition can be obtained. A framework for data analysis using big and small data is provided. Originality/Value of paper: The proposed statistical anomaly detection procedure for noisy data will improve of the feasibility of new services such as condition-based maintenance of equipment using sensor data.
KW - Engineered system
KW - Gaussian graphical model
KW - Liner Gaussian model
KW - Statistical modelling
KW - Taguchi method
UR - http://www.scopus.com/inward/record.url?scp=85090524711&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85090524711&partnerID=8YFLogxK
U2 - 10.12776/QIP.V24I2.1441
DO - 10.12776/QIP.V24I2.1441
M3 - Article
AN - SCOPUS:85090524711
SN - 1335-1745
VL - 24
SP - 75
EP - 92
JO - Quality Innovation Prosperity
JF - Quality Innovation Prosperity
IS - 2
ER -