Detection of Clips Failures in Manufacturing using Audio Signals

Suer S., Koseoglu I., Oner R., İnce G.

5th International Congress on Human-Computer Interaction, Optimization and Robotic Applications, HORA 2023, İstanbul, Turkey, 8 - 10 June 2023 identifier

  • Publication Type: Conference Paper / Full Text
  • Doi Number: 10.1109/hora58378.2023.10156765
  • City: İstanbul
  • Country: Turkey
  • Keywords: anomaly detection, machine learning, sound detection
  • Istanbul Technical University Affiliated: Yes


In industrial manufacturing processes, such as plugging small connectors in, where visual verification is difficult, workers may experience difficulties in detecting failures. Artificial intelligence algorithms can be used to detect and identify the sound of these connectors and mitigate human error. In this work, sound samples of correctly plugged-in connectors and ordinary background noise of the workplace were collected using a recording setup fastened to workers' hand. In order to discriminate anomalies that represent failures, autoencoder models were trained and tested in an unsupervised manner. Experiments with different deep learning architectures for anomaly detection are conducted. Our CNNAE-FT model achieved best results and yielded a ROC-AUC score of 0.85.