Clustering Time Series Data Using Kohonen Self-organizing Map (KSOM) for Classification of Sewage Treatment Plant Operations
Kohonen Self Organizing Map (SOM) is an unsupervised neural network that can create a low-dimensional representation of the high-dimensional input data, allowing for visual analysis and interpretation of the clusters. In the context of time series data, SOMs can be used to identify patterns and simi...
Published in: | Lecture Notes in Networks and Systems |
---|---|
Main Author: | |
Format: | Conference paper |
Language: | English |
Published: |
Springer Science and Business Media Deutschland GmbH
2024
|
Online Access: | https://www.scopus.com/inward/record.uri?eid=2-s2.0-85211360182&doi=10.1007%2f978-3-031-70687-5_18&partnerID=40&md5=f83f8668ef1b98d67ca048411eb7f335 |
id |
2-s2.0-85211360182 |
---|---|
spelling |
2-s2.0-85211360182 Khairuddin U.; Ahmad A.; Fauzi M.F.M.; Chin K.B.; Zainudin S.F.; Aris A.M. Clustering Time Series Data Using Kohonen Self-organizing Map (KSOM) for Classification of Sewage Treatment Plant Operations 2024 Lecture Notes in Networks and Systems 1133 LNNS 10.1007/978-3-031-70687-5_18 https://www.scopus.com/inward/record.uri?eid=2-s2.0-85211360182&doi=10.1007%2f978-3-031-70687-5_18&partnerID=40&md5=f83f8668ef1b98d67ca048411eb7f335 Kohonen Self Organizing Map (SOM) is an unsupervised neural network that can create a low-dimensional representation of the high-dimensional input data, allowing for visual analysis and interpretation of the clusters. In the context of time series data, SOMs can be used to identify patterns and similarities in the temporal domain and group similar time series into clusters, which can be helpful for anomaly detection and prediction tasks. Thus, this study extensively explores the KSOM algorithm to proficiently cluster data acquired from Indah Water Konsortium, a principal entity in Malaysia’s wastewater management sector. Methodically, 34,184 samples about essential wastewater treatment parameters were analyzed through a systematic data acquisition, preparation, and clustering procedure. Quantitative findings elucidated that the optimal clustering, identified with a 10 × 10 map size after 700 epochs, yielded a quantization error of 0.32 and a topological error of 0.04, producing three distinct clusters with 15.67% overlap. However, challenges emerged due to non-linear separability, complicating the delineation between the closely related clusters. The unveiled insights underscore the necessity for refined methodologies and innovative clustering techniques, propelling advancements in the precision of environmental data analysis, essential for progress in sustainable wastewater treatment processes in evolving developmental landscapes. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024. Springer Science and Business Media Deutschland GmbH 23673370 English Conference paper |
author |
Khairuddin U.; Ahmad A.; Fauzi M.F.M.; Chin K.B.; Zainudin S.F.; Aris A.M. |
spellingShingle |
Khairuddin U.; Ahmad A.; Fauzi M.F.M.; Chin K.B.; Zainudin S.F.; Aris A.M. Clustering Time Series Data Using Kohonen Self-organizing Map (KSOM) for Classification of Sewage Treatment Plant Operations |
author_facet |
Khairuddin U.; Ahmad A.; Fauzi M.F.M.; Chin K.B.; Zainudin S.F.; Aris A.M. |
author_sort |
Khairuddin U.; Ahmad A.; Fauzi M.F.M.; Chin K.B.; Zainudin S.F.; Aris A.M. |
title |
Clustering Time Series Data Using Kohonen Self-organizing Map (KSOM) for Classification of Sewage Treatment Plant Operations |
title_short |
Clustering Time Series Data Using Kohonen Self-organizing Map (KSOM) for Classification of Sewage Treatment Plant Operations |
title_full |
Clustering Time Series Data Using Kohonen Self-organizing Map (KSOM) for Classification of Sewage Treatment Plant Operations |
title_fullStr |
Clustering Time Series Data Using Kohonen Self-organizing Map (KSOM) for Classification of Sewage Treatment Plant Operations |
title_full_unstemmed |
Clustering Time Series Data Using Kohonen Self-organizing Map (KSOM) for Classification of Sewage Treatment Plant Operations |
title_sort |
Clustering Time Series Data Using Kohonen Self-organizing Map (KSOM) for Classification of Sewage Treatment Plant Operations |
publishDate |
2024 |
container_title |
Lecture Notes in Networks and Systems |
container_volume |
1133 LNNS |
container_issue |
|
doi_str_mv |
10.1007/978-3-031-70687-5_18 |
url |
https://www.scopus.com/inward/record.uri?eid=2-s2.0-85211360182&doi=10.1007%2f978-3-031-70687-5_18&partnerID=40&md5=f83f8668ef1b98d67ca048411eb7f335 |
description |
Kohonen Self Organizing Map (SOM) is an unsupervised neural network that can create a low-dimensional representation of the high-dimensional input data, allowing for visual analysis and interpretation of the clusters. In the context of time series data, SOMs can be used to identify patterns and similarities in the temporal domain and group similar time series into clusters, which can be helpful for anomaly detection and prediction tasks. Thus, this study extensively explores the KSOM algorithm to proficiently cluster data acquired from Indah Water Konsortium, a principal entity in Malaysia’s wastewater management sector. Methodically, 34,184 samples about essential wastewater treatment parameters were analyzed through a systematic data acquisition, preparation, and clustering procedure. Quantitative findings elucidated that the optimal clustering, identified with a 10 × 10 map size after 700 epochs, yielded a quantization error of 0.32 and a topological error of 0.04, producing three distinct clusters with 15.67% overlap. However, challenges emerged due to non-linear separability, complicating the delineation between the closely related clusters. The unveiled insights underscore the necessity for refined methodologies and innovative clustering techniques, propelling advancements in the precision of environmental data analysis, essential for progress in sustainable wastewater treatment processes in evolving developmental landscapes. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024. |
publisher |
Springer Science and Business Media Deutschland GmbH |
issn |
23673370 |
language |
English |
format |
Conference paper |
accesstype |
|
record_format |
scopus |
collection |
Scopus |
_version_ |
1820775436769034240 |