Evaluating Convolutional Neural Network Architecture for Historical Topographic Hardcopy Maps Analysis: A Study on Training and Validation Accuracy Variation

• Published in: Pertanika Journal of Science and Technology
• Main Author: Jaafar S.A.; Rasam A.R.A.; Diah N.M.
• Format: Article
• Language: English
• Published: Universiti Putra Malaysia Press 2024
• Online Access: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85208607925&doi=10.47836%2fpjst.32.6.11&partnerID=40&md5=a58973072175fda1b4f5ca0056f130cd

Convolutional Neural Networks (CNN) are widely used for image analysis tasks, including object detection, segmentation, and recognition. Given the advanced capability, this study evaluates the effectiveness and performance of CNN architecture for analysing Historical Topographic Hardcopy Maps (HTHM) by assessing variations in training and validation accuracy. The lack of research specifically dedicated to CNN’s application in analysing topographic hardcopy maps presents an opportunity to explore and address the unique challenges associated with this domain. While existing studies have predominantly focused on satellite imagery, this study aims to uncover valuable insights, patterns, and characteristics inherent to HTHM through customised CNN approaches. This study utilises a standard CNN architecture and tests the model’s performance with different epoch settings (20, 40, and 60) using varying dataset sizes (288, 636, 1144, and 1716 images). The results indicate that the optimal operation point for training and validation accuracy is achieved at epoch 40. Beyond epoch 40, the widening gap between training and validation accuracy suggests overfitting. Hence, adding more epochs does not significantly improve accuracy beyond the optimum phase. The experiment also shows that the CNN model obtains a training accuracy of 98%, validation accuracy of 67%, and F1-score overall performance of 77%. The analysis demonstrates that the CNN model performs reasonably well in classifying instances from the HTHM dataset. These findings contribute to a better understanding of the strengths and limitations of the model, providing valuable insights for future research and refinement of classification approaches in the context of topographic hardcopy map analysis. © Universiti Putra Malaysia Press.