Cover
Vol. 22 No. 1 (2026)

Published: June 15, 2026

Pages: 363-373

Original Article

Enhancing Underwater Search and Rescue Operations: A CNN Approach for Human, Fish, and Plant Classification

Abstract

In recent times, artificial intelligence has become an essential part of our lives, particularly in tasks involving object recognition. This paper explores the use of convolutional neural networks (CNNs) for enhancing underwater search and rescue operations by classifying images of humans, fish, and plants. Leveraging the OpenCV library for preprocessing and the Keras library with a TensorFlow backend for recognition, this study utilizes a dataset captured through field experiments. The methodology involved preprocessing the images for segmentation, followed by training a CNN model to classify these images with high accuracy. The CNN model demonstrated a remarkable classification accuracy of 99.6 %, significantly outperforming other modern machine-learning methods. This work suggests that CNNs can greatly improve the speed and effectiveness of underwater search and rescue operations by accurately identifying and locating submerged persons, which is critical for timely rescue missions.

References

  1. Y. S. Samant, “Image processing: Challenges and application,” IJARSCT, vol. 5, no. 2, 2021.
  2. Y. Kaya, S. Hong, and T. Dumitras, “Shallow-deep networks: Understanding and mitigating network overthinking,” in International Conference on Machine Learning, pp. 3301–3310, 2019.
  3. H. Qin, X. Li, Z. Yang, and M. Shang, “When underwater imagery analysis meets deep learning: a solution at the age of big visual data,” in OCEANS 2015 - MTS/IEEE Washington, pp. 1–5, 2015.
  4. D. Cires, an, U. Meier, J. Masci, and J. Schmidhuber, “Multi-column deep neural network for traffic sign classification,” Neural Networks, vol. 32, pp. 333–338, 2012.
  5. D. P. Williams and J. Groen, “A fast physics-based, environmentally adaptive underwater object detection algorithm,” in Proceedings of the OCEANS, pp. 1–7, 2011.
  6. E. Galceran, V. Djapic, M. Carreras, and D. P. Williams, “A real-time underwater object detection algorithm for multi-beam forward looking sonar,” in IFAC Proceedings Volumes, vol. 45, pp. 306–311, 2012.
  7. R. Aziz, C. Verma, and N. Srivastava, “A fuzzy-based feature selection from independent component subspace for machine learning classification of microarray data,” Genomics Data, vol. 8, pp. 4–15, 2016.
  8. T. Anwar and S. Zakir, “Effect of image augmentation on ecg image classification using deep learning,” in 2021 International Conference on Artificial Intelligence (ICAI), pp. 182–186, 2021.
  9. M. Saberioon, P. C´ısaˇr, L. Labb´e, P. Souˇcek, P. Pelissier, and T. Kerneis, “Comparative performance analysis of support vector machine, random forest, logistic regression and k-nearest neighbors in rainbow trout (oncorhynchus mykiss) classification using image-based features,” Sensors, vol. 18, no. 4, p. 1027, 2018.
  10. N. J. C. Strachan, P. Nesvadba, and A. R. Allen, “Fish species recognition by shape analysis of images,” Pattern Recognition, vol. 23, no. 5, pp. 539–544, 1990.
  11. A. Rova, G. Mori, and L. M. Dill, “One fish, two fish, butterfish, trumpeter: Recognising fish in underwater videos,” in IAPR Conference on Machine Vision Applications, pp. 404–407, 2007.
  12. S. Raine, R. Marchant, P. Moghadam, F. Maire, B. Kettle, and B. Kusy, “Multi-species seagrass detection and classification from underwater images,” in Digital Image Computing: Techniques and Applications (DICTA), pp. 1–8, 2020.
  13. F. Han, J. Yao, H. Zhu, and C. Wang, “Underwater image processing and object detection based on deep cnn method,” First published, 2020.
  14. R. Rismiyati and A. Luthfiarta, “Vgg16 transfer learning architecture for salak fruit quality classification,” Telematika, vol. 18, no. 1, p. 37, 2021.
  15. N. Ibrahim, G. A. Lestary, F. S. Hanafi, K. Saleh, N. K. C. Pratiwi, M. S. Haq, and A. I. Mastur, “Classification of tea leaf shoot maturity level using convolutional neural network method,” ELKOMIKA: Journal of Electrical Energy Engineering, Telecommunication Engineering, & Electronic Engineering, vol. 10, no. 1, p. 162, 2022.
  16. F. Kratzert and H. Mader, “Fish species classification in underwater video monitoring using convolutional neural networks,” in IEEE OCEANS 2018 MTS/IEEE Kobe Techno-Oceans (OTO), pp. 1–6, 2018.
  17. A. Salman, S. A. Siddiqui, F. Shafait, A. Mian, M. R. Shortis, K. Khurshid, et al., “Automatic fish detection in underwater videos by a deep neural network-based hybrid motion learning system,” ICES Journal of Marine Science, vol. 77, no. 4, pp. 1295–1307, 2020.
  18. V. J. D. Almero, R. S. Concepcion, E. Sybingco, and E. P. Dadios, “An image classifier for underwater fish detection using classification tree-artificial neural network hybrid,” in 2020 RIVF International Conference on Computing and Communication Technologies (RIVF), pp. 1–6, 2020.
  19. S. Villon, D. Mouillot, M. Chaumont, E. S. Darling, G. Subsol, T. Claverie, et al., “A deep learning method for accurate and fast identification of coral reef fishes in underwater images,” Ecological Informatics, vol. 48, pp. 238–244, 2018.
  20. A. Michele, V. Colin, and D. D. Santika, “Mobilenet convolutional neural networks and support vector machines for palmprint recognition,” Procedia Computer Science, vol. 157, pp. 110–117, 2019.
  21. B. Hariharan, P. Arbelaez, R. Girshick, and J. Malik, “Object instance segmentation and fine-grained localization using hypercolumns,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, pp. 1–14, 2017.
  22. Z. Cai and N. Vasconcelos, “Cascade r-cnn: Delving into high-quality object detection,” in CVPR, pp. 6154–6162, 2018.
  23. N. P. Ramaiah, E. P. Ijjine, and C. K. Mohan, “Illumination invariant thermal face recognition using convolutional neural network,” in 2015 IEEE International Conference on Signal Processing, Informatics, Communication and Energy Systems (SPICES), pp. 1–5, 2015.
  24. C. Buchanan, Y. Bi, B. Xue, R. Vennell, S. Childerhouse, M. K. Pine, D. Briscoe, and M. Zhang, “Deep convolutional neural networks for detecting dolphin echolocation clicks,” in The 6th International Conference on Image and Vision Computing, pp. 1–6, 2021.
  25. U. A. Badawi, “Fish classification using extraction of appropriate feature set,” International Journal of Electrical and Computer Engineering, vol. 12, no. 3, pp. 2488– 2500, 2022.
  26. R. Rokhana, J. Priambodo, T. Karlita, I. Sunarya, E. Yuniarno, I. Purnama, and M. Purnomo, “Convolutional neural network untuk pendeteksian patah tulang femur pada citra ultrasonic b-mode,” J. Nasional Teknik Elektro Dan Teknologi Informasi, vol. 8, no. 1, pp. 59–67, 2019.
  27. I. Putra, A. Wijaya, and R. Soelaiman, “Klasifikasi citra menggunakan convolutional neural network (cnn) pada caltech 101,” Jurnal Teknik ITS, vol. 5, no. 1, pp. A65– A69, 2016.
  28. A. Fauzan, M. Wahyuddin, and S. Ningsih, “Pleural effusion classification based on chest x-ray images using convolutional neural network,” Journal of Computer Science and Information, vol. 14, no. 1, pp. 9–16, 2021.
  29. A. Santra and C. Christy, “Genetic algorithm and confusion matrix for document clustering,” International Journal of Computer Science Issues, vol. 9, no. 1, pp. 322– 328, 2012.
  30. J. Han, K. Micheline, and P. Jian, Data Mining Concepts and Techniques. Morgan Kaufmann, 2012.
  31. A. Devarakonda, M. Naumov, and M. Garland, “Adabatch: adaptive batch sizes for training deep neural networks,” in Workshop Track - ICLR, pp. 1–4, 2017.
  32. I. Kandel and M. Castelli, “The effect of batch size on the generalizability of the convolutional neural networks on a histopathology dataset,” ICT Express, vol. 6, no. 4, pp. 312–315, 2020.
  33. F. Nashrullah, S. Adhi, and G. Budiman, “Investigasi parameter epoch pada arsitektur resnet-50 untuk klasifikasi pornografi,” Journal of Computer, Electronic, and Telecommunication, vol. 1, no. 1, pp. 1–8, 2021.
  34. X. Ying, “An overview of overfitting and its solutions,” Journal of Physics: Conference Series, vol. 1168, no. 2, pp. 1–6, 2019.
  35. S. S. Murugan, R. Ganeshbabu, and C. Srinivasan, “Underwater object recognition using knn classifier,” International Journal of Multidisciplinary Sciences and Research, vol. 9, no. 3, pp. 10–14, 2017.
  36. R. A. Dakhil and A. R. H. Khayeat, “Deep learning for enhanced marine vision: Object detection in underwater environments,” International Journal of Electrical and Electronics Research (IJEER), vol. 11, no. 4, pp. 1209– 1218, 2023.
  37. G. W. Thum, S. H. Tang, S. A. Ahmad, and M. Alrifaey, “Toward a highly accurate classification of underwater cable images via deep convolutional neural network,” Journal of Marine Science and Engineering, vol. 8, no. 11, p. 924, 2020.