Cover
Vol. 17 No. 2 (2021)

Published: December 31, 2021

Pages: 73-93

Review Article

A Survey on Segmentation Techniques for Image Processing

Wala’a N. Jasim 1 Rana Jassim Mohammed 2
1Department of Pharmacognosy, College of Pharmacy, University of Basrah, Iraq.
2Department of Computer Science, College of Education for Pure Sciences, University of Basrah, Iraq.
History
  • Received: June 17, 2021
  • Revised: August 13, 2021
  • Accepted: August 13, 2021
  • Available Online: August 16, 2021
DOI

https://doi.org/10.37917/ijeee.17.2.10

Abstract

The segmentation methods for image processing are studied in the presented work. Image segmentation can be defined as a vital step in digital image processing. Also, it is used in various applications including object co-segmentation, recognition tasks, medical imaging, content based image retrieval, object detection, machine vision and video surveillance. A lot of approaches were created for image segmentation. In addition, the main goal of segmentation is to facilitate and alter the image representation into something which is more important and simply to be analyzed. The approaches of image segmentation are splitting the images into a few parts on the basis of image’s features including texture, color, pixel intensity value and so on. With regard to the presented study, many approaches of image segmentation are reviewed and discussed. The techniques of segmentation might be categorized into six classes: First, thresholding segmentation techniques such as global thresholding (iterative thresholding, minimum error thresholding, otsu's, optimal thresholding, histogram concave analysis and entropy based thresholding), local thresholding (Sauvola’s approach, T.R Singh’s approach, Niblack’s approaches, Bernsen’s approach Bruckstein’s and Yanowitz method and Local Adaptive Automatic Binarization) and dynamic thresholding. Second, edge-based segmentation techniques such as gray-histogram technique, gradient based approach (laplacian of gaussian, differential coefficient approach, canny approach, prewitt approach, Roberts approach and sobel approach). Thirdly, region based segmentation approaches including Region growing techniques (seeded region growing (SRG), statistical region growing, unseeded region growing (UsRG)), also merging and region splitting approaches. Fourthly, clustering approaches, including soft clustering (fuzzy C-means clustering (FCM)) and hard clustering (K-means clustering). Fifth, deep neural network techniques such as convolution neural network, recurrent neural networks (RNNs), encoder-decoder and Auto encoder models and support vector machine. Finally, hybrid techniques such as evolutionary approaches, fuzzy logic and swarm intelligent (PSO and ABC techniques) and discusses the pros and cons of each method.

Keywords

References

  1. R. B. Fisher, T. P. Breckon, K. Dawson-Howe, A. Fitzgibbon, C. Robertson, E. Trucco, and C. K. Williams, “Dictionary of computer vision and image processing,” NIST Special Publication, vol. 7, no. 4, 2013, pp. 22.
  2. D. Venkateshwar Rao, S. Patil, N. Anne Babu and V. Muthukumar , “Implementation and evaluation of image processing algorithms on reconfigurable architecture using C-based hardware descriptive languages,” International Journal of Theoretical and Applied Computer Sciences, vol. 1, no.1 2006, 9-34.
  3. D. Kaur and Y. Kaur, “Various image segmentation techniques: A Review,” International Journal of Computer Jasim & Mohammed | 91 Science and Mobile Computing, vol. 3, no. 5, 2014, pp. 809-814.
  4. W.-X. Kang, Q.-Q. Yang, and R.-P. Liang, “The comparative research on image segmentation algorithms,” [in Proceedings of the 1st International Workshop on Education Technology and Computer Science, IEEE, pp. 703-707], 2009.
  5. R. F. Yaser, “Multiobject extraction from color image, ” PhD Thesis, College of Science, University of Al- Mustansirya, 2016.
  6. R. C. Gonzalez and R. E. Woods, “Digital image processing,” Prentice Hall, Upper Saddle River, New Jersey 07458, 2002.
  7. Deepa M, “Wavelet and curvelet based thresholding techniques for image denoising,” International Journal of Advanced Research in Computer Science and Electronics Engineering, vol. 1, no. 10, 2012, pp. 77-81.
  8. V. Zharkova, “Artificial intelligence in recognition and classification of astrophysical and medical images,” vol. 46. Springer Science & Business Media, 2007.
  9. P. K. Sahoo, S. Soltani, and A. K. Wong, “A survey of thresholding techniques,” Computer Vision, Graphics, and Image Processing, Elsevier, vol. 41, no. 2, 1988, pp. 233- 260.
  10. F. Deravi and S. K. Pal, “Grey level thresholding using second-order statistics,” Pattern Recognition Letters, Elsevier, vol. 1, no. 5-6, 1983, pp. 417-422.
  11. A. Rosenfeld and P. De La Torre, “Histogram concavity analysis as an aid in threshold selection,” IEEE Transactions on Systems, Man, and Cybernetics, no. 2, 1983, pp. 231-235.
  12. D. Rutovitz, “An algorithm for in-line generation of a convex cover,” Computer Graphics and Image Processing, Elsevier, vol. 4, no. 1, 1975, pp. 74-78.
  13. K. Bhargavi and S. Jyothi, “A survey on threshold based segmentation technique in image processing,” International Journal of Innovative Research and Development, vol. 3, no. 12, 2014, pp. 234-239.
  14. T. Kalaiselvi, P. Nagaraja, and V. Indhu, “A comparative study on thresholding techniques for gray image binarization,” International Journal of Advanced Research in Computer Science, vol. 8, no. 7, 2017, pp. 1168-1172.
  15. N. Otsu, “A threshold selection method from gray-level histograms,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 9, no. 1, 1979, pp. 62-66.
  16. G. Dougherty, “Digital image processing for medical applications,” Cambridge University Press, 2009.
  17. M. Athimethphat, “A review on global binarization algorithms for degraded document images,” AU J.T, vol. 14, no. 3, 2011, pp. 188-195.
  18. I. Pitas, “Digital image processing algorithms and applications, ” John Wiley and Sons, 2000. .
  19. W. N. Jasim, “A human activities recognition system for the healthcare services, " M Sc. Thesis, College of Science, University of Basrah, 2018.
  20. R. Firdousi and S. Parveen, “Local thresholding techniques in image binarization," International Journal of Engineering and Computer Science, vol. 3, no. 3, 2014, pp. 4062-4065.
  21. N. R. Pal, E. S. Corchado, L. T. Kóczy, and V. Kreinovich, “Advances in intelligent systems and computing," [in Proceedings of the 2nd International Conference on Data Engineering and Communication Technology, 2017.
  22. O. Imocha Singh, Tejmani Sinam, O. James and T.Romen Singh, “Local contrast and mean based thresholding technique in image binarization,” International Journal of Computer Applications, vol. 51, no.6, 2012, pp. 0975-8887.
  23. M. Sezgin and B. Sankur, “Survey over image thresholding techniques and quantitative performance evaluation,” Journal of Electronic Imaging, vol. 13, no. 1, 2004, pp. 146-165.
  24. G. Leedham, Y. Chen, K. Takru, J. H. N. Tan, and L. Mian, “Comparison of some thresholding algorithms for text/background segmentation in difficult document images,” [in Proceedings of the 7th International Conference on Document Analysis and Recognition, Citeseer, pp. 859-864, 2003].
  25. N. Kaur and R. Kaur, “A review on various methods of image thresholding,” International Journal on Computer Science and Engineering, vol. 3, no. 10, 2011, pp. 3441- 3443.
  26. J. S. Weszka, “A survey of threshold selection techniques,” Computer Graphics and Image Processing, Elsevier, vol. 7, no. 2, 1978, pp. 259-265.
  27. R. Kasturi, and M.M. Trivedi, “Image analysis applications,” Marcel Dekker, Inc, 1990.
  28. M. Jogendra Kumar, Dr. GVS Raj Kumar and R. Vijay Kumar Reddy, “Review on image segmentation techniques,” International Journal of Scientific Research Engineering & Technology, ISSN, 2014, pp.2278-0882.
  29. R. Kirti and A. Bhatnagar, “Image segmentation using canny edge detection technique,” International Journal of Techno-Management Research, vol. 04, no.04, 2017, pp. 8-14.
  30. X. Geets, J. A. Lee, A. Bol, M. Lonneux, and V. Grégoire, “A gradient-based method for segmenting FDG- PET images: methodology and validation,” European Journal of Nuclear Medicine and Molecular Imaging, Springer, vol. 34, no. 9, 2007, pp. 1427-1438.
  31. S. Tara, R. B. B. Reddy, G. Ramesh, and K. S. Sandeep, “Various image segmentation methods based on partial differential equation-a survey,” International. Journal of Advances in Computer, Electrical & Electronics Eng., vol. 3, no. 1, 2014, pp. 183-186.
  32. D. Cremers, “Dynamical statistical shape priors for level set-based tracking,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 8, 2006, pp. 1262-1273.
  33. D. MARR and E. HILDRET, “Theory of edge detection,” [in Proceedings of the Royal Society of London. Series B. Biological Sciences, pp. 187-217, 1980].
  34. J. A. Sethian, “Level set methods and fast marching methods: evolving interfaces in computational geometry, fluid mechanics, computer vision, and materials science,” vol. 3: Cambridge University Press, 1999 Jasim & Mohammed
  35. J. Canny, 1986, “A computational approach to edge detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 8, no. 6, 1986, pp. 679-698.
  36. W. Rong, Z. Li, W. Zhang and L. Sun, “An improved canny edge detection algorithm,” [IEEE international conference on mechatronics and automation, pp. 577-582, 2014]
  37. Y. Yao, “Image segmentation based on sobel edge detection,” [in Proceedings of the 5th International Conference on Advanced Materials and Computer Science, Atlantis Press, pp. 141-144, 2016].
  38. F. Truchetet, F. Nicolier, and O. Laligant, “Subpixel edge detection for dimensional control by artificial vision,” Journal of Electronic Imaging, vol. 10, no. 1, 2001, pp. 234-239.
  39. Priyam, Diganta Dey, Shreya, and Dipanjan Polley, “Edge detection by using canny and prewitt,” International Journal of Scientific & Engineering Research, vol. 7, no. 4, 2016, pp. 251-254.
  40. S. S. Al-Amri, N. Kalyankar, and S. Khamitkar, “Image segmentation by using edge detection,” International Journal on Computer Science and Engineering, Citeseer, vol. 2, no. 3, 2010, pp. 804-807.
  41. G. Shrivakshan and C. Chandrasekar, “A comparison of various edge detection techniques used in image processing,” International Journal of Computer Science Issues, Citeseer, vol. 9, no. 5, 2012, pp. 269-276.
  42. D. Oliva, M. Abd Elaziz, and S. Hinojosa, “Metaheuristic algorithms for image segmentation: theory and applications,” Springer, 2019.
  43. S. Kamdi and R. Krishna, "Image segmentation and region growing algorithm,” International Journal of Computer Technology and Electronics Engineering, vol. 2, no. 1, 2012, pp. 103-107.
  44. R. Adams and L. Bischof, "Seeded region growing,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 16, no. 6, 1994, pp. 641-647.
  45. J. G. Rodriguez , “Advancements in computer vision and image processing,” IGI Global, 2018.
  46. M. Yambal and H. Gupta, “Image segmentation using fuzzy C means clustering: A survey,” International Journal of Advanced Research in Computer and Communication Engineering, vol. 2, no. 7, 2013, pp. 2927-2929.
  47. V. K. Dehariya, S. K. Shrivastava, and R. Jain, “Clustering of image data set using k-means and fuzzy k- means algorithms,” [in Proceedings of the International Conference on Computational Intelligence and Communication Networks, IEEE, 2010, pp. 386-391.]
  48. W.-C. Lin, E. C.-K. Tsao, and C.-T. Chen, “Constraint satisfaction neural networks for image segmentation,” Pattern Recognition, Elsevier, vol. 25, no. 7, 1992, pp. 679-693.
  49. K. Fukushima, “Neocognitron A Self-organizing Neural Network Model for a Mechanism of Pattern Recognition Unaffected by shift in position,” Biological Cybernetics, Springer-Verlag, 1980, pp. 193-202.
  50. G. Wang, et al., “Interactive medical image segmentation using deep learning with image-specific fine tuning,” Interactive medical image segmentation using deep learning with image-specific fine tuning. IEEE transactions on medical imaging, vol. 37, no.7, 2018, 1562-1573
  51. V. Govindan, “Convolutional neural network based segmentation,” [in Proceedings of the International Conference on Information Processing, Springer, 2011, pp. 190-197].
  52. T. C. Zhang, J. Yang, J. P. Zhang, J. Zhang, “SVM methods in image segmentation,” [in Proceedings of the 6th International Conference on Advanced Collaborative Networks, Systems and Applications, IARIA,, pp. 62-65, 2016].
  53. TH.-Y. Yang, X.-Y. Wang, Q.-Y. Wang, and X.-J. Zhang, “LS-SVM based image segmentation using color and texture information,” Journal of Visual Communication and Image Representation, Elsevier, vol. 23, no. 7, 2012, pp. 1095-1112.
  54. Z. Zhang, J. Yang, Y. Wang, D. Dou, and W. Xia, “Ash content prediction of coarse coal by image analysis and GA-SVM,” Powder technology, Elsevier, vol. 268, 2014, pp. 429-435.
  55. K. Mozdren, T. Burianek, J. Platos, and V. Snášel, “Evolutionary techniques for image segmentation,” [in Proceedings of the 5th International Conference on Innovations in Bio-Inspired Computing and Applications IBICA, Springer, pp. 291-300, 2014].
  56. J. Yu, J. Yin, D. Zhou, and J. Zhang, “A pattern distance-based evolutionary approach to time series segmentation,” [in Proceedings of the Intelligent Control and Automation, Springer, pp. 797-802, 2006].
  57. B. Karasulu and S. Balli , “Image segmentation using fuzzy logic, neural networks and genetic algorithms: survey and trends,” Machine Graphics & Vision International Journal, vol. 19, no. 4, 2010, pp.367-409.
  58. M. Abdulghafour, “Image segmentation using fuzzy logic and genetic algorithms,” Journal of WSCG, vol. 11, no. 1, 2003, pp. 1-8.
  59. I. Brajevic, M. Tuba, and M. Subotic, “Performance of the improved artificial bee colony algorithm on standard engineering constrained problems,” [in Proceedings of the International Journal of Mathematics and Computers in Simulation, vol. 5, no. 2, 2011, pp. 135-143.
  60. M. Li and H. Duan, “Hybrid artificial bee colony and particle swarm optimization approach to protein secondary structure prediction,” [In Proceedings of the 10th World Congress on Intelligent Control and Automation, IEEE, pp. 5040-5044, 2012.
  61. E. Cuevas, F. Sención-Echauri, D. Zaldivar, and M. Pérez, “Image segmentation using artificial bee colony optimization,” in Handbook of Optimization, Springer, pp. 965-990, 2013.
  62. M. Bou-Imajjane and M. Sbihi, 2016, “Brain image segmentation using artificial bee colony optimization and markovian potts model,” [in Proceedings of the 5th International Conference on Multimedia Computing and Systems, IEEE, pp. 141-147, 2016].
  63. A. Mostafa, A. Fouad, M. Abd Elfattah, A. E. Hassanien, H. Hefny, S. Y. Zhu, and G. Schaefer, “CT liver segmentation using artificial bee colony optimisation,” [in Proceedings of the 19th International Conference on Knowledge Based and Intelligent Jasim & Mohammed | 93 Information and Engineering Systems, Procedia Computer Science, Elsevier, vol. 60, pp. 1622-1630, 2015].
  64. S. Ait-Aoudia, E.-H. Guerrout, and R. Mahiou, “Medical image segmentation using particle swarm optimization,” [in Proceedings of the 18th International Conference on Information Visualization, IEEE, pp. 287- 291, 2014].
  65. R. Eberhart and J. Kennedy, “A new optimizer using particle swarm theory,” in Proceedings of the 6th International Symposium on Micro Machine and Human Science," IEEE, pp. 39-43.
  66. B. Birge, “PSOt-A particle swarm optimization toolbox for use with matlab,” [in Proceedings of the IEEE Swarm Intelligence Symposium, IEEE, pp. 182-186, 2003].
  67. A. P. Engelbrecht, “Fundamentals of computational swarm intelligence,” John Wiley & Sons, Inc, 2006.
  68. J, Kennedy, “Particle swarm optimization,” [in Proceedings of International Conference on the Encyclopedia of Machine Learning, Springer, pp. 760- 766, 2010].
  69. Y. Shi, “Particle swarm optimization: developments, applications and resources,” [in Proceedings of the Congress on Evolutionary Computation, IEEE, pp. 81-86, 2001].
  70. D. Van der Merwe and A. P. Engelbrecht, “Data clustering using particle swarm optimization,” [in Proceedings of the Congress on Evolutionary Computation, IEEE, pp. 215-220, 2003.