Cover
Vol. 20 No. 2 (2024)

Published: December 31, 2024

Pages: 127-136

Original Article

A Dataset for Kinship Estimation from Image of Hand Using Machine Learning

Sarah Ibrahim Fathi 1 Mazin H. Aziz
1Computer Engineering Department, University of Mosul, Mosul, Iraq
History
  • Received: June 16, 2023
  • Revised: October 14, 2023
  • Accepted: November 2, 2023
  • Available Online: June 19, 2024
DOI

https://doi.org/10.37917/ijeee.20.2.11

Abstract

Kinship (Familial relationships) detection is crucial in many fields and has applications in biometric security, adoption, forensic investigations, and more. It is also essential during wars and natural disasters like earthquakes since it may aid in reunion, missing person searches, establishing emergency contacts, and providing psychological support. The most common method of determining kinship is DNA analysis which is highly accurate. Another approach, which is noninvasive, uses facial photos with computer vision and machine learning algorithms for kinship estimation. Each part of the Human -body has its own embedded information that can be extracted and adopted for identification, verification, or classification of that person. Kinship recognition is based on finding traits that are shared by every family. We investigate the use of hand geometry for kinship detection, which is a new approach. Because of the available hand image Datasets do not contain kinship ground truth; therefore, we created our own dataset. This paper describes the tools, methodology, and details of the collected MKH, which stands for the Mosul Kinship Hand, images dataset. The images of MKH dataset were collected using a mobile phone camera with a suitable setup and consisted of 648 images for 81 individuals from 14 families (8 hand situations per person). This paper also presents the use of this dataset in kinship prediction using machine learning. Google MdiaPipe was used for hand detection, segmentation, and geometrical key points finding. Handcraft feature extraction was used to extract 43 distinctive geometrical features from each image. A neural network classifier was designed and trained to predict kinship, yielding about 93% prediction accuracy. The results of this novel approach demonstrated that the hand possesses biometric characteristics that may be used to establish kinship, and that the suggested method is a promising way as a kinship indicator.

Keywords

References

  1. X. Wu, X. Feng, X. Cao, X. Xu, D. Hu, M. B. L´opez, and L. Liu, “Facial Kinship Verification: A Compre- hensive Review and Outlook,” International Journal of Computer Vision, vol. 130, no. 6, pp. 1494–1525, 2022.
  2. S. Albalawi, L. Alshahrani, N. Albalawi, R. Kilabi, and A. Alhakamy, “A Comprehensive Overview on Biomet- ric Authentication Systems using Artificial Intelligence Techniques,” Int J Adv Comput Sci Appl, vol. 13, no. 4, pp. 782–791, 2022.
  3. K. Pˇrihodov´a and M. Hub, “Biometric Privacy Through Hand Geometry-a Survey,” in 2019 International Con- ference on Information and Digital Technologies (IDT), pp. 395–401, IEEE, 2019.
  4. M. Baˇca, P. Grd, and T. Fotak, “Basic Principles and Trends in Hand Geometry and Hand Shape Biometrics,” New Trends and Developments in Biometrics, pp. 77–99, 2012.
  5. T. Sabhanayagam, V. P. Venkatesan, and K. Senthama- raikannan, “A Comprehensive Survey on Various Bio- metric Systems,” International Journal of Applied Engi- neering Research, vol. 13, no. 5, pp. 2276–2297, 2018.
  6. W. Wang, S. You, S. Karaoglu, and T. Gevers, “A Sur- vey on Kinship Verification,” Neurocomputing, vol. 525, pp. 1–28, 2023.
  7. M. M. T. Al Mossawy and L. E. George, “A Digital Sig- nature System Based on Hand Geometry-Survey: Basic Components of Hand-based Biometric System,” Wasit Journal of Computer and Mathematics Science, vol. 1, no. 1, pp. 1–14, 2022.
  8. P. Varchol and D. Levicky, “Using of Hand Geometry in Biometric Security Systems,” Radio engineering Prague, vol. 16, no. 4, p. 82, 2007.
  9. S. Angadi and S. Hatture, “ Hand Geometry Based User Identification Using Minimal Edge Connected Hand Im- age Graph,” IET computer vision, vol. 12, no. 5, pp. 744– 752, 2018. 134 [10] M. Nasipuri, “Human Gender Classification Based on Hand Images Using Deep Learning,” in Artificial In- telligence: First International Symposium, ISAI 2022, Haldia, India, February 17-22, 2022, Revised Selected Papers, p. 314, Springer Nature, 2023.
  10. M. Afifi, “11K Hands: Gender Recognition and Bio- metric Identification Using a Large Dataset of Hand Images,” Multimedia Tools and Applications, vol. 78, pp. 20835–20854, 2019.
  11. M. Wu, Y. Yuan, et al., “Gender Classification Based 135 | Fathi & Aziz on Geometry Features of Palm Image,” The Scientific World Journal, vol. 2014, 2014.
  12. S.-C. Jee, Y. S. Lee, J. H. Lee, S. Park, B. Jin, and M. H. Yun, “Anthropometric Classification of Human Hand Shapes in Korean Population,” in Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 60, pp. 1200–1204, SAGE Publications Sage CA: Los Angeles, CA, 2016.
  13. A. Bera, D. Bhattacharjee, and M. Nasipuri, “Person Recognition Using Alternative Hand Geometry,” Inter- national Journal of Biometrics, vol. 6, no. 3, pp. 231– 247, 2014.
  14. M. A. Abderrahmane, I. Guelzim, and A. A. Abdeloua- had, “Human Age Prediction Based on Hand Image Using Multiclass Classification,” in 2020 International Conference on Data Analytics for Business and Industry: Way Towards a Sustainable Economy (ICDABI), pp. 1–5, IEEE, 2020.
  15. I. Ahmad and M. Khan, Hand Recognition Using Palm And Hand Geometry Features. LAP LAMBERT Aca- demic Publishing, 2017.
  16. M. S. Velmurugan and S. Selvarajan, “Linear Binary Pat- tern Based Biometric Recognition Using Hand Geom- etry and Iris Images,” International Journal of Applied Engineering Research, vol. 10, no. 24, pp. 45675–45683, 2015.
  17. H. H. Mohammed, S. A. Baker, and A. S. Nori, “Biomet- ric Identity Authentication System Using Hand Geome- try Measurements,” in Journal of Physics: Conference Series, vol. 1804, p. 012144, IOP Publishing, 2021.
  18. R. Kabir, M. Rahman, M. Ahsanul, M. Rahman, and M. Kabir, “A Simple Approach to Recognize a Person Using Hand Geometry,” Ulab J. Sci. Eng., vol. 1, no. 1, pp. 19–25, 2010.
  19. N. L. Baisa, B. Williams, H. Rahmani, P. Angelov, and S. Black, “Hand-Based Person Identification Us- ing Global and Part-Aware Deep Feature Representation Learning,” in 2022 Eleventh International Conference on Image Processing Theory, Tools and Applications (IPTA), pp. 1–6, IEEE, 2022.
  20. N. L. Baisa, “Joint Person Identity, Gender and Age Es- timation from Hand Images using Deep Multi-Task Rep- resentation Learning,” arXiv preprint arXiv:2303.15263, 2023.
  21. M. Ghaderzadeh, F. Asadi, A. Hosseini, D. Bashash, H. Abolghasemi, and A. Roshanpour, “Machine Learn- ing in Detection and Classification of Leukemia Using Smear Blood Images: A Systematic Review,” Scientific Programming, vol. 2021, pp. 1–14, 2021.
  22. P. Wang, E. Fan, and P. Wang, “ Comparative Analysis of Image Classification Algorithms Based on Traditional Machine Learning and Deep Learning,” Pattern Recog- nition Letters, vol. 141, pp. 61–67, 2021.
  23. S. Dargan and M. Kumar, “A Comprehensive Survey on the Biometric Recognition Systems Based on Physio- logical and Behavioral Modalities,” Expert Systems with Applications, vol. 143, p. 113114, 2020.
  24. O. Laiadi, Kinship Verification Between Two People by Machine Learning. PhD thesis, Universit´e Mohamed Khider–Biskra, 2021.
  25. A. Goyal and T. Meenpal, “ Kinship Verification from Facial Images Using Feature Descriptors ,” in Cognitive Informatics and Soft Computing: Proceeding of CISC 2017, pp. 371–380, Springer, 2019.
  26. L. Fei, B. Zhang, Y. Xu, and L. Yan, “Palmprint Recog- nition Using Neighboring Direction Indicator,” IEEE transactions on human-machine systems, vol. 46, no. 6, pp. 787–798, 2016.
  27. A. Kumar, “IIT Delhi Touchless Palmprint Database (Version 1.0),” 2006. Accessed on February 8, 2024.
  28. J. Qi, K. Xu, and X. Ding, “Approach to Hand Pos- ture Recognition Based on Hand Shape Features for Human–Robot Interaction,” Complex & Intelligent Sys- tems, pp. 1–18, 2021.
  29. R. Vasavi, N. Rahul, A. Snigdha, K. J. Moses, and S. V. Simha, “Painting with Hand Gestures using MediaPipe,” Int. J. Innov. Sci. Res. Technol., vol. 7, no. 12, pp. 1285– 1291, 2022.
  30. C.-Y. Yang, Y.-N. Lin, S.-K. Wang, V. R. Shen, Y.-C. Tung, F. H. Shen, and C.-H. Huang, “Smart Control of Home Appliances Using Hand Gesture Recognition in an IoT-Enabled System,” Applied Artificial Intelligence, vol. 37, no. 1, p. 2176607, 2023.
  31. J. Cabero, Algebra and Trigonometry. National Book Store, 2008.
  32. J. Stewart, L. Redlin, and S. Watson, Precalculus: Math- ematics for Calculus. Cengage Learning, 2015. 136 | Fathi & Aziz
  33. F. Mateo, A. Tarazona, and E. M. Mateo, “ Comparative Study of Several Machine Learning Algorithms for Clas- sification of Unifloral Honeys,” Foods, vol. 10, no. 7, p. 1543, 2021.
  34. I. H. Sarker, H. Alqahtani, F. Alsolami, A. I. Khan, Y. B. Abushark, and M. K. Siddiqui, “Context Pre-Modeling: An Empirical Analysis for Classification Based User- Centric Context-Aware Predictive Modeling,” Journal Of Big Data, vol. 7, no. 1, pp. 1–23, 2020.