Cover
Vol. 14 No. 2 (2018)

Published: December 31, 2018

Pages: 90-102

Original Article

A Content-Based Image Retrieval Method By Exploiting Cluster Shapes

Hanan Al-Jubouri 1 Hongbo Du 2
1Computer Engineering Department Mustansiriyah University Ali Taleb Street, Baghdad, Iraq
2Applied Computing Department Buckingham University MK18 1EG, Buckingham, UK
History
  • Received: October 31, 2018
  • Available Online: December 31, 2018
DOI

https://doi.org/10.37917/ijeee.14.2.1

Abstract

Content-Based Image Retrieval (CBIR) is an automatic process of retrieving images that are the most similar to a query image based on their visual content such as colour and texture features. However, CBIR faces the technical challenge known as the semantic gap between high level conceptual meaning and the low-level image based features. This paper presents a new method that addresses the semantic gap issue by exploiting cluster shapes. The method first extracts local colours and textures using Discrete Cosine Transform (DCT) coefficients. The Expectation-Maximization Gaussian Mixture Model (EM/GMM) clustering algorithm is then applied to the local feature vectors to obtain clusters of various shapes. To compare dissimilarity between two images, the method uses a dissimilarity measure based on the principle of Kullback-Leibler divergence to compare pair-wise dissimilarity of cluster shapes. The paper further investigates two respective scenarios when the number of clusters is fixed and adaptively determined according to cluster quality. Experiments are conducted on publicly available WANG and Caltech6 databases. The results demonstrate that the proposed retrieval mechanism based on cluster shapes increases the image discrimination, and when the number of clusters is fixed to a large number, the precision of image retrieval is better than that when the relatively small number of clusters is adaptively determined.

Keywords

References

  1. D. Feng, W. C. Siu, & H. J. Zhang (eds), “Multimedia retrieval and management technolgical fundamentals and applications”, Springer-Verlag Berlin Heidelberg, 2003.
  2. R. C. Veltkamp and M. Tanase, “Contentbased image retrieval systems: A survey”, Netherlands: Technical Report UU-CS-200034, Dept. of Computing Science, Utrecht University , October 2002.
  3. A. W Smeulders, M. Worring, S. Santini, A. retrieval at the end of the early years”, IEEE Transactions on Pattern Analysis and Machine
  4. R. Datta, W. Ge, J. Li, and J. Z. Wang, “Toward Bridging the Annotation-Retrieval 14(3), pp. 24-35, 2007.
  5. W. Niblack, R. Barber, W. Equitz, M. Flickner, E.H. Glasman, D. Petkovic and P. Yanker, “The QBIC project: querying images by content using color, texture, and shape”, Storage and Retrieval for Image and Video Databases , San Jose, CA, USA, pp. 173-187, 1993.
  6. J. R. Smith and S. F. Chang, “Querying by color regions using VisualSEEk contentbased visual query system”, Intelligent Multimedia Information Retrieval , MIT Press, Cambridge, MA, USA, pp. 23-41, 1997.
  7. C. Carson, M. Thomas, S. Belongie, J.M. Hellerstein and J. Malik, “Blobworld: A system for region-based image indexing and retrieval”, Visual Information and Information Systems, Springer, Berkeley, USA, pp. 509517, 1999.
  8. http://googleblog.blogspot.co.uk/2009/10/simil ar-images-graduates-from-google.html. Accessed 3 March 2017
  9. J. Lokoč, D. Novák, M. Batko, and T. Skopal, “Visual image search: feature signatures or/and Search and Applications , Springer-Verlag, Berlin, Heidelberg, pp. 177-191, 2012.
  10. S. Sakji-Nsibi and A. Benazza-Benyahia “Region-based image retrieval using a joint scalable Bayesian segmentation and feature extraction”, 24th IEEE European Conference on Signal Processing (EUSIPCO), pp. 12721276, 2016.
  11. L. Duan, S. Dong, S. Cui and W. Ma, “Extreme Learning Machine with Gaussian Kernel Based Relevance Feedback Scheme for Retrieval”, Proceedings Adaptation, Learning and Optimization , Springer, Cham, Vol 1 . pp 397-408, 2016.
  12. E.G. Karakasis, A. Amanatiadis, A. moment invariants as local features for content based image retrieval using the bag-of-visualwords model”, Pattern Recognition Letters , 55 , pp.22-27, 2015.
  13. W. Plant and G. Schaefer, “Navigation and Browsing of Image Databases”, International Conference of Soft Computing and Pattern Recognition , Malacca , pp. 750-755, 2009.
  14. H. Al-Jubouri, “Multi-evidence fusion scheme for content-based image retrieval by clustering localised colour and texture features”, Doctoral thesis, University of Buckingham, 2015.
  15. J. Wan, D. Wang, S.C.H. Hoi, P. Wu, J. Zhu, Y. Zhang and J. Li, “Deep Learning for Content-Based Retrieval: A Comprehensive Study”, Proceedings of the 22nd ACM International Conference on Multimedia: November, pp. 157-166, 2014.
  16. G. Graefe, “A survey of B-tree locking techniques”, ACM Trans Database Systems, vol. 35, pp.16:1--16:26, 2010.
  17. TK. Sellis, N. Roussopoulos, and C. Faloutsos, “The R + -tree: a dynamic index for multi-dimensional objects”, Proceedings of the 13th international conference on very large data bases , pp. 507-518, 1987.
  18. L-Y. Wei, Y-T Hsu, W-C Peng, and W-C Lee, “Indexing spatial data in cloud data managements”, Pervasive and Mobile Computing , Vol. 15, pp. 48-61, 2014.
  19. J. Wang, W. Liu, S. Kumar and S-F Chang, “Learning to Hash for Indexing Big Data - A Survey” Proceedings of IEEE, vol. 104, no. 1, pp. 34-57, 2015.
  20. J. Lay and L. Guan, “Image retrieval based on energy histograms of the low frequency DCT coefficients”, Proceedings of 1999 IEEE Conference on Acoustics, Speech, and Signal Processing , pp. 30093012, 1999.
  21. G. Schaefer, “Content-based image retrieval: Advanced topics”, Man-Machine Interactions 2. Springer Berlin Heidelberg , pp. 31-37, 2011.
  22. W. M. Abd-Elhafiez and W. Gharibi, “Color DCT Blocks,” arXiv preprint arXiv :1208.3133, 2012.
  23. H. B. Kekre, S. D. Thepade, R. N. Chaturvedi, & S. Gupta, “Walsh, Sine, Haar & Cosine Transform with various color spaces for 'Color to Gray and Back’”, (IJIP) , Vol.6, No.5, pp349-356, 2012.
  24. Y-L. Huang and R-F. Chang, “Texture features for DCT-coded image retrieval and classification”, Conference on Acoustics, Speech, and Signal Processing , Phoenix, AZ , pp. 3013-3016, 1999.
  25. T. Westerveld, A.P. de Vries, A. van Ballegooij, F. de Jong, and D. Hiemstra, “A probabilistic multimedia retrieval model and Signal Processing , Vol.2003, No.2, pp. 186198, 2003.
  26. H. Nezamabadi-Pour and S. Saryazdi, “ Object-based image indexing and retrieval in DCT domain using clustering techniques”, 101, 2007.
  27. H. Du, “Data mining techniques applications: an Cengage Learning EMEA , 2010.
  28. A. Jain “Data clustering beyond K-means”, Pattern Recognition Letters , Vol 31, pp. 651666, 2010.
  29. N. Vasconcelos, “Image Indexing with Mixture Hierarchies,” IEEE Conference in Computer Vision and Pattern Recognition , pp. 3-10, 2001.
  30. H. Al-Jubouri, H., Du, & H. Sellahewa, “Applying Gaussian Mixture Model on discrete cosine features for segmentation and classification”, Proceedings of 4 th Computer Science and Electronic Engineering Conference (CEEC) , Colchester, UK, pp. 194-199, 2012.
  31. H. Al-Jubouri, H., Du, & H. Sellahewa, “Adaptive clustering based segmentation for and Electronic Engineering Conference (CEEC) , Colchester, UK, pp. 128-133, 2013.
  32. C. A. Bouman, “Cluster: unsupervised algorithm for modeling Gaussian mixtures”, 1997. https://engineering.purdue.edu/~bouman/soft ware/cluster/manual.pdf , Accessed on December, 2018
  33. T. A. Myrvoll and F. K. Soong, “On divergence based clustering of normal distributions and its application to HMM adaptation”, Proceedings of 8 th European Conference on Speech Communication and Technology, Geneva , pp. 1517-1520, 2003.
  34. J. Z. Wang, “Integrated region-based image retrieval,” Norwell, MA, USA: Kluwer Academic Publishers , 2001.
  35. R. Fergus, P. Perona and A. Zisserman, “Object class recognition by unsupervised scale-invariant learning,”. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Oxford, UK, pp. II-264, 2003.
  36. H. Müller, W. Müller, D. M. Squire, S. Marchand-Maillet and T. Pun, “Performance Evaluation in Content-based Image Retrieval: Overview and Proposals,” Pattern Recognition Letters , 22(5), pp. 593-601, 2001.
  37. A. Field, "Discovery statistics using SPSS", London, UK: SAGE Publications, 2006.
  38. C. Feng, and X. Wang, “Image retrieval system based on bag of view words model”, Proceedings of 15th International Conference on Computer and Information Science (ICIS) , pp. 1-4, 2016.
  39. R. Vieux, J. Benois-Pineau and J-P. Domenger, “ Content Based Image Retrieval Using Bag-of-regions ”, Springer-Verlag Berlin Heidelberg , pp. 507-517, 2012.
  40. Z. Lu, L. Wang and J.R. Wen, “Image classification by visual bag-of-words refinement and reduction”, Neurocomputing , Vol.173, pp.373-384, 2016.
  41. V. Karpagam and R. Rangarajan, “A Simple and Competent System for Content Based Retrieval of Images using Color Indexed Wavelet Decomposition”, European Journal of Scientific Research , 73(2), pp. 278-190, 2012.
  42. M. Salmi and B. Boucheham, “Content based image retrieval based on Cell Color Coherence Vector (Cell-CCV)”, Proceedings of 4th International Symposium ISKOMaghreb: Concepts and Tools for knowledge Management , pp. 1-5, 2014.
  43. M. D. Chaudhary and A. B. Upadhyay, “Fusion of local and global features using Stationary Wavelet Transform for efficient Content Based Image Retrieval”, IEEE Students' Conference on Electrical, Electronics and Computer Science (SCEECS) , pp. 1-6, 2014.
  44. M.K. Kundu, M. Chowdhury, and S.R. Bulò, “A graph-based relevance feedback mechanism in content-based image retrieval”, Knowledge-Based Systems, Vol. 73 , pp.254264, 2015.
  45. L. Feng, J. Wu, S. Liu and H. Zhang. “Global correlation descriptor: a novel representation for image retrieval ”, Journal of Visual Communication and Representation , Vol. 33 , pp.104-114, 2015 .