Color space and color channel selection on image segmentation of food images

Authors

  • Luthfi Maulana Universitas Brawijaya, Malang
  • Yusuf Gladiensyah Bihanda Universitas Brawijaya, Malang
  • Yuita Arum Sari Universitas Brawijaya, Malang

DOI:

https://doi.org/10.26594/register.v6i2.2061

Keywords:

color channel, color space, food image segmentation, food images, image segmentation

Abstract

Image segmentation is a predefined process of image processing to determine a specific object. One of the problems in food recognition and food estimation is the lack of quality of the result of image segmentation. This paper presents a comparative study of different color space and color channel selection in image segmentation of food images. Based on previous research regarding image segmentation used in food leftover estimation, this paper proposed a different approach to selecting color space and color channel based on the score of Intersection Over Union (IOU) and Dice from the whole dataset. The color transformation is required, and five color spaces were used: CIELAB, HSV, YUV, YCbCr, and HLS. The result shows that A in LAB and H in HLS are better to produce segmentation than other color channels, with the Dice score of both is 5 (the highest score). It concludes that this color channel selection is applicable to be embedded in the Automatic Food Leftover Estimation (AFLE) algorithm.

Author Biographies

Luthfi Maulana, Universitas Brawijaya, Malang

Department of Information Engineering

Yusuf Gladiensyah Bihanda, Universitas Brawijaya, Malang

Department of Information Engineering

Yuita Arum Sari, Universitas Brawijaya, Malang

Department of Information Engineering

References

J. Dehais, M. Anthimopoulos and S. Mougiakakou, "Food Image Segmentation for Dietary Assessment," in MADiMa '16: Proceedings of the 2nd International Workshop on Multimedia Assisted Dietary Management, Amsterdam, Netherlands, 2016.

G. Ciocca, P. Napoletano and R. Schettini, "Food Recognition and Leftover Estimation for Daily Diet Monitoring," in ICIAP 2015: New Trends in Image Analysis and Processing, Cham, 2015.

S. Mezgec, T. Eftimov, T. Bucher and B. K. Seljak, "Mixed deep learning and natural language processing method for fake-food image recognition and standardization to help automated dietary assessment," Public Health Nutrition, vol. 22, no. 7, p. 1193–1202, 2018.

Y. He, C. Xu, N. Khanna, C. J. Boushey and E. J. Delp, "Food image analysis: Segmentation, identification and weight estimation," in IEEE International Conference on Multimedia and Expo (ICME), San Jose, CA, 2013.

Y. A. Sari, R. K. Dewi, J. M. Maligan, L. Maulana and S. Adinugroho, "Automatic Leftover Weight Prediction in Tray Box Using Improved Image Segmentation Color Lighting Component," Journal of Southwest Jiaotong University, vol. 55, no. 1, 2020.

S. Inunganbi, A. Seal and P. Khanna, "Classification of Food Images through Interactive Image Segmentation," in Asian Conference on Intelligent Information and Database Systems, Cham, 2018.

Y. A. Sari, F. Utaminingrum, S. Adinugroho, R. K. Dewi, P. P. Adikara, R. C. Wihandika, S. Mutrofin and A. Izzah, "Indonesian Traditional Food Image Identification using Random Forest Classifier based on Color and Texture Features," in International Conference on Sustainable Information Engineering and Technology (SIET), Lombok, Indonesia, 2019.

G. Ciocca, P. Napoletano and R. Schettini, "Learning CNN-based Features for Retrieval of Food Images," in International Conference on Image Analysis and Processing, Cham, 2017.

K. Aizawa, K. Maeda, M. Ogawa, Y. Sato, M. Kasamatsu, K. Waki and H. Takimoto, "Comparative Study of the Routine Daily Usability of FoodLog: A Smartphonebased Food Recording Tool Assisted by Image Retrieval," Journal of Diabetes Science and Technology, vol. 8, no. 2, p. 203–208, 2014.

A. F. Ahsani, Y. A. Sari and P. P. Adikara, "Food Image Retrieval with Gray Level Co-Occurrence Matrix Texture Feature and CIE L*a*b* Color Moments Feature," in International Conference on Sustainable Information Engineering and Technology (SIET), Lombok, Indonesia, 2019.

Y. A. Sari, J. M. Maligan and Y. G. B. Sigit Adinugroho, "Multiple Food or Non-Food Detection in Single Tray Box Image using Fraction of Pixel Segmentation for Developing Smart NutritionBox Prototype," International Journal of Innovative Technology and Exploring Engineering (IJITEE), vol. 9, no. 3S, 2020.

Y. A. Sari, R. K. Dewi, J. M. Maligan, A. S. Ananta and S. Adinugroho, "Automatic Food Leftover Estimation in Tray Box Using Image Segmentation," in International Conference on Sustainable Information Engineering and Technology (SIET), Lombok, Indonesia, 2019.

L. Busin, N. Vandenbroucke and L. Macaire, "Color Spaces and Image Segmentation," in Advances in Imaging And Electron Physics, Elsevier, 2008.

J. Diaz-Cely, C. Arce-Lopera, J. C. Mena and L. Quintero, "The Effect of Color Channel Representations on the Transferability of Convolutional Neural Networks," in Science and Information Conference, Cham, 2020.

V. K. Singh, H. A. Rashwan, M. Abdel-Nasser, M. M. K. Sarker, F. Akram, N. Pandey, S. Romani and D. Puig, "An Efficient Solution for Breast Tumor Segmentation and Classification in Ultrasound Images Using Deep Adversarial Learning," arXiv, 2019.

K. J. Pfisterer, R. Amelard, A. G. Chung, B. Syrnyk, A. MacLean and A. Wong, "Fully-Automatic Semantic Segmentation for Food Intake Tracking in Long-Term Care Homes," arXiv, 2019.

T. S. K. M. Rabie, "Implementation of Some Similarity Coefficients in Conjunction With Multiple Upgma and Neighbor-Joining Algorithm," Egypt. Poult. Sci., vol. 30, no. 2, pp. 607-621.

P. Harnis, Y. A. Sari and M. A. Rahman, "Segmentasi Citra Kue Tradisional menggunakan Otsu Thresholding pada Ruang Warna CIE LAB," Jurnal Pengembangan Teknologi Informasi dan Ilmu Komputer, vol. 3, no. 7, pp. 6799-6808, 2019.

F. Y. Nabella, Y. A. Sari and R. C. Wihandika, "Seleksi Fitur Information Gain Pada Klasifikasi Citra Makanan Menggunakan Hue Saturation Value dan Gray Level Co-Occurrence Matrix," Jurnal Pengembangan Teknologi Informasi dan Ilmu Komputer, vol. 3, no. 2, pp. 1892-1900, 2019.

C. H. Arun and D. C. Durairaj, "Identifying Medicinal Plant Leaves Using Textures and Optimal Colour Spaces Channel," Jurnal Ilmu Komputer dan Informasi, vol. 10, no. 1, pp. 19-28, 2017.

A. Sevastopolsky, "Optic Disc and Cup Segmentation Methods for Glaucoma Detection with Modification of U-Net Convolutional Neural Network," Pattern Recognition and Image Analysis, vol. 27, p. 618–624, 2017.

Downloads

Published

2020-09-01

How to Cite

[1]
L. Maulana, Y. G. Bihanda, and Y. A. Sari, “Color space and color channel selection on image segmentation of food images”, Register: Jurnal Ilmiah Teknologi Sistem Informasi, vol. 6, no. 2, pp. 141–151, Sep. 2020.

Issue

Vol. 6 No. 2 (2020): July

Section

Article

License


Please find the rights and licenses in Register: Jurnal Ilmiah Teknologi Sistem Informasi. By submitting the article/manuscript of the article, the author(s) agree with this policy. No specific document sign-off is required.

1. License

The non-commercial use of the article will be governed by the Creative Commons Attribution license as currently displayed on Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

2. Author(s)' Warranties

The author warrants that the article is original, written by stated author(s), has not been published before, contains no unlawful statements, does not infringe the rights of others, is subject to copyright that is vested exclusively in the author and free of any third party rights, and that any necessary written permissions to quote from other sources have been obtained by the author(s).

3. User/Public Rights

Register's spirit is to disseminate articles published are as free as possible. Under the Creative Commons license, Register permits users to copy, distribute, display, and perform the work for non-commercial purposes only. Users will also need to attribute authors and Register on distributing works in the journal and other media of publications. Unless otherwise stated, the authors are public entities as soon as their articles got published.

4. Rights of Authors

Authors retain all their rights to the published works, such as (but not limited to) the following rights;

Copyright and other proprietary rights relating to the article, such as patent rights,
The right to use the substance of the article in own future works, including lectures and books,
The right to reproduce the article for own purposes,
The right to self-archive the article (please read out deposit policy),
The right to enter into separate, additional contractual arrangements for the non-exclusive distribution of the article's published version (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal (Register: Jurnal Ilmiah Teknologi Sistem Informasi).
5. Co-Authorship

If the article was jointly prepared by more than one author, any authors submitting the manuscript warrants that he/she has been authorized by all co-authors to be agreed on this copyright and license notice (agreement) on their behalf, and agrees to inform his/her co-authors of the terms of this policy. Register will not be held liable for anything that may arise due to the author(s) internal dispute. Register will only communicate with the corresponding author.

6. Royalties

Being an open accessed journal and disseminating articles for free under the Creative Commons license term mentioned, author(s) aware that Register entitles the author(s) to no royalties or other fees.

7. Miscellaneous

Register will publish the article (or have it published) in the journal if the article’s editorial process is successfully completed. Register's editors may modify the article to a style of punctuation, spelling, capitalization, referencing and usage that deems appropriate. The author acknowledges that the article may be published so that it will be publicly accessible and such access will be free of charge for the readers as mentioned in point 3.