Color space and color channel selection on image segmentation of food images

Authors

  • Luthfi Maulana Universitas Brawijaya, Malang
  • Yusuf Gladiensyah Bihanda Universitas Brawijaya, Malang
  • Yuita Arum Sari Universitas Brawijaya, Malang

DOI:

https://doi.org/10.26594/register.v6i2.2061

Keywords:

color channel, color space, food image segmentation, food images, image segmentation

Abstract

Image segmentation is a predefined process of image processing to determine a specific object. One of the problems in food recognition and food estimation is the lack of quality of the result of image segmentation. This paper presents a comparative study of different color space and color channel selection in image segmentation of food images. Based on previous research regarding image segmentation used in food leftover estimation, this paper proposed a different approach to selecting color space and color channel based on the score of Intersection Over Union (IOU) and Dice from the whole dataset. The color transformation is required, and five color spaces were used: CIELAB, HSV, YUV, YCbCr, and HLS. The result shows that A in LAB and H in HLS are better to produce segmentation than other color channels, with the Dice score of both is 5 (the highest score). It concludes that this color channel selection is applicable to be embedded in the Automatic Food Leftover Estimation (AFLE) algorithm.

Author Biographies

Luthfi Maulana, Universitas Brawijaya, Malang

Department of Information Engineering

Yusuf Gladiensyah Bihanda, Universitas Brawijaya, Malang

Department of Information Engineering

Yuita Arum Sari, Universitas Brawijaya, Malang

Department of Information Engineering

References

J. Dehais, M. Anthimopoulos and S. Mougiakakou, "Food Image Segmentation for Dietary Assessment," in MADiMa '16: Proceedings of the 2nd International Workshop on Multimedia Assisted Dietary Management, Amsterdam, Netherlands, 2016.

G. Ciocca, P. Napoletano and R. Schettini, "Food Recognition and Leftover Estimation for Daily Diet Monitoring," in ICIAP 2015: New Trends in Image Analysis and Processing, Cham, 2015.

S. Mezgec, T. Eftimov, T. Bucher and B. K. Seljak, "Mixed deep learning and natural language processing method for fake-food image recognition and standardization to help automated dietary assessment," Public Health Nutrition, vol. 22, no. 7, p. 1193–1202, 2018.

Y. He, C. Xu, N. Khanna, C. J. Boushey and E. J. Delp, "Food image analysis: Segmentation, identification and weight estimation," in IEEE International Conference on Multimedia and Expo (ICME), San Jose, CA, 2013.

Y. A. Sari, R. K. Dewi, J. M. Maligan, L. Maulana and S. Adinugroho, "Automatic Leftover Weight Prediction in Tray Box Using Improved Image Segmentation Color Lighting Component," Journal of Southwest Jiaotong University, vol. 55, no. 1, 2020.

S. Inunganbi, A. Seal and P. Khanna, "Classification of Food Images through Interactive Image Segmentation," in Asian Conference on Intelligent Information and Database Systems, Cham, 2018.

Y. A. Sari, F. Utaminingrum, S. Adinugroho, R. K. Dewi, P. P. Adikara, R. C. Wihandika, S. Mutrofin and A. Izzah, "Indonesian Traditional Food Image Identification using Random Forest Classifier based on Color and Texture Features," in International Conference on Sustainable Information Engineering and Technology (SIET), Lombok, Indonesia, 2019.

G. Ciocca, P. Napoletano and R. Schettini, "Learning CNN-based Features for Retrieval of Food Images," in International Conference on Image Analysis and Processing, Cham, 2017.

K. Aizawa, K. Maeda, M. Ogawa, Y. Sato, M. Kasamatsu, K. Waki and H. Takimoto, "Comparative Study of the Routine Daily Usability of FoodLog: A Smartphonebased Food Recording Tool Assisted by Image Retrieval," Journal of Diabetes Science and Technology, vol. 8, no. 2, p. 203–208, 2014.

A. F. Ahsani, Y. A. Sari and P. P. Adikara, "Food Image Retrieval with Gray Level Co-Occurrence Matrix Texture Feature and CIE L*a*b* Color Moments Feature," in International Conference on Sustainable Information Engineering and Technology (SIET), Lombok, Indonesia, 2019.

Y. A. Sari, J. M. Maligan and Y. G. B. Sigit Adinugroho, "Multiple Food or Non-Food Detection in Single Tray Box Image using Fraction of Pixel Segmentation for Developing Smart NutritionBox Prototype," International Journal of Innovative Technology and Exploring Engineering (IJITEE), vol. 9, no. 3S, 2020.

Y. A. Sari, R. K. Dewi, J. M. Maligan, A. S. Ananta and S. Adinugroho, "Automatic Food Leftover Estimation in Tray Box Using Image Segmentation," in International Conference on Sustainable Information Engineering and Technology (SIET), Lombok, Indonesia, 2019.

L. Busin, N. Vandenbroucke and L. Macaire, "Color Spaces and Image Segmentation," in Advances in Imaging And Electron Physics, Elsevier, 2008.

J. Diaz-Cely, C. Arce-Lopera, J. C. Mena and L. Quintero, "The Effect of Color Channel Representations on the Transferability of Convolutional Neural Networks," in Science and Information Conference, Cham, 2020.

V. K. Singh, H. A. Rashwan, M. Abdel-Nasser, M. M. K. Sarker, F. Akram, N. Pandey, S. Romani and D. Puig, "An Efficient Solution for Breast Tumor Segmentation and Classification in Ultrasound Images Using Deep Adversarial Learning," arXiv, 2019.

K. J. Pfisterer, R. Amelard, A. G. Chung, B. Syrnyk, A. MacLean and A. Wong, "Fully-Automatic Semantic Segmentation for Food Intake Tracking in Long-Term Care Homes," arXiv, 2019.

T. S. K. M. Rabie, "Implementation of Some Similarity Coefficients in Conjunction With Multiple Upgma and Neighbor-Joining Algorithm," Egypt. Poult. Sci., vol. 30, no. 2, pp. 607-621.

P. Harnis, Y. A. Sari and M. A. Rahman, "Segmentasi Citra Kue Tradisional menggunakan Otsu Thresholding pada Ruang Warna CIE LAB," Jurnal Pengembangan Teknologi Informasi dan Ilmu Komputer, vol. 3, no. 7, pp. 6799-6808, 2019.

F. Y. Nabella, Y. A. Sari and R. C. Wihandika, "Seleksi Fitur Information Gain Pada Klasifikasi Citra Makanan Menggunakan Hue Saturation Value dan Gray Level Co-Occurrence Matrix," Jurnal Pengembangan Teknologi Informasi dan Ilmu Komputer, vol. 3, no. 2, pp. 1892-1900, 2019.

C. H. Arun and D. C. Durairaj, "Identifying Medicinal Plant Leaves Using Textures and Optimal Colour Spaces Channel," Jurnal Ilmu Komputer dan Informasi, vol. 10, no. 1, pp. 19-28, 2017.

A. Sevastopolsky, "Optic Disc and Cup Segmentation Methods for Glaucoma Detection with Modification of U-Net Convolutional Neural Network," Pattern Recognition and Image Analysis, vol. 27, p. 618–624, 2017.

Downloads

Published

2020-09-01

How to Cite

[1]
L. Maulana, Y. G. Bihanda, and Y. A. Sari, “Color space and color channel selection on image segmentation of food images”, Register: Jurnal Ilmiah Teknologi Sistem Informasi, vol. 6, no. 2, pp. 141–151, Sep. 2020.

Issue

Section

Article