Food Photo Recognition for Dietary Tracking: System and Experiment

Page view(s)
Checked on Jun 08, 2024
Food Photo Recognition for Dietary Tracking: System and Experiment
Food Photo Recognition for Dietary Tracking: System and Experiment
Journal Title:
International Conference on Multimedia Modeling
Publication Date:
13 January 2018
Ming, Z.Y., Chen, J., Cao, Y., Forde, C.G., Ngo, C.W. and Chua, T.S. (2018). Food photo recognition for dietary tracking; system and experiment. Proceedings of the 23rd International MMM Conference on Multi-Media Modelling, MMM, 2, 129-141. doi: 10.1007/978-3-319-73600-6_12.
Tracking dietary intake is an important task for health management especially for chronic diseases such as obesity, diabetes, and cardiovascular diseases. Given the popularity of personal hand-held devices, mobile applications provide a promising low-cost solution to tackle the key risk factor by diet monitoring. In this work, we propose a photo based dietary tracking system that employs deep-based image recognition algorithms to recognize food and analyze nutrition. The system is beneficial for patients to manage their dietary and nutrition intake, and for the medical institutions to intervene and treat the chronic diseases. To the best of our knowledge, there are no popular applications in the market that provide a high-performance food photo recognition like ours, which is more convenient and intuitive to enter food than textual typing. We conducted experiments on evaluating the recognition accuracy on laboratory data and real user data on Singapore local food, which shed light on uplifting lab trained image recognition models in real applications. In addition, we have conducted user study to verify that our proposed method has the potential to foster higher user engagement rate as compared to existing apps based dietary tracking approaches.
License type:
Funding Info:
This research is supported by the Human Nutritional Sciences Research, under the BMRC Transition Funds (TA) (H16/99/b0/007).
This is a post-peer-review, pre-copyedit version of an article published in International Conference on Multimedia Modeling. The final authenticated version is available online at:
Files uploaded:

File Size Format Action
4-mmm2018-3.pdf 3.86 MB PDF Open