Researchers have developed a novel method for estimating the volume of food from egocentric stereo video, eliminating the need for manual scale calibration or reference objects. This approach utilizes FoundationStereo for zero-shot stereo matching, SAM 2 for food segmentation, and TSDF fusion to create a 3D mesh of plated food items from a single stereo recording. By leveraging wearable devices with factory-calibrated stereo baselines and on-device visual-inertial odometry for camera pose estimation, the system achieves a mean absolute percentage error of 9.1% across five tested food items, paving the way for passive dietary intake monitoring. AI
IMPACT Enables passive dietary monitoring and could improve health tracking applications.
RANK_REASON Academic paper detailing a new computer vision method for food volume estimation. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- arXiv
- CatalyzeX
- CORE Recommender
- DagsHub
- FoundationStereo
- Gotit.pub
- Hugging Face
- Influence Flower
- SAM 2
- ScienceCast
- The Synthetic Dream Foundation
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →