AI Food Police

Tracking fried food from meal photos with the language model built into macOS By Irfan Alghani Khalid Project page: https://towardsdatascience.com/ai-food-police/ ShipAI is a Towards Data Science project. Watch all the videos here: https://towardsdatascience.com/videos/ Key takeaways. 1. A meal photo goes to Apple's on-device Foundation Model through the fm command and comes back as JSON. 2. Each meal is flagged for fried food or santan, logged to a Google Sheet and charted by week. 3. The first, loose prompt let the model invent plausible answers, so he kept tightening it until the JSON held. Chapters: 0:00 Food Police on Apple's model 0:50 Analyzing a plate of nasi goreng 2:42 The weekly analytics 3:39 The Streamlit and FastAPI code 7:03 Why not Gemini 8:13 Prompting with an image 10:17 Google Sheets as the database