Raspberry Pi smart fridge uses Chat GPT4 to keep track of your food
Mimobeano, a maker and developer, has ventured into the realm of smart home devices with their latest creation: a Chat GPT-driven smart fridge powered by our beloved single-board computer, the Raspberry Pi. This innovative project aims to streamline kitchen organization by assisting users in keeping track of the food items stored in their fridge.
Originally conceived as a project for their master’s degree, Mimobeano’s smart fridge was initially programmed to recognize 12 specific food items using a model trained on thousands of images. However, after a few years, they decided to enhance the project by integrating GPT4-Vision, enabling the system to autonomously analyze fridge contents without relying on predefined categories.
The smart fridge operates by capturing an image each time the fridge door is opened, which is then processed through GPT4-Vision to identify food items. Mimobeano utilizes Telegram to send specific requests to the system, such as compiling a list of ingredients. The Raspberry Pi, connected to an HQ camera module with a wide-angle lens, hosts a bot that interfaces with the OpenAI API to interpret and fulfill these requests.
Future enhancements for the project include the development of a custom, 3D-printed mount to capture images at a more optimal angle and integration of features to monitor food expiration dates. Mimobeano’s dedication to improving and expanding the functionality of their smart fridge promises exciting developments in the realm of kitchen automation. To learn more about this Raspberry Pi project and stay updated on its progress, check out the original Reddit thread and follow Mimobeano for future updates.