🛒 Implement Purchase Location Feature

Issue Overview

Our system aims to help users not only recognize food but also identify where it can be purchased nearby or online. The Purchase Location feature will enable the model to return structured, accurate purchase options such as nearby grocery stores, supermarkets, or online marketplaces where the recognized food item can be obtained.

What is Needed

We’re looking for contributors to:

• Define effective prompts in the location_prompt.yml file that guide the LLM to generate structured, relevant purchase information for each food item.

• Implement tool functions in the location_tools.py script for retrieving location-based purchase data, integrating with public APIs.

• Integrate both components in the purchase_location.py script to return structured results

• Ensure the final output is structured, not plain text. It should include purchase options in a well-defined format

• Use the APIs provided in the contribution guidelines and any other public data sources (if needed) to ground responses for accuracy.

How You Can Contribute

• Fork the Repository: Start by forking the repository.

• Implement the Feature: Work within the purchase_location/ folder to define tools, prompts, and integration scripts.

• Follow Contribution Guidelines: Adhere to the contribution rules in the repo.

• Submit a Pull Request: Once completed, submit your PR with a short description, a few screenshots of successful sample generated purchase location to the PR comment, and mention any additional API requirements in your PR.

• Collaborate: We’ll review your implementation, test results, and work with you to finalize it.

Why This Matters

The Purchase Location feature brings convenience and accessibility to our system by connecting food recognition with real-world action by showing users where they can buy what they discover.

This helps bridge the gap between discovery and purchase, empowering users to explore new cuisines, find ingredients easily, and support local stores or online marketplaces.

Important Note

Contributors are required to use Azure OpenAI as the LLM for this feature. Please follow the setup instructions outlined in our Azure OpenAI Setup Process Guide to configure your environment before beginning your implementation.

🙌 Thank you for contributing to making our project smarter and more meaningful! Happy Coding!