Smart Evaluation Solution

This project is a collaborative effort to integrate cutting-edge AI technologies into Heineken Vietnam's operations, enhancing efficiency, customer experience, and strategic decision-makin

---

Table of Contents

• 📍 Overview
• Workflow
• 👾 Demo
• 🧩 Features
• 🤖Technologies Used
• 🚀 Usage
• 🧑‍💻 Contributing

📍 Overview

HEINEKEN Vietnam, the leading beer producer in Vietnam, aims to revolutionize brand experience for consumers. From local retail stores to favorite hangout spots with friends, you can easily spot Heineken's advertising materials (banners, posters, LED signs, etc.). These elements contribute to an engaging and memorable experience for customers. However, manually inspecting and evaluating these setups through images is time-consuming and costly for the company.

Our mission is to develop an image analysis tool that can automatically detect the following elements:

1. Brand Logos: Detect logos of Heineken, Tiger, Bia Viet, Larue, Bivina, Edelweiss, and Strongbow.
2. Products: Recognize beer cases and bottles.
3. Consumers: Evaluate the number, activities, and emotions of customers.
4. Advertising Materials: Identify posters, banners, and brand advertisements.
5. Image Context: Analyze the location—restaurant, bar, grocery store, or supermarket, etc.

This project leverages advanced AI technologies, including Optical Character Recognition (OCR) and Large Language Models (LLMs), to process and analyze data collected from various retail settings. The workflow ensures data accuracy, extracts meaningful features, and generates predictive insights that guide strategic adjustments.

Workfow

🤖Technologies Used

• Optical Character Recognition (OCR)
• Large Language Models (LLMs)
• Machine Learning and AI Algorithms
• Data Analysis and Visualization Tools

👾 Demo

🧩 Features

• Object Detection: Accurately identifies objects within images using advanced GenAI models.

• Insight Generation: Offers suggestions based on detected objects and user-provided context.

• User-Friendly Interface: Easy to use and understand, allowing for quick and efficient analysis.

🚀 Usage

1. Installation:

https://github.com/MinLee0210/Smart-Evaluation-Solution.git
cd /Smart-Evaluation-Solution
pip install -r requirements.txt

2. Setup the environment

Then, you are required to get the API key from Gemini and Groq:

• Gemini's API key
• Groq's API key

After that, let's create a .env file and follow this format:

GEMINI_API_KEY="GEMINI_API_KEY"
GROQ_API_KEY="GROQ_API_KEY"

We leave the .env.examples as a template for implementing our environment.

3. Running the Application:

Navigate to the project directory in your terminal. Run the following command:

streamlit run app.py

Note:

For those whose machine can not serve any requirements of any models that we use, we suggest running this app on Colab. We can test the app by tunnelling Colab to our local machine. We leave the link of our Colab experiment here. Remember to get NGROK's API key for the best experiment.

🧑‍💻 Contributing

• Lê Đức Minh | LinkedIn: /in/minh-le-duc/ | Gmail: [email protected]
• Lê Nguyễn Đăng Khoa | LinkedIn: /in/khoale-maiu/ | Gmail: [email protected]
• Trần Ngọc Đại | LinkedIn: /in/ngoc-dai-tran/ | Gmail: [email protected]
• Phạm Minh Mẫn | LinkedIn: /in/man-pham/ | Gmail: [email protected]