IoT smart home appliance that captures candid photos of your family’s special moments using a combination of emotion detection and phrase detection. This app is a great appliance for families to capture fun moments between family members or improve your mood by playing happy songs when you are sad.

Built with

• NodeJs
• Mosquito
• Node-red
• MongoDB
• Flutter

Getting started

To run the application, you will need Node JS, MongoDB, Mosquito, Node red and Futter installed on your machine.

• Clone this repo
• Navigate to the server folder, install the required dependencies and run node app.js to start the local server
• Import Node-red/spotify_flow.json into your Node-RED instance from the node-red folder.
• Navigate to the fultter folder to run the Flutter app.

Using node-red's Spotify integration

• To use the Spotify tool in node red you will have to make an account on Spotify.
• After creating your account go to Spotify Developers to login and create an App to get a Client ID and Secret.
• Enter your Client ID and Client Secret in the Spotify Node.
• This is the scope to Start/Resume a Users Playback; user-modify-playback-state.
• After authorizing you Select the API "play" and you are done with setting up the Spotify node.
• Please refer to the Spotify's Web API reference to know about utilizing other API's. Please note: to use the 'Play' functionality you must have Spotify premium activated

Using MQTT

Websockets are used on the edge device using port 9001. Add the following configration to the mosquitto.conf file.

listener 443
protocol websockets

Views

Smart home edge device running on Browser

Our smart home application runs on the Chrome Browser where it does facial emotion detection, take picture with voice command and blur detection.

Candid Capture Website

The candid capture website allows users to login and view their photos.

Candid Capture flutter app

The flutter app has two activities, one to show the pictures taken of the user and the other to deal with the configurations/Settings.

Overall Architecture

Edge-device functionalities

The following diagram shows the functionalities of the browser which acts as our edge device.

Configuration

Users can modify the various settings of their home system such as; Camera on/off, camera timmings, camera frequency, spotify album. The following is the pictorial representation of changing the configuration.

Handling Images

The following flow diagram outlines how the edge device, server, browser and flutter are integrated when the appropriate picture is taken.

License

MIT

Authors

Project was build was part of our University Internet of Things course at AUS by

• Jeremy Dsilva
• Dhriti Adyanthaya
• Shaham Kampala